-- Logs begin at Fri 2022-05-27 15:38:25 UTC, end at Fri 2022-05-27 16:50:46 UTC. -- May 27 16:18:56.035750 dv-cinder-835553-1-smb systemd[1]: Starting Devstack devstack@keystone.service... May 27 16:18:56.044781 dv-cinder-835553-1-smb devstack@keystone.service[80253]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 27 16:18:56.046821 dv-cinder-835553-1-smb devstack@keystone.service[80253]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 16:18:56 2022] *** May 27 16:18:56.046821 dv-cinder-835553-1-smb devstack@keystone.service[80253]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 16:18:56.046821 dv-cinder-835553-1-smb devstack@keystone.service[80253]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 16:18:56.046821 dv-cinder-835553-1-smb devstack@keystone.service[80253]: nodename: dv-cinder-835553-1-smb May 27 16:18:56.046821 dv-cinder-835553-1-smb devstack@keystone.service[80253]: machine: x86_64 May 27 16:18:56.046821 dv-cinder-835553-1-smb devstack@keystone.service[80253]: clock source: unix May 27 16:18:56.046821 dv-cinder-835553-1-smb devstack@keystone.service[80253]: pcre jit disabled May 27 16:18:56.046821 dv-cinder-835553-1-smb devstack@keystone.service[80253]: detected number of CPU cores: 4 May 27 16:18:56.046821 dv-cinder-835553-1-smb devstack@keystone.service[80253]: current working directory: / May 27 16:18:56.046821 dv-cinder-835553-1-smb devstack@keystone.service[80253]: detected binary path: /usr/bin/uwsgi-core May 27 16:18:56.047369 dv-cinder-835553-1-smb devstack@keystone.service[80253]: your processes number limit is 47680 May 27 16:18:56.047369 dv-cinder-835553-1-smb devstack@keystone.service[80253]: your memory page size is 4096 bytes May 27 16:18:56.047369 dv-cinder-835553-1-smb devstack@keystone.service[80253]: detected max file descriptor number: 2048 May 27 16:18:56.047369 dv-cinder-835553-1-smb devstack@keystone.service[80253]: lock engine: pthread robust mutexes May 27 16:18:56.047369 dv-cinder-835553-1-smb devstack@keystone.service[80253]: thunder lock: enabled May 27 16:18:56.047369 dv-cinder-835553-1-smb devstack@keystone.service[80253]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 27 16:18:56.047369 dv-cinder-835553-1-smb devstack@keystone.service[80253]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 16:18:56.091054 dv-cinder-835553-1-smb devstack@keystone.service[80253]: Python main interpreter initialized at 0x56019aa669c0 May 27 16:18:56.091054 dv-cinder-835553-1-smb devstack@keystone.service[80253]: python threads support enabled May 27 16:18:56.091054 dv-cinder-835553-1-smb devstack@keystone.service[80253]: your server socket listen backlog is limited to 100 connections May 27 16:18:56.091054 dv-cinder-835553-1-smb devstack@keystone.service[80253]: your mercy for graceful operations on workers is 90 seconds May 27 16:18:56.091454 dv-cinder-835553-1-smb devstack@keystone.service[80253]: mapped 403077 bytes (393 KB) for 2 cores May 27 16:18:56.091454 dv-cinder-835553-1-smb devstack@keystone.service[80253]: *** Operational MODE: preforking *** May 27 16:18:56.091754 dv-cinder-835553-1-smb devstack@keystone.service[80253]: *** uWSGI is running in multiple interpreter mode *** May 27 16:18:56.091754 dv-cinder-835553-1-smb devstack@keystone.service[80253]: spawned uWSGI master process (pid: 80253) May 27 16:18:56.091975 dv-cinder-835553-1-smb systemd[1]: Started Devstack devstack@keystone.service. May 27 16:18:56.096040 dv-cinder-835553-1-smb devstack@keystone.service[80253]: spawned uWSGI worker 1 (pid: 80263, cores: 1) May 27 16:18:56.096040 dv-cinder-835553-1-smb devstack@keystone.service[80253]: spawned uWSGI worker 2 (pid: 80264, cores: 1) May 27 16:18:56.096040 dv-cinder-835553-1-smb devstack@keystone.service[80253]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 16:19:01.686933 dv-cinder-835553-1-smb devstack@keystone.service[80264]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 16:19:01.686933 dv-cinder-835553-1-smb devstack@keystone.service[80264]: from cryptography.utils import int_from_bytes May 27 16:19:01.687780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 16:19:01.687780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: from cryptography.utils import int_from_bytes May 27 16:19:01.731008 dv-cinder-835553-1-smb devstack@keystone.service[80263]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 16:19:01.731008 dv-cinder-835553-1-smb devstack@keystone.service[80263]: from cryptography.utils import int_from_bytes May 27 16:19:01.731662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 16:19:01.731662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: from cryptography.utils import int_from_bytes May 27 16:19:01.736672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 16:19:01.736864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 16:19:01.737055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] command line args: [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 16:19:01.737321 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 16:19:01.737496 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ================================================================================ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 16:19:01.737773 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] admin_token = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.738014 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] config_dir = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.738171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.738379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] config_source = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.738509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] debug = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.738724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.739932 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.739932 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.739932 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.739932 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.739932 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.740295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] log_config_append = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.740295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.740413 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] log_dir = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.740631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] log_file = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.740869 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.741111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.741586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.741586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.741753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.741924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.742164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.742403 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.742631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.742866 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.743089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.743318 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.743565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.743804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.744096 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.744576 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.41/identity {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.744755 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] publish_errors = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.744982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.745211 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.745385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.745626 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.745854 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.746083 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] standard_threads = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.746310 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.746545 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.746718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.746889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] use_journal = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.747060 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] use_json = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.747231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] use_stderr = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.747401 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] use_syslog = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.747626 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.747881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.748138 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.748397 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.748632 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.748873 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.749105 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.749347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.749578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.749819 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.750060 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.750307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.750537 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.750778 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.751008 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.751251 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.751493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.751725 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.751973 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.752243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.752484 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.752718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.752965 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.753218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.753463 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.753705 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.753931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.754157 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.754383 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.754612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.754855 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.755096 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.755323 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.755547 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.755879 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.756165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.756406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.756651 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.756877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.757108 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.757341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.757564 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.757786 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.757995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.758218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.758444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.758683 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.758908 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.759133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.759343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.759570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.759796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.760056 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.760283 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.760513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.760741 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.760971 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.761205 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.761432 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.761654 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.761895 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.762122 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.762354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.762577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.762831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.763063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.763287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.763518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.763748 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.764031 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.764264 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.764505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.764744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.764975 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.765204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.765433 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.765673 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.765904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.766135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.766371 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.766602 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.766833 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.767063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.767290 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.767518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.767772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.768029 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.768261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.768491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.768726 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.768956 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.769185 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.769415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.769639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.769862 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.770087 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.770315 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.770539 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.770772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.771002 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.771247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.771502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.771799 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.772207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.772449 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.772679 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.external = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.772908 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.773198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.773431 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.773659 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.password = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.773886 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] auth.token = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.774120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.774350 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.774591 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.774819 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.775061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.775303 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.775529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.775760 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.776002 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.776266 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.776508 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.776740 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.776977 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.777206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.777463 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.777709 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.777939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.778188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.778464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.778668 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 16:19:01.778751 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.778874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 16:19:01.778965 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.779078 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] command line args: [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 16:19:01.779158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.779352 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 16:19:01.779430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.779532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ================================================================================ {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 16:19:01.779620 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.779792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] admin_token = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.779872 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.780058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] config_dir = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.780151 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.780253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.780345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.780420 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] config_source = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.780537 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.780616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] debug = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.780779 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.780859 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.781009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.781091 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.781188 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.781267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.781442 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.781563 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.781691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.781804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.781923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.782034 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.782142 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] log_config_append = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.782248 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.782347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.782443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.782540 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] log_dir = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.782671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] log_file = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.782750 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.782832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.782947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.783048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.783135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.783277 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.783359 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.783516 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.783605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.783705 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.783785 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.783891 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.783979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.784162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.784260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.784411 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.784492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.784645 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.784725 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.784877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.784965 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.785104 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.785184 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.785334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.785412 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.785586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.785674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.785835 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.785915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.786097 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.786178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.786341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.786596 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.41/identity {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.786676 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.786781 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] publish_errors = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.786871 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.787082 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.787335 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.787438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.787503 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.787898 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.788060 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.788147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.788223 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.788296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.788369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] standard_threads = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.788454 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.788676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.788768 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.788843 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.788916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.788988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.789060 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.789140 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] use_journal = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.789140 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] use_json = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.789312 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.789424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] use_stderr = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.789503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.789575 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] use_syslog = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.789658 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.789734 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 16:19:01.789833 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.789947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.790076 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.790188 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.790318 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.790449 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.790543 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.790687 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.790768 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.790936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.791017 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.791173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.791257 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.791411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.791492 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.791645 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.791724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.791879 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.791960 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.792146 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.792227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.792391 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.792472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.792623 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.792704 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.792847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.792933 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.793072 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.793154 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.793315 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.793398 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.793557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.793644 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.793790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.793871 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.794020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.794110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.794251 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.794344 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.794476 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.794634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.794717 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.794791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.794949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.795033 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.795175 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.795256 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.795414 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.795495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.795653 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.795736 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.795891 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.795975 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.796145 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.796230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.796370 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.796452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.796599 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.796680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.796827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.796909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.797056 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.797139 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.797279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.797369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.797507 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.797587 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.797754 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.797841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.797992 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.798071 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.798228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.798307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.798464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.798545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.798688 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.798769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.798921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.799000 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.799152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.799234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.799385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.799466 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.799618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.799736 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.799847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.799933 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.800097 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.800196 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.800333 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.800425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.800581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.800671 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.800813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.800903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.801049 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.801138 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.801281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.801378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.801516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.801605 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.801750 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.801840 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.802004 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.802082 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.802206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.802298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.802443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.802526 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.802700 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.802843 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.802952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.803050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.803149 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.803242 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.803514 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.803597 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.803759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.803840 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.803993 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.804108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.804257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.804345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.804497 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.804579 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.804726 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.804817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.804966 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.805049 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.805199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.805281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.805426 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.805507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.805653 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] role.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.805735 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.805886 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.805966 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] role.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.806109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.806189 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.806357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.806440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.806601 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.806689 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.806844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.806933 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.807079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.807167 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.807313 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.807396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.807548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.807638 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.807787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.807868 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.808069 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.808158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.808278 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.808373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.808520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.808601 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.808758 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.808839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.808994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.809083 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.809230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.809312 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.809465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.809644 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.809727 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.809877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.809960 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.810122 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.810205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.810367 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.810449 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.810611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.810694 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.810857 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.810937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.811094 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.811175 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.811331 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.811413 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.811565 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.811647 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.811798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.811880 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.812040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.812124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.812274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.812356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.812504 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.812586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.812732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.812814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.812973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.813061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.813214 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.813296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.813443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.813525 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.813674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.813755 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.813898 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.813980 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.814127 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] token.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.814210 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.814358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.814440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.814601 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.814684 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.external = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.814828 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.814909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.815078 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.815160 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.815322 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.815413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.815553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.815636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.password = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.815779 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] auth.token = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.815859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.816030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.816130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.816271 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.816352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.816501 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.816581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.816733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.816822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.816961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.817041 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.817200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.817282 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.817431 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.817520 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.817660 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.817741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.817898 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.817970 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.818140 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.818229 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.818441 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.818559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.818807 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.818897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.819049 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.819131 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.819285 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.819376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.819526 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.819608 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.819757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.819839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.819989 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.820103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.820243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.820325 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.820474 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.820561 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.820716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.820806 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.820949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.821031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.821188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.821268 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.821423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.821513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.821667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.821750 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.821896 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.821983 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.822144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.822300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.822368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.822438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.822589 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.822661 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.822818 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.822908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.822985 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80264) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 16:19:01.823102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.823362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.823600 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.823854 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.824114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.824364 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.824598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.824847 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.825094 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.825330 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.825564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.825809 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.826037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.826273 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.826522 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.826773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.827004 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.827234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.827463 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.827707 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.827952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.828221 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.828474 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.828720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.828989 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.829227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.829464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.829693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.829928 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.830159 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.830393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.830633 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.831219 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.831464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.831693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.831939 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.832210 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.832447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.832691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.832937 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.833171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.833408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.833637 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.833889 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.834179 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.834392 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.834601 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.834828 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.835076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.835323 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.835555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.835785 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.836050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.836300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.836536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.836774 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.837010 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.837240 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.837481 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.837740 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.837971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.838217 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.838462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.838707 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.838942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.839172 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.839407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.839640 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.839873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.840251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.840503 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.840750 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.840998 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.841244 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.841492 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.841724 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.841971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.842209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.842448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.842686 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.842923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.843177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.843426 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.843666 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.843920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.844179 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.844425 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.844661 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.844896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.845133 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.845379 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.845688 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.845958 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.846231 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.846505 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.846789 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.847072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.847342 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.847626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.847899 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.848160 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.848410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.848648 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.848888 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.849122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] role.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.849367 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] role.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.849695 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.849942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.850198 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.850439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.850686 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.850931 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.851182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.851467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.851762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.851999 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.852268 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.852516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.852776 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.853030 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.853456 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.853697 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.853948 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.854189 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:01.854279 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.854419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:01.854502 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.854642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:01.854740 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.854893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.855147 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.855401 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.855642 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.855875 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.856137 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.856372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.856622 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.856877 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.857123 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.857362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.857598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.857829 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.858065 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] token.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.858301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.858547 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.858783 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.859037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.859285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.859523 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.859766 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.860055 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.860278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.860515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.860753 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.860987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.861231 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.861478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.861709 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.861951 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.862246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.862505 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.connection = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.862750 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.863001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.863083 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:01.863246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.863466 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.863699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.863945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.864208 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.864445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.864701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.864939 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.865227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.865464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.865710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.865946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.866190 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.866419 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.866658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.866892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 16:19:01.867062 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 16:19:01.891240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:01.891473 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:01.891979 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:01.892235 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:01.892457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:01.902602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:01.921144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:01.921383 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:01.943620 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:01.958808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:01.995630 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:01.995887 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:01.996629 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:01.996875 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.062582 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.062798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.062871 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.062964 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.063044 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.063159 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.063251 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.063405 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.063545 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.063618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.063687 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.063890 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.088136 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.088358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.088572 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.088674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.088791 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.088924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.089018 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.089100 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.089219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.089327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.089402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.089585 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.089762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.089978 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.101294 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.101638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.114234 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.114537 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.114679 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.114834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.115048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.115210 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.115437 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.115437 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.115578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.115663 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80264) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.115870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.116003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.116396 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.116625 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80263) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 16:19:02.133903 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.134188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.134339 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 16:19:02.134499 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 16:19:02.134594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.134723 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.134850 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 16:19:02.134976 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 16:19:02.135101 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.135276 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.135404 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.135531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.135673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.135807 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.135945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.136101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.146907 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.147271 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.147475 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.147745 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.148672 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.148955 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.149198 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.149480 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.156047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.157706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.159339 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.159626 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.159868 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.160174 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.160455 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.160712 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.161061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.161168 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.161342 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.161439 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.161611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.161707 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.161885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.161983 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.162240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.162457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.162646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.162959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.163210 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.163512 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.163778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.164069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.188901 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.190701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.190976 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.191254 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.193096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.193752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.196537 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.196822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.197101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.199143 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.199424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.199697 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.204552 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.204821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.207616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.207918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.209929 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.210404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.210653 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.210922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.211201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.211471 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.211739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.212000 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.212803 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.213271 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.213515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.213791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.214075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.214352 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.214624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.214929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.231262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.231574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.234116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.234413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.236312 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.239269 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.240038 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.240986 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.243171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.243476 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.245704 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.248656 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.249348 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.252399 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.253169 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.253470 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.253756 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.254040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.254312 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.254590 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.256404 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.256712 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.257001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.257282 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.257563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.257847 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.274419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.274715 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.274967 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.275229 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.277203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.277509 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.277778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.278039 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.283424 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.285217 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.285479 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.286298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.288527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.288815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.289097 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.289097 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.289475 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.289625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.289906 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.291969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.292284 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.292837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.292837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.293061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.303682 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.303964 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.304254 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.304544 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.304815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.305082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.305356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.307117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.307387 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.307676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.307988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.308270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.308547 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.308831 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.323568 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.326922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.327799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.330303 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.331527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.332279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.333945 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.334272 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.334584 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.335003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.336691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.338337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.338611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.338910 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.342212 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.343827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.346451 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.347106 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.347405 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.347681 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.347954 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.348158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.351494 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.351785 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.352103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.352387 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.357269 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.357551 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.357939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.361615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.361912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.362306 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.365877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80264) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.366154 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.366431 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.366698 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.366959 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.367234 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.367518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.367781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.368058 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.368320 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.368582 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.368840 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.369109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.369369 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80264) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.370658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80263) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 16:19:02.370942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.371226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.371501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.371774 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.372069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.372343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.372628 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.372902 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.373177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.373446 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.373707 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.373969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.374246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80263) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 16:19:02.408529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56019aa669c0 pid: 80264 (default app) May 27 16:19:02.412137 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eec0d1-0a79-4c73-8c09-7e05e80453dc None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:02.412570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eec0d1-0a79-4c73-8c09-7e05e80453dc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:02.412940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eec0d1-0a79-4c73-8c09-7e05e80453dc None None] PATH_INFO: `/v3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:02.414801 dv-cinder-835553-1-smb devstack@keystone.service[80263]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56019aa669c0 pid: 80263 (default app) May 27 16:19:02.417406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 791 bytes} [Fri May 27 16:19:02 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:10.557785 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e878f-9e46-4353-9f15-6f5b0a921c78 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:10.558645 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e878f-9e46-4353-9f15-6f5b0a921c78 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:10.558645 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e878f-9e46-4353-9f15-6f5b0a921c78 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:10.565903 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1/2] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:10 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:10.573080 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a0827-0671-459d-bafe-309bfc589ba8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:10.573539 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a0827-0671-459d-bafe-309bfc589ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:10.573715 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a0827-0671-459d-bafe-309bfc589ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:10.647379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: INFO dbcounter [None req-769a0827-0671-459d-bafe-309bfc589ba8 None None] Registered counter for database keystone May 27 16:19:10.670107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG oslo_db.sqlalchemy.engines [None req-769a0827-0671-459d-bafe-309bfc589ba8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80264) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:19:10.681386 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writer thread running {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:19:10.868469 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG passlib.handlers.bcrypt [None req-769a0827-0671-459d-bafe-309bfc589ba8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80264) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 16:19:10.868793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG passlib.handlers.bcrypt [None req-769a0827-0671-459d-bafe-309bfc589ba8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80264) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 16:19:10.931075 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-769a0827-0671-459d-bafe-309bfc589ba8 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:10.932755 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-769a0827-0671-459d-bafe-309bfc589ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:11.072738 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 2/3] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 27 16:19:11.235775 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e878f-9e46-4353-9f15-6f5b0a921c78 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:11.313514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: INFO dbcounter [None req-687e878f-9e46-4353-9f15-6f5b0a921c78 None None] Registered counter for database keystone May 27 16:19:11.336306 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG oslo_db.sqlalchemy.engines [None req-687e878f-9e46-4353-9f15-6f5b0a921c78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 16:19:11.344677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writer thread running {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 16:19:11.475429 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e878f-9e46-4353-9f15-6f5b0a921c78 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:11.480858 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6172ab-0637-495f-83e5-b9826ed98e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:11.481519 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6172ab-0637-495f-83e5-b9826ed98e8e admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:11.481796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6172ab-0637-495f-83e5-b9826ed98e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:11.482068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6172ab-0637-495f-83e5-b9826ed98e8e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:11.491738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6172ab-0637-495f-83e5-b9826ed98e8e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:11.548584 dv-cinder-835553-1-smb devstack@keystone.service[80263]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cc6172ab-0637-495f-83e5-b9826ed98e8e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 16:19:11.548928 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6172ab-0637-495f-83e5-b9826ed98e8e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:11.559824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 2/4] 10.222.0.41 () {58 vars in 1324 bytes} [Fri May 27 16:19:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:19:11.567557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a0827-0671-459d-bafe-309bfc589ba8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:11.585103 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a0827-0671-459d-bafe-309bfc589ba8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:11.593724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2276b4b-86d8-4c7a-8540-dd4988687184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:11.595365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2276b4b-86d8-4c7a-8540-dd4988687184 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:11.595752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2276b4b-86d8-4c7a-8540-dd4988687184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:11.596178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2276b4b-86d8-4c7a-8540-dd4988687184 admin admin] PATH_INFO: `/v3/projects/e4a92a8dcb534d23b8816fa07dbb1878` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:11.598769 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2276b4b-86d8-4c7a-8540-dd4988687184 admin admin] RBAC: Authorizing `identity:get_project(project_id=e4a92a8dcb534d23b8816fa07dbb1878)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:11.761165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c2276b4b-86d8-4c7a-8540-dd4988687184 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 16:19:11.761377 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2276b4b-86d8-4c7a-8540-dd4988687184 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:11.766214 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 3/5] 10.222.0.41 () {56 vars in 1207 bytes} [Fri May 27 16:19:11 2022] GET /identity/v3/projects/e4a92a8dcb534d23b8816fa07dbb1878 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:14.031988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b930641-de42-4dde-a50e-49b784df453e None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:14.032850 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b930641-de42-4dde-a50e-49b784df453e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:14.033001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b930641-de42-4dde-a50e-49b784df453e None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:14.039793 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 3/6] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:14.046598 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05c97d-c9e1-4ae7-b005-f4bed717f2b6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:14.047322 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05c97d-c9e1-4ae7-b005-f4bed717f2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:14.047497 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05c97d-c9e1-4ae7-b005-f4bed717f2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:14.070060 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7a05c97d-c9e1-4ae7-b005-f4bed717f2b6 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:14.071599 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7a05c97d-c9e1-4ae7-b005-f4bed717f2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:14.081561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 4/7] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 27 16:19:14.104710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b930641-de42-4dde-a50e-49b784df453e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:14.120804 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b930641-de42-4dde-a50e-49b784df453e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:14.129799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103463e-da34-41d1-b736-5c06511ad4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:14.130764 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103463e-da34-41d1-b736-5c06511ad4fe admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:14.131205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103463e-da34-41d1-b736-5c06511ad4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:14.132904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103463e-da34-41d1-b736-5c06511ad4fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:14.147900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103463e-da34-41d1-b736-5c06511ad4fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:14.150086 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103463e-da34-41d1-b736-5c06511ad4fe admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:14.159675 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 4/8] 10.222.0.41 () {58 vars in 1324 bytes} [Fri May 27 16:19:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:19:14.167032 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05c97d-c9e1-4ae7-b005-f4bed717f2b6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:14.179705 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05c97d-c9e1-4ae7-b005-f4bed717f2b6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:14.185396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc10f7-09f3-4396-8152-2a90d913d1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:14.186286 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc10f7-09f3-4396-8152-2a90d913d1de admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:14.186572 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc10f7-09f3-4396-8152-2a90d913d1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:14.186849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc10f7-09f3-4396-8152-2a90d913d1de admin admin] PATH_INFO: `/v3/users/4ab56873c9924436afdc333a98301e78` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:14.188436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc10f7-09f3-4396-8152-2a90d913d1de admin admin] RBAC: Authorizing `identity:get_user(user_id=4ab56873c9924436afdc333a98301e78)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:14.190334 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc10f7-09f3-4396-8152-2a90d913d1de admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:14.191943 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 5/9] 10.222.0.41 () {56 vars in 1198 bytes} [Fri May 27 16:19:14 2022] GET /identity/v3/users/4ab56873c9924436afdc333a98301e78 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:16.475913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63a362-5dab-40dc-aaea-e6b95f05859d None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:16.476488 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63a362-5dab-40dc-aaea-e6b95f05859d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:16.476488 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63a362-5dab-40dc-aaea-e6b95f05859d None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:16.477879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 5/10] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:16.483602 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37476-01db-4f20-9609-ec7c8c796ea7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:16.484064 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37476-01db-4f20-9609-ec7c8c796ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:16.484265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37476-01db-4f20-9609-ec7c8c796ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:16.501977 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e9e37476-01db-4f20-9609-ec7c8c796ea7 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:16.503166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e9e37476-01db-4f20-9609-ec7c8c796ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:16.522503 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b929fa3-8c75-4da9-b5d6-5e57ebf3d9c3 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:16.523044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b929fa3-8c75-4da9-b5d6-5e57ebf3d9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:16.523322 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b929fa3-8c75-4da9-b5d6-5e57ebf3d9c3 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:16.524798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 6/11] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:16.530319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51417456-a51f-41ab-bccc-90aac410f7d4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:16.530679 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51417456-a51f-41ab-bccc-90aac410f7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:16.530963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51417456-a51f-41ab-bccc-90aac410f7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:16.572060 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG passlib.handlers.bcrypt [None req-51417456-a51f-41ab-bccc-90aac410f7d4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80263) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 16:19:16.572390 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG passlib.handlers.bcrypt [None req-51417456-a51f-41ab-bccc-90aac410f7d4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80263) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 16:19:16.585708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 6/12] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:19:16.609036 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e37476-01db-4f20-9609-ec7c8c796ea7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:16.619191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-51417456-a51f-41ab-bccc-90aac410f7d4 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:16.620897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-51417456-a51f-41ab-bccc-90aac410f7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:16.633883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:16.722813 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e37476-01db-4f20-9609-ec7c8c796ea7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:16.727017 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 7/13] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:19:16.750392 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51417456-a51f-41ab-bccc-90aac410f7d4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:16.759540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28e915-5c08-4a86-9080-360242bb4310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:16.760369 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28e915-5c08-4a86-9080-360242bb4310 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:16.760652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28e915-5c08-4a86-9080-360242bb4310 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:16.760923 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28e915-5c08-4a86-9080-360242bb4310 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:16.772878 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28e915-5c08-4a86-9080-360242bb4310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:16.784026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ec28e915-5c08-4a86-9080-360242bb4310 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:19:16.784026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:16.784026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:16.784026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:16.784026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:16.784026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:16.784026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:16.784026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:16.784026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:16.784026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:16.784026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:16.784026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:16.784026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:16.784026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:16.784026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:16.784026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:16.785063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:16.785063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:16.785063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:16.785063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:16.785063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:16.785063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:16.785063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:16.785063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:16.785063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:16.785063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:16.785063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:16.785063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:19:16.785063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:16.785063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:16.785063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:16.785063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:16.785903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:16.785903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:16.785903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:16.785903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:16.785903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:16.785903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:16.785903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:16.785903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:16.785903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:16.785903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:16.785903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:19:16.785903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:19:16.785903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 7/14] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:19:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:19:16.791275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28e915-5c08-4a86-9080-360242bb4310 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:16.855419 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51417456-a51f-41ab-bccc-90aac410f7d4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:16.857636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:16.877221 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:16.894852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4baa8b-5d6f-4c70-8193-f24ffe77297c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:16.895395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28e915-5c08-4a86-9080-360242bb4310 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:16.895768 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4baa8b-5d6f-4c70-8193-f24ffe77297c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:16.896086 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4baa8b-5d6f-4c70-8193-f24ffe77297c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:16.896373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4baa8b-5d6f-4c70-8193-f24ffe77297c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:16.932536 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed2aa0-e31e-4f93-aef0-c165af9a00ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:16.933224 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed2aa0-e31e-4f93-aef0-c165af9a00ff None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:16.933506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed2aa0-e31e-4f93-aef0-c165af9a00ff None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:16.933788 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed2aa0-e31e-4f93-aef0-c165af9a00ff None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:16.934551 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed2aa0-e31e-4f93-aef0-c165af9a00ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:16.934864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed2aa0-e31e-4f93-aef0-c165af9a00ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:16.936319 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed2aa0-e31e-4f93-aef0-c165af9a00ff None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:16.948468 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 8/15] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:16.954085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed2aa0-e31e-4f93-aef0-c165af9a00ff None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:16.968749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4baa8b-5d6f-4c70-8193-f24ffe77297c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:16.970308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4baa8b-5d6f-4c70-8193-f24ffe77297c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:17.057054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed2aa0-e31e-4f93-aef0-c165af9a00ff None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:17.079165 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 8/16] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:19:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 16:19:17.085817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4baa8b-5d6f-4c70-8193-f24ffe77297c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:17.089545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:17.092784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b446b6-d3e9-4006-87d6-15282d531a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:17.093682 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b446b6-d3e9-4006-87d6-15282d531a5e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:17.093969 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b446b6-d3e9-4006-87d6-15282d531a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:17.094247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b446b6-d3e9-4006-87d6-15282d531a5e None admin] PATH_INFO: `/v3/users/4ab56873c9924436afdc333a98301e78` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:17.095455 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b446b6-d3e9-4006-87d6-15282d531a5e None admin] RBAC: Authorizing `identity:get_user(user_id=4ab56873c9924436afdc333a98301e78)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:17.096980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b446b6-d3e9-4006-87d6-15282d531a5e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:17.098664 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 9/17] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:16 2022] GET /identity/v3/users/4ab56873c9924436afdc333a98301e78 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:17.104463 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b446b6-d3e9-4006-87d6-15282d531a5e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:17.120573 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:17.189753 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4baa8b-5d6f-4c70-8193-f24ffe77297c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:17.209791 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b446b6-d3e9-4006-87d6-15282d531a5e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:17.225264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a8608-90f9-4b23-bb43-c6bcb40b573c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:17.226160 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a8608-90f9-4b23-bb43-c6bcb40b573c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:17.226438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a8608-90f9-4b23-bb43-c6bcb40b573c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:17.226710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a8608-90f9-4b23-bb43-c6bcb40b573c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:17.244001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5d79b-e81d-4e10-8de2-760a6f424953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:17.244835 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5d79b-e81d-4e10-8de2-760a6f424953 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:17.245121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5d79b-e81d-4e10-8de2-760a6f424953 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:17.245393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5d79b-e81d-4e10-8de2-760a6f424953 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:17.245962 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a8608-90f9-4b23-bb43-c6bcb40b573c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:17.246574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5d79b-e81d-4e10-8de2-760a6f424953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:17.247464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a8608-90f9-4b23-bb43-c6bcb40b573c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:17.248045 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5d79b-e81d-4e10-8de2-760a6f424953 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:17.249670 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 10/18] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:19:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:17.255485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5d79b-e81d-4e10-8de2-760a6f424953 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:17.269577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-4a8a8608-90f9-4b23-bb43-c6bcb40b573c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:19:17.269577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:17.269577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:17.269577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:17.269577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:17.269577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:17.269577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:17.269577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:17.269577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:17.269577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:17.269577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:17.269577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:17.269577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:19:17.269577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:19:17.269577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:19:17.271353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:19:17.271353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:17.271353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:17.271353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:17.271353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:17.271353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:17.271353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:17.271353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:17.271353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:19:17.271353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:17.271353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:17.271353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:17.271353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:17.271353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:17.271353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:17.271353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:17.271353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:17.273492 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:19:17.273492 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:19:17.273492 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:19:17.273492 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:19:17.273492 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 9/19] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:19:17.278521 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a8608-90f9-4b23-bb43-c6bcb40b573c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:17.343991 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:17.346091 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:17.367526 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5d79b-e81d-4e10-8de2-760a6f424953 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:17.389423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a8608-90f9-4b23-bb43-c6bcb40b573c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:17.403292 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2953d-f403-4277-bd44-c042788d3a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:17.403980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2953d-f403-4277-bd44-c042788d3a21 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:17.404295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2953d-f403-4277-bd44-c042788d3a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:17.404567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2953d-f403-4277-bd44-c042788d3a21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:17.405421 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2953d-f403-4277-bd44-c042788d3a21 None admin] RBAC: Adding query filter params (role.id=e1e39192d3af465aa504728e32ab7cd2, scope.domain.id=default, user.id=4ab56873c9924436afdc333a98301e78) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:17.405742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2953d-f403-4277-bd44-c042788d3a21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:17.407278 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2953d-f403-4277-bd44-c042788d3a21 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:17.415482 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 11/20] 10.222.0.41 () {56 vars in 1322 bytes} [Fri May 27 16:19:17 2022] GET /identity/v3/role_assignments?user.id=4ab56873c9924436afdc333a98301e78&scope.domain.id=default&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:17.548949 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff652f87-ea62-4df8-bf40-1f93c7ddb2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:17.549632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff652f87-ea62-4df8-bf40-1f93c7ddb2dc None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:17.549915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff652f87-ea62-4df8-bf40-1f93c7ddb2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:17.550187 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff652f87-ea62-4df8-bf40-1f93c7ddb2dc None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:17.550935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff652f87-ea62-4df8-bf40-1f93c7ddb2dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:17.551242 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff652f87-ea62-4df8-bf40-1f93c7ddb2dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:17.552728 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff652f87-ea62-4df8-bf40-1f93c7ddb2dc None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:17.573858 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 10/21] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:20.062843 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a6591-ed76-4c41-871c-915b38dbdca7 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:20.063874 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a6591-ed76-4c41-871c-915b38dbdca7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:20.064375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a6591-ed76-4c41-871c-915b38dbdca7 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:20.065933 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 12/22] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:20.072122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716016cf-ea29-4801-a4c3-63da6f303b6a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:20.073062 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716016cf-ea29-4801-a4c3-63da6f303b6a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:20.073527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716016cf-ea29-4801-a4c3-63da6f303b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:20.093135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-716016cf-ea29-4801-a4c3-63da6f303b6a None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:20.094732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-716016cf-ea29-4801-a4c3-63da6f303b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:20.177318 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 11/23] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:20.221840 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a6591-ed76-4c41-871c-915b38dbdca7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:20.340676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477a4dd-97d3-4e84-b4a1-07c8921a6e91 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:20.341293 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477a4dd-97d3-4e84-b4a1-07c8921a6e91 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:20.341767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477a4dd-97d3-4e84-b4a1-07c8921a6e91 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:20.343768 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 12/24] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:20.349114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9c7b5-42db-4e69-9d8b-425870cfc445 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:20.349637 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9c7b5-42db-4e69-9d8b-425870cfc445 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:20.350185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9c7b5-42db-4e69-9d8b-425870cfc445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:20.370554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a6591-ed76-4c41-871c-915b38dbdca7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:20.376870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c3f9c7b5-42db-4e69-9d8b-425870cfc445 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:20.379204 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c3f9c7b5-42db-4e69-9d8b-425870cfc445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:20.443419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c19ac8-0d3e-4ba7-9614-b0cd31787c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:20.444341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c19ac8-0d3e-4ba7-9614-b0cd31787c8f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:20.444863 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c19ac8-0d3e-4ba7-9614-b0cd31787c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:20.445275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c19ac8-0d3e-4ba7-9614-b0cd31787c8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:20.463662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:20.481308 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c19ac8-0d3e-4ba7-9614-b0cd31787c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:20.495276 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 13/25] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:20.497038 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc340e-4156-4678-8a8a-ef15c41f016d None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:20.497274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e1c19ac8-0d3e-4ba7-9614-b0cd31787c8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:19:20.497274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:20.497274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:20.497274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:20.497274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:20.497274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:20.497274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:20.497274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:20.497274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:20.497274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:20.497274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:20.497274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:20.497274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:20.497274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:20.497274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:20.497274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:20.498142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:20.498142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:20.498142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:20.498142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:20.498142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:20.498142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:20.498142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:20.498142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:20.498142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:20.498142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:20.498142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:20.498142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:19:20.498142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:20.498142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:20.498142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:20.498142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:20.498953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:20.498953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:20.498953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:20.498953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:20.498953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:20.498953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:20.498953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:20.498953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:20.498953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:20.498953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:20.498953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:19:20.498953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:19:20.498953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 13/26] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:19:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:20.500440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc340e-4156-4678-8a8a-ef15c41f016d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:20.500917 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc340e-4156-4678-8a8a-ef15c41f016d None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:20.502866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 14/27] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:20.508385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c19ac8-0d3e-4ba7-9614-b0cd31787c8f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:20.510090 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e246d-e3ea-46c8-8fa1-d4f29d1feb1e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:20.510381 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e246d-e3ea-46c8-8fa1-d4f29d1feb1e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:20.510657 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e246d-e3ea-46c8-8fa1-d4f29d1feb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:20.516241 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:20.547456 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2a3e246d-e3ea-46c8-8fa1-d4f29d1feb1e None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:20.548665 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2a3e246d-e3ea-46c8-8fa1-d4f29d1feb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:20.633258 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 15/28] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:20.634530 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e246d-e3ea-46c8-8fa1-d4f29d1feb1e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:20.699315 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c19ac8-0d3e-4ba7-9614-b0cd31787c8f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:20.750121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2611b90-e8f3-4580-97a9-6b1b87859843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:20.750815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2611b90-e8f3-4580-97a9-6b1b87859843 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:20.751094 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2611b90-e8f3-4580-97a9-6b1b87859843 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:20.751368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2611b90-e8f3-4580-97a9-6b1b87859843 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:20.752625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2611b90-e8f3-4580-97a9-6b1b87859843 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:20.752940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2611b90-e8f3-4580-97a9-6b1b87859843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:20.755030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2611b90-e8f3-4580-97a9-6b1b87859843 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:20.766908 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 14/29] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:20.768120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2611b90-e8f3-4580-97a9-6b1b87859843 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:20.780513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e246d-e3ea-46c8-8fa1-d4f29d1feb1e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:20.790334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:20.830420 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f4f0b-68c8-485a-af88-a9dbaef5518a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:20.831632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f4f0b-68c8-485a-af88-a9dbaef5518a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:20.831915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f4f0b-68c8-485a-af88-a9dbaef5518a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:20.832587 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f4f0b-68c8-485a-af88-a9dbaef5518a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:20.847883 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f4f0b-68c8-485a-af88-a9dbaef5518a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:20.849964 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f4f0b-68c8-485a-af88-a9dbaef5518a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:20.857326 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:20.875534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-981f4f0b-68c8-485a-af88-a9dbaef5518a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:19:20.875534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:20.875534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:20.875534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:20.875534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:20.875534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:20.875534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:20.875534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:20.875534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:20.875534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:20.875534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:20.875534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:20.875534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:19:20.875534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:19:20.875534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:19:20.876583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:19:20.876583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:20.876583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:20.876583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:20.876583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:20.876583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:20.876583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:20.876583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:20.876583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:19:20.876583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:20.876583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:20.876583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:20.876583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:20.876583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:20.876583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:20.876583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:20.876583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:20.878186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:19:20.878186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:19:20.878186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:19:20.878186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:19:20.878186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 16/30] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:20.884741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa713d-dd8b-4424-b380-6766f84f62bf None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:20.884958 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa713d-dd8b-4424-b380-6766f84f62bf None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:20.885416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa713d-dd8b-4424-b380-6766f84f62bf None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:20.887315 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 17/31] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:20.888613 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa713d-dd8b-4424-b380-6766f84f62bf None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:20.905304 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2611b90-e8f3-4580-97a9-6b1b87859843 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:20.947654 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22502300-7195-4e7f-9308-b0bd8efc7ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:20.948654 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22502300-7195-4e7f-9308-b0bd8efc7ae7 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:20.949874 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22502300-7195-4e7f-9308-b0bd8efc7ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:20.950261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22502300-7195-4e7f-9308-b0bd8efc7ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:20.951132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22502300-7195-4e7f-9308-b0bd8efc7ae7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:20.952692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22502300-7195-4e7f-9308-b0bd8efc7ae7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:21.023098 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa713d-dd8b-4424-b380-6766f84f62bf None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:21.058940 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ca898-75a9-405f-9cb3-4ddd7d133508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:21.060100 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ca898-75a9-405f-9cb3-4ddd7d133508 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:21.060506 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ca898-75a9-405f-9cb3-4ddd7d133508 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:21.060859 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ca898-75a9-405f-9cb3-4ddd7d133508 None admin] PATH_INFO: `/v3/users/4ab56873c9924436afdc333a98301e78` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:21.062743 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ca898-75a9-405f-9cb3-4ddd7d133508 None admin] RBAC: Authorizing `identity:get_user(user_id=4ab56873c9924436afdc333a98301e78)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:21.064482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ca898-75a9-405f-9cb3-4ddd7d133508 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:21.066728 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 18/32] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:20 2022] GET /identity/v3/users/4ab56873c9924436afdc333a98301e78 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:21.067639 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ca898-75a9-405f-9cb3-4ddd7d133508 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:21.105324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:21.109364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 15/33] 10.222.0.41 () {60 vars in 1131 bytes} [Fri May 27 16:19:20 2022] POST /identity/v3/roles => generated 219 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:19:21.111082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2379a9-d824-439b-ae4f-1966b4b44e71 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:21.111374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2379a9-d824-439b-ae4f-1966b4b44e71 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:21.111703 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2379a9-d824-439b-ae4f-1966b4b44e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:21.147605 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fc2379a9-d824-439b-ae4f-1966b4b44e71 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:21.149775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fc2379a9-d824-439b-ae4f-1966b4b44e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:21.271290 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ca898-75a9-405f-9cb3-4ddd7d133508 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:21.329731 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 16/34] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:21.330977 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2379a9-d824-439b-ae4f-1966b4b44e71 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:21.354196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011e1ee-6216-4705-96e5-0e9d419b9688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:21.355105 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011e1ee-6216-4705-96e5-0e9d419b9688 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:21.355393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011e1ee-6216-4705-96e5-0e9d419b9688 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:21.356657 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011e1ee-6216-4705-96e5-0e9d419b9688 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:21.358274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011e1ee-6216-4705-96e5-0e9d419b9688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:21.358802 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011e1ee-6216-4705-96e5-0e9d419b9688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:21.362512 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011e1ee-6216-4705-96e5-0e9d419b9688 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:21.388078 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 19/35] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:21.388934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011e1ee-6216-4705-96e5-0e9d419b9688 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:21.429203 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:21.483646 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2379a9-d824-439b-ae4f-1966b4b44e71 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:21.490354 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:21.510171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011e1ee-6216-4705-96e5-0e9d419b9688 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:21.534878 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4c150-ec4c-475c-9dbc-979d1cb0059c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:21.535999 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4c150-ec4c-475c-9dbc-979d1cb0059c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:21.536451 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4c150-ec4c-475c-9dbc-979d1cb0059c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:21.536986 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4c150-ec4c-475c-9dbc-979d1cb0059c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:21.540413 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4c150-ec4c-475c-9dbc-979d1cb0059c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:21.542626 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4c150-ec4c-475c-9dbc-979d1cb0059c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:21.544610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 17/36] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:19:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:21.545629 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4c150-ec4c-475c-9dbc-979d1cb0059c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:21.551170 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357014a-d106-4848-ba67-11d35599e9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:21.551859 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357014a-d106-4848-ba67-11d35599e9a1 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:21.552227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357014a-d106-4848-ba67-11d35599e9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:21.552514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357014a-d106-4848-ba67-11d35599e9a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:21.553409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357014a-d106-4848-ba67-11d35599e9a1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:21.554991 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357014a-d106-4848-ba67-11d35599e9a1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:21.663915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4c150-ec4c-475c-9dbc-979d1cb0059c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:21.689467 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:21.693124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 20/37] 10.222.0.41 () {60 vars in 1131 bytes} [Fri May 27 16:19:21 2022] POST /identity/v3/roles => generated 225 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:19:21.694876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357014a-d106-4848-ba67-11d35599e9a1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:21.703653 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf317c-0e70-4802-9c56-67506a97224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:21.704389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf317c-0e70-4802-9c56-67506a97224c None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:21.704671 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf317c-0e70-4802-9c56-67506a97224c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:21.704947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf317c-0e70-4802-9c56-67506a97224c None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:21.706087 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf317c-0e70-4802-9c56-67506a97224c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:21.708459 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf317c-0e70-4802-9c56-67506a97224c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:21.753087 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 18/38] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 16:19:21 2022] POST /identity/v3/projects => generated 301 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:19:21.755183 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77686c-77cc-46ae-b4c0-7baaf1f8e6fc None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:21.755511 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77686c-77cc-46ae-b4c0-7baaf1f8e6fc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:21.755815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77686c-77cc-46ae-b4c0-7baaf1f8e6fc None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:21.759241 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 19/39] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:21.765930 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265f20e-308b-4ab8-8c43-9127e4764533 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:21.766263 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265f20e-308b-4ab8-8c43-9127e4764533 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:21.766493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265f20e-308b-4ab8-8c43-9127e4764533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:21.790970 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5265f20e-308b-4ab8-8c43-9127e4764533 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:21.792620 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5265f20e-308b-4ab8-8c43-9127e4764533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:21.848356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357014a-d106-4848-ba67-11d35599e9a1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:21.884040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 20/40] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:21.915922 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09b29b-6175-43a0-ad1f-8b5632cfe3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:21.916901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09b29b-6175-43a0-ad1f-8b5632cfe3ca None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:21.917188 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09b29b-6175-43a0-ad1f-8b5632cfe3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:21.917479 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09b29b-6175-43a0-ad1f-8b5632cfe3ca None admin] PATH_INFO: `/v3/domains/default/users/4ab56873c9924436afdc333a98301e78/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:21.924964 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09b29b-6175-43a0-ad1f-8b5632cfe3ca None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4ab56873c9924436afdc333a98301e78, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:21.926874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09b29b-6175-43a0-ad1f-8b5632cfe3ca None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:21.927767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c420592-6741-4d66-a47e-85211404a446 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:21.929409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c420592-6741-4d66-a47e-85211404a446 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:21.930214 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c420592-6741-4d66-a47e-85211404a446 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:21.932612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 21/41] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:19:21.934507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c420592-6741-4d66-a47e-85211404a446 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:21.956829 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 21/42] 10.222.0.41 () {58 vars in 1361 bytes} [Fri May 27 16:19:21 2022] PUT /identity/v3/domains/default/users/4ab56873c9924436afdc333a98301e78/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:19:21.958338 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f534f8d-9e06-4abc-a1e3-28bce048895a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:21.958660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f534f8d-9e06-4abc-a1e3-28bce048895a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:21.958951 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f534f8d-9e06-4abc-a1e3-28bce048895a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:21.976447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:21.979757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4f534f8d-9e06-4abc-a1e3-28bce048895a None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:21.981530 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4f534f8d-9e06-4abc-a1e3-28bce048895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:22.067576 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c420592-6741-4d66-a47e-85211404a446 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:22.068537 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 22/43] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:22.085045 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:22.092887 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f534f8d-9e06-4abc-a1e3-28bce048895a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:22.114139 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b9d9f-5cea-41a6-8ada-abd07abc97f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:22.116137 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b9d9f-5cea-41a6-8ada-abd07abc97f6 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:22.116137 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b9d9f-5cea-41a6-8ada-abd07abc97f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:22.116400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b9d9f-5cea-41a6-8ada-abd07abc97f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:22.117116 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b9d9f-5cea-41a6-8ada-abd07abc97f6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:22.118859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b9d9f-5cea-41a6-8ada-abd07abc97f6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:22.140483 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 22/44] 10.222.0.41 () {60 vars in 1131 bytes} [Fri May 27 16:19:21 2022] POST /identity/v3/roles => generated 223 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:19:22.227577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f534f8d-9e06-4abc-a1e3-28bce048895a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:22.269402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bdbd7-c052-401a-93f2-e4efd8f711ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:22.270296 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bdbd7-c052-401a-93f2-e4efd8f711ba None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:22.270523 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bdbd7-c052-401a-93f2-e4efd8f711ba None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:22.270777 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bdbd7-c052-401a-93f2-e4efd8f711ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:22.272130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bdbd7-c052-401a-93f2-e4efd8f711ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:22.273699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bdbd7-c052-401a-93f2-e4efd8f711ba None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:22.275672 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 23/45] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:19:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:22.281197 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b9d9f-5cea-41a6-8ada-abd07abc97f6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:22.391727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b9d9f-5cea-41a6-8ada-abd07abc97f6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:22.427350 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f77c8-308b-4d3e-9b64-a2eb8a3e63be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:22.428107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f77c8-308b-4d3e-9b64-a2eb8a3e63be None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:22.428394 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f77c8-308b-4d3e-9b64-a2eb8a3e63be None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:22.428673 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f77c8-308b-4d3e-9b64-a2eb8a3e63be None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:22.429419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f77c8-308b-4d3e-9b64-a2eb8a3e63be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:22.430924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f77c8-308b-4d3e-9b64-a2eb8a3e63be None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:22.457930 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 23/46] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 16:19:22 2022] POST /identity/v3/projects => generated 312 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:19:24.236487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ffd5f-1b17-443f-9273-1e7e0b10c433 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:24.237002 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ffd5f-1b17-443f-9273-1e7e0b10c433 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:24.237116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ffd5f-1b17-443f-9273-1e7e0b10c433 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:24.238449 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 24/47] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:24.244267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33080891-092d-4e4a-8d61-66ceaa628042 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:24.244694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33080891-092d-4e4a-8d61-66ceaa628042 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:24.244869 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33080891-092d-4e4a-8d61-66ceaa628042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:24.263528 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-33080891-092d-4e4a-8d61-66ceaa628042 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:24.264765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-33080891-092d-4e4a-8d61-66ceaa628042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:24.279186 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:24.340387 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 24/48] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:24.363631 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ffd5f-1b17-443f-9273-1e7e0b10c433 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:24.368145 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:24.472487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ffd5f-1b17-443f-9273-1e7e0b10c433 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:24.512336 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc499f3-1a9b-4d11-b685-557d4264f85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:24.513070 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc499f3-1a9b-4d11-b685-557d4264f85e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:24.513351 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc499f3-1a9b-4d11-b685-557d4264f85e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:24.513619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc499f3-1a9b-4d11-b685-557d4264f85e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:24.526855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc499f3-1a9b-4d11-b685-557d4264f85e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:24.535527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ffc499f3-1a9b-4d11-b685-557d4264f85e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:19:24.535527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:24.535527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:24.535527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:24.535527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:24.535527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:24.535527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:24.535527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:24.535527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:24.535527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:24.535527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:24.535527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:24.535527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:24.535527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:24.535527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:24.535527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:24.536459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:24.536459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:24.536459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:24.536459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:24.536459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:24.536459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:24.536459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:24.536459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:24.536459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:24.536459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:24.536459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:24.536459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:19:24.536459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:24.536459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:24.536459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:24.536459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:24.537357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:24.537357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:24.537357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:24.537357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:24.537357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:24.537357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:24.537357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:24.537357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:24.537357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:24.537357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:24.537357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:19:24.537357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:19:24.537357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 25/49] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:19:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:24.542766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33080891-092d-4e4a-8d61-66ceaa628042 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:24.649174 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33080891-092d-4e4a-8d61-66ceaa628042 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:24.677433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bfb8f-ade8-460c-9636-9f917c763638 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:24.677790 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bfb8f-ade8-460c-9636-9f917c763638 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:24.678063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bfb8f-ade8-460c-9636-9f917c763638 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:24.679511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 26/50] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:24.684593 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caae0c-cd3f-4da5-b447-371cf96b8b23 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:24.684956 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caae0c-cd3f-4da5-b447-371cf96b8b23 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:24.685306 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32caae0c-cd3f-4da5-b447-371cf96b8b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:24.685640 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c68bbb-8c70-47b0-b937-93848927acfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:24.686331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c68bbb-8c70-47b0-b937-93848927acfd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:24.686617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c68bbb-8c70-47b0-b937-93848927acfd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:24.686895 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c68bbb-8c70-47b0-b937-93848927acfd None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:24.687667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c68bbb-8c70-47b0-b937-93848927acfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:24.687979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c68bbb-8c70-47b0-b937-93848927acfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:24.689431 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c68bbb-8c70-47b0-b937-93848927acfd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:24.698221 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 25/51] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:24.702854 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-32caae0c-cd3f-4da5-b447-371cf96b8b23 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:24.703739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c68bbb-8c70-47b0-b937-93848927acfd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:24.703896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-32caae0c-cd3f-4da5-b447-371cf96b8b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:24.716522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:24.768518 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:24.778904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 27/52] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:19:24.808440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32caae0c-cd3f-4da5-b447-371cf96b8b23 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:24.809050 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c68bbb-8c70-47b0-b937-93848927acfd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:24.844866 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86527de-bcf8-4983-b53a-7cff6e495fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:24.846259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86527de-bcf8-4983-b53a-7cff6e495fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:24.846714 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86527de-bcf8-4983-b53a-7cff6e495fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:24.847162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86527de-bcf8-4983-b53a-7cff6e495fc0 None admin] PATH_INFO: `/v3/users/4ab56873c9924436afdc333a98301e78` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:24.849226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86527de-bcf8-4983-b53a-7cff6e495fc0 None admin] RBAC: Authorizing `identity:get_user(user_id=4ab56873c9924436afdc333a98301e78)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:24.851895 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86527de-bcf8-4983-b53a-7cff6e495fc0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:24.854671 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 26/53] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:24 2022] GET /identity/v3/users/4ab56873c9924436afdc333a98301e78 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:24.861836 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86527de-bcf8-4983-b53a-7cff6e495fc0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:24.918287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32caae0c-cd3f-4da5-b447-371cf96b8b23 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:24.944838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:24.960483 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bdac8-408f-45e6-b6cf-2d16abb0e6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:24.961302 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bdac8-408f-45e6-b6cf-2d16abb0e6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:24.961583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bdac8-408f-45e6-b6cf-2d16abb0e6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:24.961855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bdac8-408f-45e6-b6cf-2d16abb0e6c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:24.963052 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bdac8-408f-45e6-b6cf-2d16abb0e6c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:24.964574 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bdac8-408f-45e6-b6cf-2d16abb0e6c6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:24.966217 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 28/54] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:19:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:24.969743 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86527de-bcf8-4983-b53a-7cff6e495fc0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:24.971650 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bdac8-408f-45e6-b6cf-2d16abb0e6c6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:25.003343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4903fa6-c679-4e57-a751-4eda2ff7f330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:25.004190 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4903fa6-c679-4e57-a751-4eda2ff7f330 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:25.004478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4903fa6-c679-4e57-a751-4eda2ff7f330 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:25.004775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4903fa6-c679-4e57-a751-4eda2ff7f330 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:25.006013 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4903fa6-c679-4e57-a751-4eda2ff7f330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:25.007507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4903fa6-c679-4e57-a751-4eda2ff7f330 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:25.009178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 27/55] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:19:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:25.015007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4903fa6-c679-4e57-a751-4eda2ff7f330 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:25.035858 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:25.076562 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bdac8-408f-45e6-b6cf-2d16abb0e6c6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:25.113685 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0743e2-8b4d-4971-835c-df09bc1adab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:25.114357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0743e2-8b4d-4971-835c-df09bc1adab8 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:25.114711 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0743e2-8b4d-4971-835c-df09bc1adab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:25.114916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0743e2-8b4d-4971-835c-df09bc1adab8 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:25.115845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0743e2-8b4d-4971-835c-df09bc1adab8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:25.117368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0743e2-8b4d-4971-835c-df09bc1adab8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:25.119238 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4903fa6-c679-4e57-a751-4eda2ff7f330 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:25.145726 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 29/56] 10.222.0.41 () {60 vars in 1140 bytes} [Fri May 27 16:19:24 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:19:25.161842 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09656e0a-d882-4fb4-b6e3-30260376c79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:25.162692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09656e0a-d882-4fb4-b6e3-30260376c79b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:25.162911 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09656e0a-d882-4fb4-b6e3-30260376c79b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:25.163213 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09656e0a-d882-4fb4-b6e3-30260376c79b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:25.164084 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09656e0a-d882-4fb4-b6e3-30260376c79b None admin] RBAC: Adding query filter params (role.id=e1e39192d3af465aa504728e32ab7cd2, scope.domain.id=default, user.id=4ab56873c9924436afdc333a98301e78) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:25.164423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09656e0a-d882-4fb4-b6e3-30260376c79b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:25.166021 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09656e0a-d882-4fb4-b6e3-30260376c79b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:25.173457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 28/57] 10.222.0.41 () {56 vars in 1322 bytes} [Fri May 27 16:19:25 2022] GET /identity/v3/role_assignments?user.id=4ab56873c9924436afdc333a98301e78&scope.domain.id=default&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 530 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:27.365826 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e516920-1663-46b2-b8d8-db2cba61038a None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:27.366355 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e516920-1663-46b2-b8d8-db2cba61038a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:27.366355 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e516920-1663-46b2-b8d8-db2cba61038a None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:27.367781 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 30/58] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:27.374227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58bace-be3f-40c6-b853-2092783062f7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:27.374948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58bace-be3f-40c6-b853-2092783062f7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:27.375094 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58bace-be3f-40c6-b853-2092783062f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:27.400990 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1d58bace-be3f-40c6-b853-2092783062f7 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:27.402208 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1d58bace-be3f-40c6-b853-2092783062f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:27.405176 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:27.488591 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 29/59] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:27.514182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e516920-1663-46b2-b8d8-db2cba61038a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:27.629302 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e516920-1663-46b2-b8d8-db2cba61038a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:27.643317 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:27.665251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc63182-7742-47cd-8506-bf303e5e6075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:27.666053 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc63182-7742-47cd-8506-bf303e5e6075 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:27.666344 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc63182-7742-47cd-8506-bf303e5e6075 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:27.666605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc63182-7742-47cd-8506-bf303e5e6075 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:27.667877 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc63182-7742-47cd-8506-bf303e5e6075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:27.669397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc63182-7742-47cd-8506-bf303e5e6075 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:27.671082 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 31/60] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:19:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:27.677010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58bace-be3f-40c6-b853-2092783062f7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:27.779720 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58bace-be3f-40c6-b853-2092783062f7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:27.815602 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c48d5-4eae-4070-a51b-f97360984b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:27.816305 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c48d5-4eae-4070-a51b-f97360984b2e None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:27.816592 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c48d5-4eae-4070-a51b-f97360984b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:27.816873 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c48d5-4eae-4070-a51b-f97360984b2e None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:27.817586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c48d5-4eae-4070-a51b-f97360984b2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:27.819165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c48d5-4eae-4070-a51b-f97360984b2e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:27.835265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:27.852749 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 30/61] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 16:19:27 2022] POST /identity/v3/users => generated 275 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:19:31.225806 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a3b4c-1ff5-4d19-b4df-3c65f8d2e709 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:31.226856 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a3b4c-1ff5-4d19-b4df-3c65f8d2e709 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:31.227349 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a3b4c-1ff5-4d19-b4df-3c65f8d2e709 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:31.228984 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 32/62] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:31.234733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d2e13-f284-475b-9d05-b90acf1db2a7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:31.240913 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d2e13-f284-475b-9d05-b90acf1db2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:31.241430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d2e13-f284-475b-9d05-b90acf1db2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:31.267052 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fd4d2e13-f284-475b-9d05-b90acf1db2a7 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:31.268617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fd4d2e13-f284-475b-9d05-b90acf1db2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:31.378570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 31/63] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:31.423662 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d2e13-f284-475b-9d05-b90acf1db2a7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:31.423856 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c541b-0011-4944-8f77-1fa7f93e8ae8 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:31.424135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c541b-0011-4944-8f77-1fa7f93e8ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:31.424333 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c541b-0011-4944-8f77-1fa7f93e8ae8 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:31.426161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 33/64] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:31.432643 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555d023-2d1d-4f24-88e2-f82a50d3b45a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:31.433305 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555d023-2d1d-4f24-88e2-f82a50d3b45a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:31.434541 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555d023-2d1d-4f24-88e2-f82a50d3b45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:31.456953 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-5555d023-2d1d-4f24-88e2-f82a50d3b45a None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:31.458503 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5555d023-2d1d-4f24-88e2-f82a50d3b45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:31.540997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 34/65] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:31.577524 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555d023-2d1d-4f24-88e2-f82a50d3b45a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:31.596850 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d2e13-f284-475b-9d05-b90acf1db2a7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:31.626062 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:31.636362 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d2168-d110-454b-ab34-99eabb753f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:31.637370 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d2168-d110-454b-ab34-99eabb753f52 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:31.637661 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d2168-d110-454b-ab34-99eabb753f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:31.638080 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d2168-d110-454b-ab34-99eabb753f52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:31.649016 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d2168-d110-454b-ab34-99eabb753f52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:31.656692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-6c2d2168-d110-454b-ab34-99eabb753f52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:19:31.656692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:31.656692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:31.656692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:31.656692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:31.656692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:31.656692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:31.656692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:31.656692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:31.656692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:31.656692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:31.656692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:31.656692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:31.656692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:31.656692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:31.656692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:31.657578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:31.657578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:31.657578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:31.657578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:31.657578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:31.657578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:31.657578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:31.657578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:31.657578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:31.657578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:31.657578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:31.657578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:19:31.657578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:31.657578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:31.657578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:31.657578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:31.658345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:31.658345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:31.658345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:31.658345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:31.658345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:31.658345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:31.658345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:31.658345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:31.658345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:31.658345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:31.658345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:19:31.658345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:19:31.658345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 32/66] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:19:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:31.659176 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e64f8-bfe3-4d9c-bf85-6707bcc8a2a9 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:31.659593 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e64f8-bfe3-4d9c-bf85-6707bcc8a2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:31.660002 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e64f8-bfe3-4d9c-bf85-6707bcc8a2a9 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:31.661430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 33/67] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:31.662931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae0c26-e0d9-4b28-83a3-83e7827efbd1 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:31.663375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae0c26-e0d9-4b28-83a3-83e7827efbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:31.663812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae0c26-e0d9-4b28-83a3-83e7827efbd1 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:31.665247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 34/68] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:31.669332 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae0c26-e0d9-4b28-83a3-83e7827efbd1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:31.698139 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555d023-2d1d-4f24-88e2-f82a50d3b45a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:31.716572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:31.740001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1856ef7-8436-44f8-b1db-2f1335432c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:31.740846 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1856ef7-8436-44f8-b1db-2f1335432c7a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:31.741129 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1856ef7-8436-44f8-b1db-2f1335432c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:31.741518 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1856ef7-8436-44f8-b1db-2f1335432c7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:31.751900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1856ef7-8436-44f8-b1db-2f1335432c7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:31.760054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-c1856ef7-8436-44f8-b1db-2f1335432c7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:19:31.760054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:31.760054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:31.760054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:31.760054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:31.760054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:31.760054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:31.760054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:31.760054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:31.760054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:31.760054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:31.760054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:31.760054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:31.760054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:31.760054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:31.760054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:31.760974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:31.760974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:31.760974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:31.760974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:31.760974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:31.760974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:31.760974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:31.760974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:31.760974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:31.760974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:31.760974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:31.760974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:19:31.760974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:31.760974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:31.760974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:31.760974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:31.761729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:31.761729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:31.761729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:31.761729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:31.761729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:31.761729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:31.761729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:31.761729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:31.761729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:31.761729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:31.761729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:19:31.761729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:19:31.761729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 35/69] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:19:31.763306 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dd6ee-e782-48e1-8c2d-b5453d233ff0 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:31.763306 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dd6ee-e782-48e1-8c2d-b5453d233ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:31.763306 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dd6ee-e782-48e1-8c2d-b5453d233ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:31.779293 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae0c26-e0d9-4b28-83a3-83e7827efbd1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:31.784675 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d85dd6ee-e782-48e1-8c2d-b5453d233ff0 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:31.785863 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d85dd6ee-e782-48e1-8c2d-b5453d233ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:31.816341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2411c1-de33-483c-8410-cdbff4c3c532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:31.816944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2411c1-de33-483c-8410-cdbff4c3c532 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:31.817260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2411c1-de33-483c-8410-cdbff4c3c532 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:31.817534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2411c1-de33-483c-8410-cdbff4c3c532 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:31.818382 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2411c1-de33-483c-8410-cdbff4c3c532 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:31.819195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2411c1-de33-483c-8410-cdbff4c3c532 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:31.820152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2411c1-de33-483c-8410-cdbff4c3c532 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:31.831587 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 35/70] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:31.833310 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3dedc-ab2d-4c05-9dc6-1d08afbde8e0 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:31.833601 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3dedc-ab2d-4c05-9dc6-1d08afbde8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:31.834139 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3dedc-ab2d-4c05-9dc6-1d08afbde8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:31.851285 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ccb3dedc-ab2d-4c05-9dc6-1d08afbde8e0 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:31.852553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ccb3dedc-ab2d-4c05-9dc6-1d08afbde8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:31.865098 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 36/71] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:31.866355 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dd6ee-e782-48e1-8c2d-b5453d233ff0 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:31.907288 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:31.934392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 36/72] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:31.935579 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3dedc-ab2d-4c05-9dc6-1d08afbde8e0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:31.976703 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dd6ee-e782-48e1-8c2d-b5453d233ff0 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:31.978259 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:32.013730 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513c94e-9ae4-424e-9319-3d711d60c6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:32.014435 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513c94e-9ae4-424e-9319-3d711d60c6bd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:32.014720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513c94e-9ae4-424e-9319-3d711d60c6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:32.014999 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513c94e-9ae4-424e-9319-3d711d60c6bd None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:32.015785 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513c94e-9ae4-424e-9319-3d711d60c6bd None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:32.016133 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513c94e-9ae4-424e-9319-3d711d60c6bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:32.018286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513c94e-9ae4-424e-9319-3d711d60c6bd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:32.032455 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 37/73] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:19:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:32.038436 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513c94e-9ae4-424e-9319-3d711d60c6bd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:32.046833 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3dedc-ab2d-4c05-9dc6-1d08afbde8e0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:32.085491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b0494-4687-4db1-9f50-aff271fd1c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:32.086338 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b0494-4687-4db1-9f50-aff271fd1c3a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:32.086755 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b0494-4687-4db1-9f50-aff271fd1c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:32.087028 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b0494-4687-4db1-9f50-aff271fd1c3a None admin] PATH_INFO: `/v3/users/4ab56873c9924436afdc333a98301e78` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:32.088357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b0494-4687-4db1-9f50-aff271fd1c3a None admin] RBAC: Authorizing `identity:get_user(user_id=4ab56873c9924436afdc333a98301e78)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:32.090014 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b0494-4687-4db1-9f50-aff271fd1c3a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:32.091776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 37/74] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:31 2022] GET /identity/v3/users/4ab56873c9924436afdc333a98301e78 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:32.095279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b0494-4687-4db1-9f50-aff271fd1c3a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:32.147641 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:32.152767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513c94e-9ae4-424e-9319-3d711d60c6bd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:32.189135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b4331-026e-4a32-be0d-317d8fc7fd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:32.190081 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b4331-026e-4a32-be0d-317d8fc7fd9d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:32.190353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b4331-026e-4a32-be0d-317d8fc7fd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:32.190703 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b4331-026e-4a32-be0d-317d8fc7fd9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:32.201513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b0494-4687-4db1-9f50-aff271fd1c3a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:32.202040 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b4331-026e-4a32-be0d-317d8fc7fd9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:32.211032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-d52b4331-026e-4a32-be0d-317d8fc7fd9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:19:32.211032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:32.211032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:32.211032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:32.211032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:32.211032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:32.211032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:32.211032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:32.211032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:32.211032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:32.211032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:32.211032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:32.211032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:32.211032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:32.211032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:32.211032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:32.211947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:32.211947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:32.211947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:32.211947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:32.211947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:32.211947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:32.211947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:32.211947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:32.211947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:32.211947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:32.211947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:32.211947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:19:32.211947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:32.211947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:32.211947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:32.211947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:32.212756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:32.212756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:32.212756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:32.212756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:32.212756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:32.212756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:32.212756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:32.212756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:32.212756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:32.212756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:32.212756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:19:32.212756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:19:32.212756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 38/75] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:19:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:32.213399 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b4331-026e-4a32-be0d-317d8fc7fd9d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:32.241880 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a93984-b9ed-4a7f-a660-ed4e50e52acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:32.242697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a93984-b9ed-4a7f-a660-ed4e50e52acf None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:32.242817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:32.243201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a93984-b9ed-4a7f-a660-ed4e50e52acf None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:32.243296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a93984-b9ed-4a7f-a660-ed4e50e52acf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:32.253728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a93984-b9ed-4a7f-a660-ed4e50e52acf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:32.262095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-f7a93984-b9ed-4a7f-a660-ed4e50e52acf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:19:32.262095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:32.262095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:32.262095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:32.262095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:32.262095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:32.262095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:32.262095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:32.262095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:32.262095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:32.262095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:32.262095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:32.262095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:32.262095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:32.262095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:32.262095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:32.263027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:32.263027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:32.263027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:32.263027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:32.263027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:32.263027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:32.263027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:32.263027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:32.263027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:32.263027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:32.263027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:32.263027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:19:32.263027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:32.263027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:32.263027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:32.263027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:32.263775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:32.263775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:32.263775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:32.263775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:32.263775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:32.263775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:32.263775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:32.263775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:32.263775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:32.263775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:32.263775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:19:32.263775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:19:32.263775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 38/76] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:32.264452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a93984-b9ed-4a7f-a660-ed4e50e52acf None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:32.324098 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b4331-026e-4a32-be0d-317d8fc7fd9d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:32.358992 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a91d7-66fe-4ce5-b3a8-aface651a90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:32.359792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a91d7-66fe-4ce5-b3a8-aface651a90b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:32.360106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a91d7-66fe-4ce5-b3a8-aface651a90b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:32.360388 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a91d7-66fe-4ce5-b3a8-aface651a90b None admin] PATH_INFO: `/v3/users/8ef914cb95d3407db3772d63d8a4e129` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:32.364127 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a93984-b9ed-4a7f-a660-ed4e50e52acf None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:32.371088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:32.376548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a91d7-66fe-4ce5-b3a8-aface651a90b None admin] RBAC: Authorizing `identity:get_user(user_id=8ef914cb95d3407db3772d63d8a4e129)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:32.378140 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a91d7-66fe-4ce5-b3a8-aface651a90b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:32.379765 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 39/77] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:32 2022] GET /identity/v3/users/8ef914cb95d3407db3772d63d8a4e129 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:32.380563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a91d7-66fe-4ce5-b3a8-aface651a90b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:32.403512 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e3b32-2cbd-4e48-a1ce-b776879dba26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:32.404316 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e3b32-2cbd-4e48-a1ce-b776879dba26 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:32.404599 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e3b32-2cbd-4e48-a1ce-b776879dba26 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:32.404875 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e3b32-2cbd-4e48-a1ce-b776879dba26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:32.465032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:32.473518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e3b32-2cbd-4e48-a1ce-b776879dba26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:32.475456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e3b32-2cbd-4e48-a1ce-b776879dba26 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:32.485872 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a91d7-66fe-4ce5-b3a8-aface651a90b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:32.522525 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b8934-3635-4282-bcf3-1ecf9a0ec0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:32.523248 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b8934-3635-4282-bcf3-1ecf9a0ec0ce None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:32.523539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b8934-3635-4282-bcf3-1ecf9a0ec0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:32.523815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b8934-3635-4282-bcf3-1ecf9a0ec0ce None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:32.524614 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b8934-3635-4282-bcf3-1ecf9a0ec0ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:32.524936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b8934-3635-4282-bcf3-1ecf9a0ec0ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:32.526345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b8934-3635-4282-bcf3-1ecf9a0ec0ce None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:32.534768 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 40/78] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:19:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:32.537978 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1e982-5807-4315-89bf-464160cf370f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:32.538269 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1e982-5807-4315-89bf-464160cf370f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:32.538564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1e982-5807-4315-89bf-464160cf370f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:32.539893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 41/79] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:32.540599 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1e982-5807-4315-89bf-464160cf370f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:32.581698 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 39/80] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:19:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:19:32.582552 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e3b32-2cbd-4e48-a1ce-b776879dba26 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:32.592838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:32.645839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1e982-5807-4315-89bf-464160cf370f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:32.680265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79e55f-c04d-4533-a9ce-6ee21e63d31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:32.680930 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79e55f-c04d-4533-a9ce-6ee21e63d31f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:32.681466 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79e55f-c04d-4533-a9ce-6ee21e63d31f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:32.681466 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79e55f-c04d-4533-a9ce-6ee21e63d31f None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:32.682215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79e55f-c04d-4533-a9ce-6ee21e63d31f None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:32.682512 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79e55f-c04d-4533-a9ce-6ee21e63d31f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:32.683901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79e55f-c04d-4533-a9ce-6ee21e63d31f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:32.684151 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e3b32-2cbd-4e48-a1ce-b776879dba26 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:32.692040 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 42/81] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:19:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:32.692838 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79e55f-c04d-4533-a9ce-6ee21e63d31f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:32.705287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:32.721754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4dc7ce-0e9b-4c60-9e8a-c4bfa7877502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:32.722415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dc7ce-0e9b-4c60-9e8a-c4bfa7877502 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:32.722696 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dc7ce-0e9b-4c60-9e8a-c4bfa7877502 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:32.722966 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4dc7ce-0e9b-4c60-9e8a-c4bfa7877502 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:32.796135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4dc7ce-0e9b-4c60-9e8a-c4bfa7877502 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:32.797933 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4dc7ce-0e9b-4c60-9e8a-c4bfa7877502 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:32.804546 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79e55f-c04d-4533-a9ce-6ee21e63d31f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:32.806277 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:32.845919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831840c-01ce-4b2c-85dd-049ae6de867d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:32.846803 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831840c-01ce-4b2c-85dd-049ae6de867d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:32.847087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831840c-01ce-4b2c-85dd-049ae6de867d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:32.847360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831840c-01ce-4b2c-85dd-049ae6de867d None admin] PATH_INFO: `/v3/users/8ef914cb95d3407db3772d63d8a4e129` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:32.848582 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831840c-01ce-4b2c-85dd-049ae6de867d None admin] RBAC: Authorizing `identity:get_user(user_id=8ef914cb95d3407db3772d63d8a4e129)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:32.850279 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831840c-01ce-4b2c-85dd-049ae6de867d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:32.851925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 43/82] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:32 2022] GET /identity/v3/users/8ef914cb95d3407db3772d63d8a4e129 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:32.853140 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd7880-17ac-4fb8-9f76-0ec9527ae44a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:32.853478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd7880-17ac-4fb8-9f76-0ec9527ae44a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:32.853753 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd7880-17ac-4fb8-9f76-0ec9527ae44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:32.871282 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-83cd7880-17ac-4fb8-9f76-0ec9527ae44a None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:32.872548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-83cd7880-17ac-4fb8-9f76-0ec9527ae44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:32.905244 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 40/83] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:19:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:19:32.906006 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4dc7ce-0e9b-4c60-9e8a-c4bfa7877502 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:32.950587 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 44/84] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:32.951475 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd7880-17ac-4fb8-9f76-0ec9527ae44a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:32.955989 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:33.025420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4dc7ce-0e9b-4c60-9e8a-c4bfa7877502 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:33.032541 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:33.056095 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd7880-17ac-4fb8-9f76-0ec9527ae44a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:33.060329 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551d51c-6b10-4721-86c5-9043df81ee5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:33.061207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551d51c-6b10-4721-86c5-9043df81ee5b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:33.061488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551d51c-6b10-4721-86c5-9043df81ee5b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:33.061759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551d51c-6b10-4721-86c5-9043df81ee5b None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:33.062949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551d51c-6b10-4721-86c5-9043df81ee5b None admin] RBAC: Authorizing `identity:get_project(project_id=f82f5c51617d45fc90355caaf5b8a8b2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:33.064481 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551d51c-6b10-4721-86c5-9043df81ee5b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:33.066196 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 41/85] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:32 2022] GET /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:33.066948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551d51c-6b10-4721-86c5-9043df81ee5b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:33.090249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb6c60-f8b1-4d39-a7df-4de424f25bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:33.091139 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb6c60-f8b1-4d39-a7df-4de424f25bca None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:33.091428 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb6c60-f8b1-4d39-a7df-4de424f25bca None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:33.091706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb6c60-f8b1-4d39-a7df-4de424f25bca None admin] PATH_INFO: `/v3/users/8ef914cb95d3407db3772d63d8a4e129` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:33.093093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb6c60-f8b1-4d39-a7df-4de424f25bca None admin] RBAC: Authorizing `identity:get_user(user_id=8ef914cb95d3407db3772d63d8a4e129)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:33.094594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb6c60-f8b1-4d39-a7df-4de424f25bca None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:33.096279 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 45/86] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:32 2022] GET /identity/v3/users/8ef914cb95d3407db3772d63d8a4e129 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:33.097041 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb6c60-f8b1-4d39-a7df-4de424f25bca None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:33.169605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:33.175733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551d51c-6b10-4721-86c5-9043df81ee5b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:33.200341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb6c60-f8b1-4d39-a7df-4de424f25bca None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:33.210580 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e46b41-a95f-4d5f-a470-0b7fed15d5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:33.211245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e46b41-a95f-4d5f-a470-0b7fed15d5ab None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:33.211546 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e46b41-a95f-4d5f-a470-0b7fed15d5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:33.211813 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e46b41-a95f-4d5f-a470-0b7fed15d5ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:33.234036 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5af44-21ca-405c-a40b-52a8c7ccec6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:33.234896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5af44-21ca-405c-a40b-52a8c7ccec6e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:33.235173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5af44-21ca-405c-a40b-52a8c7ccec6e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:33.235441 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5af44-21ca-405c-a40b-52a8c7ccec6e None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:33.236660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5af44-21ca-405c-a40b-52a8c7ccec6e None admin] RBAC: Authorizing `identity:get_project(project_id=f82f5c51617d45fc90355caaf5b8a8b2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:33.238169 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5af44-21ca-405c-a40b-52a8c7ccec6e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:33.239889 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 46/87] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:33 2022] GET /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:33.240864 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5af44-21ca-405c-a40b-52a8c7ccec6e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:33.263592 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:33.294094 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e46b41-a95f-4d5f-a470-0b7fed15d5ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:33.295604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e46b41-a95f-4d5f-a470-0b7fed15d5ab None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:33.347006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5af44-21ca-405c-a40b-52a8c7ccec6e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:33.382971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19891a0-232f-4a6a-a233-e4c813b572e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:33.383787 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19891a0-232f-4a6a-a233-e4c813b572e5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:33.384106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19891a0-232f-4a6a-a233-e4c813b572e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:33.384383 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19891a0-232f-4a6a-a233-e4c813b572e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:33.385669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19891a0-232f-4a6a-a233-e4c813b572e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:33.387151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19891a0-232f-4a6a-a233-e4c813b572e5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:33.388837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 47/88] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:19:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:33.393517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19891a0-232f-4a6a-a233-e4c813b572e5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:33.399851 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 42/89] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:19:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:19:33.400751 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e46b41-a95f-4d5f-a470-0b7fed15d5ab None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:33.404619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:33.479079 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:33.494945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19891a0-232f-4a6a-a233-e4c813b572e5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:33.505368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e46b41-a95f-4d5f-a470-0b7fed15d5ab None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:33.530478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02892b2-f8a5-46a4-bcfa-6f2e9d4eec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:33.531146 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02892b2-f8a5-46a4-bcfa-6f2e9d4eec3b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:33.531434 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02892b2-f8a5-46a4-bcfa-6f2e9d4eec3b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:33.531722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02892b2-f8a5-46a4-bcfa-6f2e9d4eec3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:33.532589 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02892b2-f8a5-46a4-bcfa-6f2e9d4eec3b None admin] RBAC: Adding query filter params (role.id=e1e39192d3af465aa504728e32ab7cd2, scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2, user.id=4ab56873c9924436afdc333a98301e78) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:33.532907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02892b2-f8a5-46a4-bcfa-6f2e9d4eec3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:33.534381 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02892b2-f8a5-46a4-bcfa-6f2e9d4eec3b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:33.540003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad719d-acbf-4180-8d92-adf53cda96bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:33.540693 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad719d-acbf-4180-8d92-adf53cda96bb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:33.540981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad719d-acbf-4180-8d92-adf53cda96bb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:33.541254 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad719d-acbf-4180-8d92-adf53cda96bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:33.542404 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 48/90] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:19:33 2022] GET /identity/v3/role_assignments?user.id=4ab56873c9924436afdc333a98301e78&scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:33.543221 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02892b2-f8a5-46a4-bcfa-6f2e9d4eec3b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:33.623308 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad719d-acbf-4180-8d92-adf53cda96bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:33.625506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad719d-acbf-4180-8d92-adf53cda96bb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:33.644282 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:33.679792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02892b2-f8a5-46a4-bcfa-6f2e9d4eec3b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:33.714121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:33.723348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d70772-068a-471e-b009-8ec3c8a51323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:33.724061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d70772-068a-471e-b009-8ec3c8a51323 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:33.724466 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d70772-068a-471e-b009-8ec3c8a51323 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:33.724733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d70772-068a-471e-b009-8ec3c8a51323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:33.725580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d70772-068a-471e-b009-8ec3c8a51323 None admin] RBAC: Adding query filter params (role.id=91889a59745c4d8185400f69d84eb50e, scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2, user.id=8ef914cb95d3407db3772d63d8a4e129) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:33.725898 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d70772-068a-471e-b009-8ec3c8a51323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:33.727413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d70772-068a-471e-b009-8ec3c8a51323 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:33.742010 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 49/91] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:19:33 2022] GET /identity/v3/role_assignments?user.id=8ef914cb95d3407db3772d63d8a4e129&scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2&role.id=91889a59745c4d8185400f69d84eb50e => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:33.742010 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d70772-068a-471e-b009-8ec3c8a51323 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:33.753909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 43/92] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:19:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:19:33.754575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad719d-acbf-4180-8d92-adf53cda96bb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:33.887016 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d70772-068a-471e-b009-8ec3c8a51323 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:33.910813 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad719d-acbf-4180-8d92-adf53cda96bb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:33.931685 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b94ae-8c23-4867-b73c-8158b58b4f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:33.932563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b94ae-8c23-4867-b73c-8158b58b4f37 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:33.933197 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b94ae-8c23-4867-b73c-8158b58b4f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:33.933570 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b94ae-8c23-4867-b73c-8158b58b4f37 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:33.934817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b94ae-8c23-4867-b73c-8158b58b4f37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:33.936398 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b94ae-8c23-4867-b73c-8158b58b4f37 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:33.949707 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:33.964289 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f56c8-a7bb-468d-b34e-2372d5df8ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:33.965243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f56c8-a7bb-468d-b34e-2372d5df8ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:33.965533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f56c8-a7bb-468d-b34e-2372d5df8ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:33.967182 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f56c8-a7bb-468d-b34e-2372d5df8ea0 None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:33.968558 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f56c8-a7bb-468d-b34e-2372d5df8ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=f82f5c51617d45fc90355caaf5b8a8b2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:33.970477 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f56c8-a7bb-468d-b34e-2372d5df8ea0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:33.972347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 44/93] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:33 2022] GET /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:33.976646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 50/94] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 16:19:33 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:19:33.984178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f56c8-a7bb-468d-b34e-2372d5df8ea0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:33.987406 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b94ae-8c23-4867-b73c-8158b58b4f37 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:34.067720 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:34.183057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f56c8-a7bb-468d-b34e-2372d5df8ea0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:34.236431 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b94ae-8c23-4867-b73c-8158b58b4f37 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:34.238353 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e78b20-20f5-49b3-ae67-13874a646dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:34.239491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e78b20-20f5-49b3-ae67-13874a646dfd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:34.239774 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e78b20-20f5-49b3-ae67-13874a646dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:34.240215 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e78b20-20f5-49b3-ae67-13874a646dfd None admin] PATH_INFO: `/v3/projects/be5498375a504138aca6cc376d3b4634` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:34.242373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e78b20-20f5-49b3-ae67-13874a646dfd None admin] RBAC: Authorizing `identity:get_project(project_id=be5498375a504138aca6cc376d3b4634)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:34.246050 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e78b20-20f5-49b3-ae67-13874a646dfd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:34.246645 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 45/95] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:33 2022] GET /identity/v3/projects/be5498375a504138aca6cc376d3b4634 => generated 312 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:34.254445 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e78b20-20f5-49b3-ae67-13874a646dfd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:34.291116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30693aa3-5464-49e7-91e0-774606516af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:34.292240 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30693aa3-5464-49e7-91e0-774606516af0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:34.292795 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30693aa3-5464-49e7-91e0-774606516af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:34.293082 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30693aa3-5464-49e7-91e0-774606516af0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:34.294103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30693aa3-5464-49e7-91e0-774606516af0 None admin] RBAC: Adding query filter params (role.id=60519d06a8c94e6c82462e5d79d9856b, scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2, user.id=8ef914cb95d3407db3772d63d8a4e129) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:34.295632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30693aa3-5464-49e7-91e0-774606516af0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:34.297474 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30693aa3-5464-49e7-91e0-774606516af0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:34.306188 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 51/96] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:19:33 2022] GET /identity/v3/role_assignments?user.id=8ef914cb95d3407db3772d63d8a4e129&scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2&role.id=60519d06a8c94e6c82462e5d79d9856b => generated 259 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:34.382664 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e78b20-20f5-49b3-ae67-13874a646dfd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:34.395481 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:34.423894 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec4d94-5244-434b-9ba2-8e62ffcc82e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:34.425010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec4d94-5244-434b-9ba2-8e62ffcc82e6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:34.425390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec4d94-5244-434b-9ba2-8e62ffcc82e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:34.425758 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec4d94-5244-434b-9ba2-8e62ffcc82e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:34.426716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec4d94-5244-434b-9ba2-8e62ffcc82e6 None admin] RBAC: Adding query filter params (role.id=91889a59745c4d8185400f69d84eb50e, scope.project.id=be5498375a504138aca6cc376d3b4634, user.id=8ef914cb95d3407db3772d63d8a4e129) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:34.427181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec4d94-5244-434b-9ba2-8e62ffcc82e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:34.429435 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec4d94-5244-434b-9ba2-8e62ffcc82e6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:34.440485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 46/97] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:19:34 2022] GET /identity/v3/role_assignments?user.id=8ef914cb95d3407db3772d63d8a4e129&scope.project.id=be5498375a504138aca6cc376d3b4634&role.id=91889a59745c4d8185400f69d84eb50e => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:36.332525 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca8056-f0a2-465b-bf48-58d38195974b None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:36.333072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca8056-f0a2-465b-bf48-58d38195974b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:36.333072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca8056-f0a2-465b-bf48-58d38195974b None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:36.334624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 52/98] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:36.340642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fe95b-b07a-43f6-96b3-99ec1a646a00 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:36.341596 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fe95b-b07a-43f6-96b3-99ec1a646a00 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:36.342089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fe95b-b07a-43f6-96b3-99ec1a646a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:36.364797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c81fe95b-b07a-43f6-96b3-99ec1a646a00 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:36.366446 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c81fe95b-b07a-43f6-96b3-99ec1a646a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:36.462060 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 47/99] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:36.496516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca8056-f0a2-465b-bf48-58d38195974b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:36.589404 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:36.648729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca8056-f0a2-465b-bf48-58d38195974b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:36.696724 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bee42-5493-418f-9840-26c666d1230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:36.697927 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bee42-5493-418f-9840-26c666d1230c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:36.698429 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bee42-5493-418f-9840-26c666d1230c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:36.698896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bee42-5493-418f-9840-26c666d1230c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:36.711363 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bee42-5493-418f-9840-26c666d1230c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:36.719076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-cc2bee42-5493-418f-9840-26c666d1230c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:19:36.719076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:36.719076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:36.719076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:36.719076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:36.719076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:36.719076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:36.719076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:36.719076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:36.719076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:36.719076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:36.719076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:36.719076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:36.719076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:36.719076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:36.719076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:36.720128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:36.720128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:36.720128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:36.720128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:36.720128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:36.720128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:36.720128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:36.720128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:36.720128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:36.720128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:36.720128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:36.720128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:19:36.720128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:36.720128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:36.720128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:36.720128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:36.720929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:36.720929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:36.720929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:36.720929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:36.720929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:36.720929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:36.720929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:36.720929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:36.720929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:36.720929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:36.720929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:19:36.720929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:19:36.720929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 53/100] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:19:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:36.729121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fe95b-b07a-43f6-96b3-99ec1a646a00 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:36.733369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545499f-de94-43c4-8517-d94144825901 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:36.733673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545499f-de94-43c4-8517-d94144825901 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:36.733958 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545499f-de94-43c4-8517-d94144825901 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:36.735342 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 54/101] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:19:36.741383 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf87972-fd5d-4050-bf2b-e7fd2b6943fa None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:36.741673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf87972-fd5d-4050-bf2b-e7fd2b6943fa None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:36.741953 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf87972-fd5d-4050-bf2b-e7fd2b6943fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:36.766734 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-bbf87972-fd5d-4050-bf2b-e7fd2b6943fa None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:36.768230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bbf87972-fd5d-4050-bf2b-e7fd2b6943fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:36.882673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 55/102] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:19:36.918131 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf87972-fd5d-4050-bf2b-e7fd2b6943fa None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:36.939867 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fe95b-b07a-43f6-96b3-99ec1a646a00 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:36.952431 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:37.013197 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:37.019373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ea080-bb25-4800-8a6d-c740049f43ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:37.020088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ea080-bb25-4800-8a6d-c740049f43ff None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:37.020380 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ea080-bb25-4800-8a6d-c740049f43ff None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:37.020654 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ea080-bb25-4800-8a6d-c740049f43ff None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:37.021488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ea080-bb25-4800-8a6d-c740049f43ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:37.021795 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ea080-bb25-4800-8a6d-c740049f43ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:37.023254 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ea080-bb25-4800-8a6d-c740049f43ff None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:37.042536 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 48/103] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:37.048242 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ea080-bb25-4800-8a6d-c740049f43ff None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:37.123140 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf87972-fd5d-4050-bf2b-e7fd2b6943fa None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:37.211986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe5187-2f9b-41ba-9e30-0a80a07b3d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:37.213316 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe5187-2f9b-41ba-9e30-0a80a07b3d37 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:37.213810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe5187-2f9b-41ba-9e30-0a80a07b3d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:37.214380 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe5187-2f9b-41ba-9e30-0a80a07b3d37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:37.220999 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ea080-bb25-4800-8a6d-c740049f43ff None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:37.250118 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe5187-2f9b-41ba-9e30-0a80a07b3d37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:37.258245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-51fe5187-2f9b-41ba-9e30-0a80a07b3d37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:19:37.258245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:37.258245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:37.258245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:37.258245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:37.258245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:37.258245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:37.258245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:37.258245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:37.258245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:37.258245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:37.258245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:37.258245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:37.258245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:37.258245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:37.258245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:37.259120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:37.259120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:37.259120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:37.259120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:37.259120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:37.259120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:37.259120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:37.259120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:37.259120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:37.259120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:37.259120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:37.259120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:19:37.259120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:37.259120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:37.259120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:37.259120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:37.259919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:37.259919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:37.259919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:37.259919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:37.259919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:37.259919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:37.259919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:37.259919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:37.259919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:37.259919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:37.259919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:19:37.259919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:19:37.259919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 56/104] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:19:37.269385 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9670ac-3d37-4f2d-9ea9-5dfa6a46176c None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:37.269663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9670ac-3d37-4f2d-9ea9-5dfa6a46176c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:37.269946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9670ac-3d37-4f2d-9ea9-5dfa6a46176c None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:37.271378 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 57/105] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:37.272243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693d6bc-41d2-4ce5-8452-51134fadee04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:37.273199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693d6bc-41d2-4ce5-8452-51134fadee04 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:37.273476 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693d6bc-41d2-4ce5-8452-51134fadee04 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:37.273748 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693d6bc-41d2-4ce5-8452-51134fadee04 None admin] PATH_INFO: `/v3/users/4ab56873c9924436afdc333a98301e78` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:37.275093 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693d6bc-41d2-4ce5-8452-51134fadee04 None admin] RBAC: Authorizing `identity:get_user(user_id=4ab56873c9924436afdc333a98301e78)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:37.276702 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693d6bc-41d2-4ce5-8452-51134fadee04 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:37.278331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 49/106] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:37 2022] GET /identity/v3/users/4ab56873c9924436afdc333a98301e78 => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:37.279144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9670ac-3d37-4f2d-9ea9-5dfa6a46176c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:37.280410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1aa89-4712-4f21-a68d-1b18c07cdf1b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:37.280998 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1aa89-4712-4f21-a68d-1b18c07cdf1b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:37.281273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1aa89-4712-4f21-a68d-1b18c07cdf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:37.318196 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c6d1aa89-4712-4f21-a68d-1b18c07cdf1b None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:37.319469 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c6d1aa89-4712-4f21-a68d-1b18c07cdf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:37.388581 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:37.464424 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 50/107] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:37.466159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1aa89-4712-4f21-a68d-1b18c07cdf1b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:37.520738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9670ac-3d37-4f2d-9ea9-5dfa6a46176c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:37.535454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:37.576461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1aa89-4712-4f21-a68d-1b18c07cdf1b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:37.618439 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341f037-16e2-42d1-98c7-02b78785b795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:37.619340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341f037-16e2-42d1-98c7-02b78785b795 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:37.619620 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341f037-16e2-42d1-98c7-02b78785b795 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:37.619892 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341f037-16e2-42d1-98c7-02b78785b795 None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:37.621385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341f037-16e2-42d1-98c7-02b78785b795 None admin] RBAC: Authorizing `identity:get_project(project_id=f82f5c51617d45fc90355caaf5b8a8b2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:37.622897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341f037-16e2-42d1-98c7-02b78785b795 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:37.624710 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 51/108] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:37 2022] GET /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:37.625814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341f037-16e2-42d1-98c7-02b78785b795 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:37.656828 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c31c9-c324-4339-a016-f5cc01e3a692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:37.657531 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c31c9-c324-4339-a016-f5cc01e3a692 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:37.657821 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c31c9-c324-4339-a016-f5cc01e3a692 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:37.658101 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c31c9-c324-4339-a016-f5cc01e3a692 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:37.658895 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c31c9-c324-4339-a016-f5cc01e3a692 None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:37.659198 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c31c9-c324-4339-a016-f5cc01e3a692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:37.660812 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c31c9-c324-4339-a016-f5cc01e3a692 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:37.664508 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:37.685474 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 58/109] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:19:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:37.687895 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c31c9-c324-4339-a016-f5cc01e3a692 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:37.797705 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341f037-16e2-42d1-98c7-02b78785b795 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:37.824106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c31c9-c324-4339-a016-f5cc01e3a692 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:37.868725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f539a61-06e2-4595-b212-9e2652e69ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:37.869099 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b50f31-9d4b-43aa-9cc7-4f6c5fc7ecad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:37.869975 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b50f31-9d4b-43aa-9cc7-4f6c5fc7ecad None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:37.870263 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b50f31-9d4b-43aa-9cc7-4f6c5fc7ecad None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:37.870539 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b50f31-9d4b-43aa-9cc7-4f6c5fc7ecad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:37.870894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f539a61-06e2-4595-b212-9e2652e69ab2 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:37.871380 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f539a61-06e2-4595-b212-9e2652e69ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:37.871883 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f539a61-06e2-4595-b212-9e2652e69ab2 None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2/users/4ab56873c9924436afdc333a98301e78/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:37.874581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f539a61-06e2-4595-b212-9e2652e69ab2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f82f5c51617d45fc90355caaf5b8a8b2, user_id=4ab56873c9924436afdc333a98301e78, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:37.876438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f539a61-06e2-4595-b212-9e2652e69ab2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:37.885194 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b50f31-9d4b-43aa-9cc7-4f6c5fc7ecad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:37.894155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-f2b50f31-9d4b-43aa-9cc7-4f6c5fc7ecad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:19:37.894155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:37.894155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:37.894155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:37.894155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:37.894155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:37.894155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:37.894155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:37.894155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:37.894155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:37.894155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:37.894155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:37.894155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:37.894155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:37.894155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:37.894155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:37.895172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:37.895172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:37.895172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:37.895172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:37.895172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:37.895172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:37.895172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:37.895172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:37.895172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:37.895172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:37.895172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:37.895172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:19:37.895172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:37.895172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:37.895172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:37.895172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:37.895953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:37.895953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:37.895953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:37.895953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:37.895953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:37.895953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:37.895953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:37.895953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:37.895953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:37.895953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:37.895953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:19:37.895953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:19:37.895953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 52/110] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:19:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:37.897573 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b50f31-9d4b-43aa-9cc7-4f6c5fc7ecad None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:37.898608 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 59/111] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:19:37 2022] PUT /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2/users/4ab56873c9924436afdc333a98301e78/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:19:37.900560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfd075-c238-4b28-80ab-84fb23fec1f2 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:37.902081 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfd075-c238-4b28-80ab-84fb23fec1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:37.902590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfd075-c238-4b28-80ab-84fb23fec1f2 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:37.904442 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 60/112] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:37.910264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470b2b5-9b21-4a62-ad46-d52d490406be None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:37.910598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470b2b5-9b21-4a62-ad46-d52d490406be None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:37.911239 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470b2b5-9b21-4a62-ad46-d52d490406be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:37.931341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6470b2b5-9b21-4a62-ad46-d52d490406be None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:37.932741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6470b2b5-9b21-4a62-ad46-d52d490406be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:37.961963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:38.017720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 61/113] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:19:38.018801 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470b2b5-9b21-4a62-ad46-d52d490406be None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:38.030338 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:38.043844 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b50f31-9d4b-43aa-9cc7-4f6c5fc7ecad None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:38.096973 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8f3c4-7511-44bd-b264-9e6eda9b7a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:38.099047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8f3c4-7511-44bd-b264-9e6eda9b7a3a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:38.104512 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8f3c4-7511-44bd-b264-9e6eda9b7a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:38.104809 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8f3c4-7511-44bd-b264-9e6eda9b7a3a None admin] PATH_INFO: `/v3/users/8ef914cb95d3407db3772d63d8a4e129` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:38.106294 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8f3c4-7511-44bd-b264-9e6eda9b7a3a None admin] RBAC: Authorizing `identity:get_user(user_id=8ef914cb95d3407db3772d63d8a4e129)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:38.107834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8f3c4-7511-44bd-b264-9e6eda9b7a3a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:38.109642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 53/114] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:37 2022] GET /identity/v3/users/8ef914cb95d3407db3772d63d8a4e129 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:38.110479 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8f3c4-7511-44bd-b264-9e6eda9b7a3a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:38.189505 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470b2b5-9b21-4a62-ad46-d52d490406be None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:38.234046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818eb6f8-0dd8-40c5-81b6-8dd1ec4492f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:38.234745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eb6f8-0dd8-40c5-81b6-8dd1ec4492f0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:38.235030 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eb6f8-0dd8-40c5-81b6-8dd1ec4492f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:38.235334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eb6f8-0dd8-40c5-81b6-8dd1ec4492f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:38.236634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818eb6f8-0dd8-40c5-81b6-8dd1ec4492f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:38.236950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818eb6f8-0dd8-40c5-81b6-8dd1ec4492f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:38.238390 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818eb6f8-0dd8-40c5-81b6-8dd1ec4492f0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:38.247460 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 62/115] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:19:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:38.251871 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818eb6f8-0dd8-40c5-81b6-8dd1ec4492f0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:38.269822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8f3c4-7511-44bd-b264-9e6eda9b7a3a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:38.272001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:38.309387 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030e7b9-1c4d-40e6-afb8-f0374645e0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:38.310205 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030e7b9-1c4d-40e6-afb8-f0374645e0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:38.310815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030e7b9-1c4d-40e6-afb8-f0374645e0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:38.310815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030e7b9-1c4d-40e6-afb8-f0374645e0e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:38.312199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030e7b9-1c4d-40e6-afb8-f0374645e0e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:38.313691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030e7b9-1c4d-40e6-afb8-f0374645e0e1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:38.315717 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 54/116] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:19:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:38.316951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd50201-93f2-4a9e-b6ea-30a2deffb4b4 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:38.317238 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd50201-93f2-4a9e-b6ea-30a2deffb4b4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:38.317515 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd50201-93f2-4a9e-b6ea-30a2deffb4b4 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:38.318927 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 55/117] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:38.323341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604e984-73c0-432c-b214-e0f2adb0df7d None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:38.323341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604e984-73c0-432c-b214-e0f2adb0df7d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:38.323341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604e984-73c0-432c-b214-e0f2adb0df7d None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:38.323341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 56/118] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:38.323341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604e984-73c0-432c-b214-e0f2adb0df7d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:38.357128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:38.369426 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818eb6f8-0dd8-40c5-81b6-8dd1ec4492f0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:38.406435 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19ad3b-7c59-42ce-ad6b-84cdf4fb35a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:38.407327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19ad3b-7c59-42ce-ad6b-84cdf4fb35a9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:38.407615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19ad3b-7c59-42ce-ad6b-84cdf4fb35a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:38.407897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19ad3b-7c59-42ce-ad6b-84cdf4fb35a9 None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:38.409715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19ad3b-7c59-42ce-ad6b-84cdf4fb35a9 None admin] RBAC: Authorizing `identity:get_project(project_id=f82f5c51617d45fc90355caaf5b8a8b2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:38.411592 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19ad3b-7c59-42ce-ad6b-84cdf4fb35a9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:38.414098 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 63/119] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:38 2022] GET /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:38.414675 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19ad3b-7c59-42ce-ad6b-84cdf4fb35a9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:38.440279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604e984-73c0-432c-b214-e0f2adb0df7d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:38.479377 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b8abb-d220-4306-9284-f5f107ab95bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:38.480305 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b8abb-d220-4306-9284-f5f107ab95bd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:38.480597 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b8abb-d220-4306-9284-f5f107ab95bd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:38.480876 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b8abb-d220-4306-9284-f5f107ab95bd None admin] PATH_INFO: `/v3/users/8ef914cb95d3407db3772d63d8a4e129` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:38.482114 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b8abb-d220-4306-9284-f5f107ab95bd None admin] RBAC: Authorizing `identity:get_user(user_id=8ef914cb95d3407db3772d63d8a4e129)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:38.483596 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b8abb-d220-4306-9284-f5f107ab95bd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:38.485471 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 57/120] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:38 2022] GET /identity/v3/users/8ef914cb95d3407db3772d63d8a4e129 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:38.491023 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53793741-5867-4924-8a8c-84bfe639385d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:38.491331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53793741-5867-4924-8a8c-84bfe639385d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:38.491606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53793741-5867-4924-8a8c-84bfe639385d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:38.508597 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-53793741-5867-4924-8a8c-84bfe639385d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:38.509799 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-53793741-5867-4924-8a8c-84bfe639385d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:38.516358 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:38.530955 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19ad3b-7c59-42ce-ad6b-84cdf4fb35a9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:38.579394 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 58/121] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:38.580862 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50600652-4376-49cf-9f0b-2aa4fb181b86 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:38.581156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50600652-4376-49cf-9f0b-2aa4fb181b86 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:38.581432 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50600652-4376-49cf-9f0b-2aa4fb181b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:38.582615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7b0bc-0fc7-4e40-852c-66183bcc37dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:38.583962 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7b0bc-0fc7-4e40-852c-66183bcc37dd None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:38.584796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7b0bc-0fc7-4e40-852c-66183bcc37dd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:38.585393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7b0bc-0fc7-4e40-852c-66183bcc37dd None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:38.586636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7b0bc-0fc7-4e40-852c-66183bcc37dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:38.589149 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7b0bc-0fc7-4e40-852c-66183bcc37dd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:38.600852 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-50600652-4376-49cf-9f0b-2aa4fb181b86 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:38.602337 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-50600652-4376-49cf-9f0b-2aa4fb181b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:38.632814 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 64/122] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 16:19:38 2022] POST /identity/v3/projects => generated 302 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:19:38.632814 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7b0bc-0fc7-4e40-852c-66183bcc37dd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:38.637642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:38.697299 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 59/123] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:38.698282 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50600652-4376-49cf-9f0b-2aa4fb181b86 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:38.782633 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7b0bc-0fc7-4e40-852c-66183bcc37dd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:38.822098 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12d520-5d88-44a3-ac60-3f973cd26516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:38.823227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12d520-5d88-44a3-ac60-3f973cd26516 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:38.823521 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12d520-5d88-44a3-ac60-3f973cd26516 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:38.823802 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12d520-5d88-44a3-ac60-3f973cd26516 None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2/users/8ef914cb95d3407db3772d63d8a4e129/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:38.826142 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12d520-5d88-44a3-ac60-3f973cd26516 None admin] RBAC: Authorizing `identity:create_grant(project_id=f82f5c51617d45fc90355caaf5b8a8b2, user_id=8ef914cb95d3407db3772d63d8a4e129, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:38.827746 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12d520-5d88-44a3-ac60-3f973cd26516 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:38.829249 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50600652-4376-49cf-9f0b-2aa4fb181b86 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:38.842756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:38.849900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 65/124] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:19:38 2022] PUT /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2/users/8ef914cb95d3407db3772d63d8a4e129/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:19:38.851325 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12d520-5d88-44a3-ac60-3f973cd26516 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:38.887411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c66d9-32a6-4325-ab9c-386964e0e103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:38.888409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c66d9-32a6-4325-ab9c-386964e0e103 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:38.888805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c66d9-32a6-4325-ab9c-386964e0e103 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:38.889184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c66d9-32a6-4325-ab9c-386964e0e103 None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:38.890644 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c66d9-32a6-4325-ab9c-386964e0e103 None admin] RBAC: Authorizing `identity:get_project(project_id=f82f5c51617d45fc90355caaf5b8a8b2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:38.892577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c66d9-32a6-4325-ab9c-386964e0e103 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:38.895055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 60/125] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:38 2022] GET /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:38.896477 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c66d9-32a6-4325-ab9c-386964e0e103 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:38.936448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:39.017424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12d520-5d88-44a3-ac60-3f973cd26516 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:39.040714 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c66d9-32a6-4325-ab9c-386964e0e103 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:39.059066 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024346c-df19-4585-b984-9ad081e3a918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:39.060062 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024346c-df19-4585-b984-9ad081e3a918 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:39.060457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024346c-df19-4585-b984-9ad081e3a918 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:39.060839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024346c-df19-4585-b984-9ad081e3a918 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:39.074141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024346c-df19-4585-b984-9ad081e3a918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:39.083298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-0024346c-df19-4585-b984-9ad081e3a918 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:19:39.083298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:39.083298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:39.083298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:39.083298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:39.083298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:39.083298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:39.083298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:39.083298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:39.083298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:39.083298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:39.083298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:39.083298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:39.083298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:39.083298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:39.083298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:39.085321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:39.085321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:39.085321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:39.085321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:39.085321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:39.085321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:39.085321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:39.085321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:39.085321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:39.085321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:39.085321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:39.085321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:19:39.085321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:39.085321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:39.085321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:39.085321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:39.086303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:39.086303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:39.086303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:39.086303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:39.086303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:39.086303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:39.086303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:39.086303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:39.086303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:39.086303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:39.086303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:19:39.086303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:19:39.086303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 66/126] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:39.086303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024346c-df19-4585-b984-9ad081e3a918 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:39.088047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2fcc6-8803-4264-8748-4d5129675aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:39.092115 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2fcc6-8803-4264-8748-4d5129675aaf None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:39.092115 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2fcc6-8803-4264-8748-4d5129675aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:39.092115 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2fcc6-8803-4264-8748-4d5129675aaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:39.107766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2fcc6-8803-4264-8748-4d5129675aaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:39.118082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c8f2fcc6-8803-4264-8748-4d5129675aaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:19:39.118082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:39.118082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:39.118082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:39.118082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:39.118082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:39.118082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:39.118082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:39.118082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:39.118082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:39.118082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:39.118082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:39.118082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:39.118082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:39.118082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:39.118082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:39.119220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:39.119220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:39.119220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:39.119220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:39.119220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:39.119220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:39.119220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:39.119220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:39.119220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:39.119220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:39.119220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:39.119220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:19:39.119220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:39.119220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:39.119220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:39.119220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:39.120316 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:39.120316 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:39.120316 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:39.120316 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:39.120316 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:39.120316 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:39.120316 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:39.120316 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:39.120316 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:39.120316 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:39.120316 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:19:39.120316 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:19:39.124288 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 61/127] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:39.124288 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2fcc6-8803-4264-8748-4d5129675aaf None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:39.174900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:39.262854 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024346c-df19-4585-b984-9ad081e3a918 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:39.290797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:39.315061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2fcc6-8803-4264-8748-4d5129675aaf None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:39.333132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb31cff-5e9d-45bf-8c3e-8069daa73f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:39.334487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb31cff-5e9d-45bf-8c3e-8069daa73f5a None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:39.334951 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb31cff-5e9d-45bf-8c3e-8069daa73f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:39.335393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb31cff-5e9d-45bf-8c3e-8069daa73f5a None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2/users/8ef914cb95d3407db3772d63d8a4e129/roles/60519d06a8c94e6c82462e5d79d9856b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:39.342038 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb31cff-5e9d-45bf-8c3e-8069daa73f5a None admin] RBAC: Authorizing `identity:create_grant(project_id=f82f5c51617d45fc90355caaf5b8a8b2, user_id=8ef914cb95d3407db3772d63d8a4e129, role_id=60519d06a8c94e6c82462e5d79d9856b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:39.344039 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb31cff-5e9d-45bf-8c3e-8069daa73f5a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:39.351570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0cf89-acf8-4d30-8742-8ffc1e41891c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:39.352430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0cf89-acf8-4d30-8742-8ffc1e41891c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:39.352857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0cf89-acf8-4d30-8742-8ffc1e41891c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:39.353554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0cf89-acf8-4d30-8742-8ffc1e41891c None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:39.354503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0cf89-acf8-4d30-8742-8ffc1e41891c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:39.354817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0cf89-acf8-4d30-8742-8ffc1e41891c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:39.356458 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0cf89-acf8-4d30-8742-8ffc1e41891c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:39.368169 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 62/128] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:19:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:39.369093 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0cf89-acf8-4d30-8742-8ffc1e41891c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:39.372952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 67/129] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:19:39 2022] PUT /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2/users/8ef914cb95d3407db3772d63d8a4e129/roles/60519d06a8c94e6c82462e5d79d9856b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:19:39.374193 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb31cff-5e9d-45bf-8c3e-8069daa73f5a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:39.543058 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0cf89-acf8-4d30-8742-8ffc1e41891c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:39.586143 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4df02-a06d-4fcd-987b-b0b4b4ce5b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:39.586973 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4df02-a06d-4fcd-987b-b0b4b4ce5b4d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:39.587268 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4df02-a06d-4fcd-987b-b0b4b4ce5b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:39.587547 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4df02-a06d-4fcd-987b-b0b4b4ce5b4d None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:39.588340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4df02-a06d-4fcd-987b-b0b4b4ce5b4d None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:39.588651 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4df02-a06d-4fcd-987b-b0b4b4ce5b4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:39.590303 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4df02-a06d-4fcd-987b-b0b4b4ce5b4d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:39.601117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 63/130] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:19:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:39.607033 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4df02-a06d-4fcd-987b-b0b4b4ce5b4d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:39.610050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb31cff-5e9d-45bf-8c3e-8069daa73f5a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:39.632421 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:39.662928 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:39.694784 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20882e24-cf64-4964-ab1b-d36955b2735b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:39.696203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20882e24-cf64-4964-ab1b-d36955b2735b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:39.696763 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20882e24-cf64-4964-ab1b-d36955b2735b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:39.697275 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20882e24-cf64-4964-ab1b-d36955b2735b None admin] PATH_INFO: `/v3/users/906dbeb68d7c48f3bbe09217c0f9bee6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:39.715359 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20882e24-cf64-4964-ab1b-d36955b2735b None admin] RBAC: Authorizing `identity:get_user(user_id=906dbeb68d7c48f3bbe09217c0f9bee6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:39.717337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20882e24-cf64-4964-ab1b-d36955b2735b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:39.719497 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 68/131] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:39 2022] GET /identity/v3/users/906dbeb68d7c48f3bbe09217c0f9bee6 => generated 289 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:39.725009 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20882e24-cf64-4964-ab1b-d36955b2735b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:39.774353 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4df02-a06d-4fcd-987b-b0b4b4ce5b4d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:39.818238 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c44d30-3df0-4faf-99c2-5e16bb7d4402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:39.819036 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c44d30-3df0-4faf-99c2-5e16bb7d4402 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:39.819328 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c44d30-3df0-4faf-99c2-5e16bb7d4402 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:39.819603 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c44d30-3df0-4faf-99c2-5e16bb7d4402 None admin] PATH_INFO: `/v3/users/8ef914cb95d3407db3772d63d8a4e129` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:39.821377 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c44d30-3df0-4faf-99c2-5e16bb7d4402 None admin] RBAC: Authorizing `identity:get_user(user_id=8ef914cb95d3407db3772d63d8a4e129)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:39.822901 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c44d30-3df0-4faf-99c2-5e16bb7d4402 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:39.825338 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 64/132] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:39 2022] GET /identity/v3/users/8ef914cb95d3407db3772d63d8a4e129 => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:39.831666 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c44d30-3df0-4faf-99c2-5e16bb7d4402 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:39.855698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20882e24-cf64-4964-ab1b-d36955b2735b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:39.899906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10360c1-1b41-4d67-aa85-0b9e97d9a438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:39.902058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10360c1-1b41-4d67-aa85-0b9e97d9a438 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:39.902744 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10360c1-1b41-4d67-aa85-0b9e97d9a438 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:39.903400 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10360c1-1b41-4d67-aa85-0b9e97d9a438 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:39.939302 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:39.988429 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:39.988652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c44d30-3df0-4faf-99c2-5e16bb7d4402 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:40.033976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10360c1-1b41-4d67-aa85-0b9e97d9a438 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:40.035479 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10360c1-1b41-4d67-aa85-0b9e97d9a438 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:40.059197 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8b99a-7f8a-4476-83ba-352f089a3a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:40.060098 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8b99a-7f8a-4476-83ba-352f089a3a40 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:40.060381 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8b99a-7f8a-4476-83ba-352f089a3a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:40.060652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8b99a-7f8a-4476-83ba-352f089a3a40 None admin] PATH_INFO: `/v3/projects/be5498375a504138aca6cc376d3b4634` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:40.061885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8b99a-7f8a-4476-83ba-352f089a3a40 None admin] RBAC: Authorizing `identity:get_project(project_id=be5498375a504138aca6cc376d3b4634)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:40.063369 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8b99a-7f8a-4476-83ba-352f089a3a40 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:40.065464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 65/133] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:39 2022] GET /identity/v3/projects/be5498375a504138aca6cc376d3b4634 => generated 312 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:40.076074 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8b99a-7f8a-4476-83ba-352f089a3a40 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:40.159344 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 69/134] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:19:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:19:40.169360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10360c1-1b41-4d67-aa85-0b9e97d9a438 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:40.278298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:40.301666 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8b99a-7f8a-4476-83ba-352f089a3a40 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:40.310882 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10360c1-1b41-4d67-aa85-0b9e97d9a438 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:40.370623 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34c7ad-4df8-49aa-abaf-1a7cdbb1f352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:40.371422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34c7ad-4df8-49aa-abaf-1a7cdbb1f352 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:40.371712 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34c7ad-4df8-49aa-abaf-1a7cdbb1f352 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:40.372447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34c7ad-4df8-49aa-abaf-1a7cdbb1f352 None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:40.381285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34c7ad-4df8-49aa-abaf-1a7cdbb1f352 None admin] RBAC: Authorizing `identity:get_project(project_id=f82f5c51617d45fc90355caaf5b8a8b2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:40.382948 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34c7ad-4df8-49aa-abaf-1a7cdbb1f352 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:40.385112 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 70/135] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:40 2022] GET /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:40.391068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34c7ad-4df8-49aa-abaf-1a7cdbb1f352 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:40.413919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7732d7-0f70-48af-88ad-c21212aea81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:40.415197 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7732d7-0f70-48af-88ad-c21212aea81a None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:40.415636 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7732d7-0f70-48af-88ad-c21212aea81a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:40.416067 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7732d7-0f70-48af-88ad-c21212aea81a None admin] PATH_INFO: `/v3/projects/be5498375a504138aca6cc376d3b4634/users/8ef914cb95d3407db3772d63d8a4e129/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:40.420740 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7732d7-0f70-48af-88ad-c21212aea81a None admin] RBAC: Authorizing `identity:create_grant(project_id=be5498375a504138aca6cc376d3b4634, user_id=8ef914cb95d3407db3772d63d8a4e129, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:40.422462 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7732d7-0f70-48af-88ad-c21212aea81a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:40.460816 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 66/136] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:19:40 2022] PUT /identity/v3/projects/be5498375a504138aca6cc376d3b4634/users/8ef914cb95d3407db3772d63d8a4e129/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:19:40.548859 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34c7ad-4df8-49aa-abaf-1a7cdbb1f352 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:40.593676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adddd3-7f23-465d-a007-cfafa446b6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:40.594377 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adddd3-7f23-465d-a007-cfafa446b6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:40.594670 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adddd3-7f23-465d-a007-cfafa446b6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:40.594956 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adddd3-7f23-465d-a007-cfafa446b6a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:40.595817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0adddd3-7f23-465d-a007-cfafa446b6a7 None admin] RBAC: Adding query filter params (role.id=63f594b5fbbe4eb7b69119f8afda416f, scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2, user.id=906dbeb68d7c48f3bbe09217c0f9bee6) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:40.596168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0adddd3-7f23-465d-a007-cfafa446b6a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:40.597657 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0adddd3-7f23-465d-a007-cfafa446b6a7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:40.604374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 71/137] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:19:40 2022] GET /identity/v3/role_assignments?user.id=906dbeb68d7c48f3bbe09217c0f9bee6&scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2&role.id=63f594b5fbbe4eb7b69119f8afda416f => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:40.788340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065f08c-fe47-42e2-807f-e2bdf97a9381 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:40.789211 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065f08c-fe47-42e2-807f-e2bdf97a9381 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:40.789655 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065f08c-fe47-42e2-807f-e2bdf97a9381 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:40.791253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 67/138] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:40.806184 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d796c-7381-4ca8-9932-6a247b59524a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:40.806717 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d796c-7381-4ca8-9932-6a247b59524a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:40.806790 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d796c-7381-4ca8-9932-6a247b59524a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:40.829581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-148d796c-7381-4ca8-9932-6a247b59524a None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:40.831152 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-148d796c-7381-4ca8-9932-6a247b59524a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:40.834901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:40.926123 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 72/139] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:40.969490 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065f08c-fe47-42e2-807f-e2bdf97a9381 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:40.978088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:41.103823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065f08c-fe47-42e2-807f-e2bdf97a9381 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:41.146302 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738faf57-4c48-410b-a349-7fad0c318be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:41.147656 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738faf57-4c48-410b-a349-7fad0c318be7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:41.148184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738faf57-4c48-410b-a349-7fad0c318be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:41.148653 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738faf57-4c48-410b-a349-7fad0c318be7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:41.162861 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738faf57-4c48-410b-a349-7fad0c318be7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:41.171243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-738faf57-4c48-410b-a349-7fad0c318be7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:19:41.171243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:41.171243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:41.171243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:41.171243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:41.171243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:41.171243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:41.171243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:41.171243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:41.171243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:41.171243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:41.171243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:41.171243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:41.171243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:41.171243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:41.171243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:41.172296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:41.172296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:41.172296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:41.172296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:41.172296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:41.172296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:41.172296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:41.172296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:41.172296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:41.172296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:41.172296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:41.172296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:19:41.172296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:41.172296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:41.172296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:41.172296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:41.173297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:41.173297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:41.173297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:41.173297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:41.173297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:41.173297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:41.173297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:41.173297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:41.173297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:41.173297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:41.173297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:19:41.173297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:19:41.175718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 68/140] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:19:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:41.181984 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d796c-7381-4ca8-9932-6a247b59524a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:41.312512 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d796c-7381-4ca8-9932-6a247b59524a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:41.376317 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a4da6-d750-4a70-b21a-94bcef5c103a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:41.376926 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a4da6-d750-4a70-b21a-94bcef5c103a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:41.377209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a4da6-d750-4a70-b21a-94bcef5c103a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:41.377482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a4da6-d750-4a70-b21a-94bcef5c103a None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:41.378239 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a4da6-d750-4a70-b21a-94bcef5c103a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:41.378543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a4da6-d750-4a70-b21a-94bcef5c103a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:41.379932 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a4da6-d750-4a70-b21a-94bcef5c103a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:41.395291 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 73/141] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:41.401312 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738faf57-4c48-410b-a349-7fad0c318be7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:41.488822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:41.534627 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738faf57-4c48-410b-a349-7fad0c318be7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:41.578881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242bc6c-5415-4b77-b6c1-7daaf9a2a3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:41.580218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242bc6c-5415-4b77-b6c1-7daaf9a2a3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:41.581047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242bc6c-5415-4b77-b6c1-7daaf9a2a3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:41.581537 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242bc6c-5415-4b77-b6c1-7daaf9a2a3e9 None admin] PATH_INFO: `/v3/users/4ab56873c9924436afdc333a98301e78` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:41.588896 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242bc6c-5415-4b77-b6c1-7daaf9a2a3e9 None admin] RBAC: Authorizing `identity:get_user(user_id=4ab56873c9924436afdc333a98301e78)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:41.590778 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242bc6c-5415-4b77-b6c1-7daaf9a2a3e9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:41.592760 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 69/142] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:41 2022] GET /identity/v3/users/4ab56873c9924436afdc333a98301e78 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:41.598375 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a4da6-d750-4a70-b21a-94bcef5c103a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:41.606599 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:41.743267 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a4da6-d750-4a70-b21a-94bcef5c103a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:41.788740 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e9afe-bf07-405f-bc73-f7e06d559cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:41.789402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e9afe-bf07-405f-bc73-f7e06d559cba None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:41.789686 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e9afe-bf07-405f-bc73-f7e06d559cba None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:41.789965 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e9afe-bf07-405f-bc73-f7e06d559cba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:41.880256 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e9afe-bf07-405f-bc73-f7e06d559cba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:41.881832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e9afe-bf07-405f-bc73-f7e06d559cba None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:41.884086 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:41.998220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 74/143] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:19:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:19:42.003887 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242bc6c-5415-4b77-b6c1-7daaf9a2a3e9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:42.105940 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdef156-7c5a-4d6c-b088-0080de89e415 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:42.106371 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdef156-7c5a-4d6c-b088-0080de89e415 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:42.106489 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdef156-7c5a-4d6c-b088-0080de89e415 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:42.107852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 75/144] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:19:42.114621 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbf7db-67de-4ed3-87ba-fa44debb9db9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:42.115070 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbf7db-67de-4ed3-87ba-fa44debb9db9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:42.115253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbf7db-67de-4ed3-87ba-fa44debb9db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:42.153703 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-34cbf7db-67de-4ed3-87ba-fa44debb9db9 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:42.155071 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-34cbf7db-67de-4ed3-87ba-fa44debb9db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:42.178777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242bc6c-5415-4b77-b6c1-7daaf9a2a3e9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:42.274488 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 76/145] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:19:42.274986 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:42.308742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9d83b-11b9-43a8-8b88-f013a92080c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:42.309648 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9d83b-11b9-43a8-8b88-f013a92080c8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:42.309934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9d83b-11b9-43a8-8b88-f013a92080c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:42.310208 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9d83b-11b9-43a8-8b88-f013a92080c8 None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:42.311433 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9d83b-11b9-43a8-8b88-f013a92080c8 None admin] RBAC: Authorizing `identity:get_project(project_id=f82f5c51617d45fc90355caaf5b8a8b2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:42.312945 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9d83b-11b9-43a8-8b88-f013a92080c8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:42.314659 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 70/146] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:42 2022] GET /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2 => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:42.320676 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9d83b-11b9-43a8-8b88-f013a92080c8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:42.320834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbf7db-67de-4ed3-87ba-fa44debb9db9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:42.392378 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:42.473240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9d83b-11b9-43a8-8b88-f013a92080c8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:42.511983 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64406a-e8a0-4e4d-9cfe-5f699e991259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:42.512838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64406a-e8a0-4e4d-9cfe-5f699e991259 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:42.513117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64406a-e8a0-4e4d-9cfe-5f699e991259 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:42.513393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64406a-e8a0-4e4d-9cfe-5f699e991259 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:42.514752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64406a-e8a0-4e4d-9cfe-5f699e991259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:42.516267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64406a-e8a0-4e4d-9cfe-5f699e991259 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:42.518114 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 71/147] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:19:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:42.519120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b290e43-b16c-47cf-96c4-e5b96a63a91b None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:42.519404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b290e43-b16c-47cf-96c4-e5b96a63a91b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:42.519678 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b290e43-b16c-47cf-96c4-e5b96a63a91b None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:42.520974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 72/148] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:42.531097 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b290e43-b16c-47cf-96c4-e5b96a63a91b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:42.533111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbf7db-67de-4ed3-87ba-fa44debb9db9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:42.592261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1307671-be51-4497-aab0-160561ddfced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:42.592937 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1307671-be51-4497-aab0-160561ddfced None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:42.593222 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1307671-be51-4497-aab0-160561ddfced None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:42.593506 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1307671-be51-4497-aab0-160561ddfced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:42.594354 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1307671-be51-4497-aab0-160561ddfced None admin] RBAC: Adding query filter params (role.id=e1e39192d3af465aa504728e32ab7cd2, scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2, user.id=4ab56873c9924436afdc333a98301e78) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:42.595131 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1307671-be51-4497-aab0-160561ddfced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:42.597067 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1307671-be51-4497-aab0-160561ddfced None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:42.606653 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 77/149] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:19:42 2022] GET /identity/v3/role_assignments?user.id=4ab56873c9924436afdc333a98301e78&scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:42.607932 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef8d97-6004-402a-9a12-8b4d24f5a18d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:42.608248 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef8d97-6004-402a-9a12-8b4d24f5a18d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:42.608525 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef8d97-6004-402a-9a12-8b4d24f5a18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:42.630093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0fef8d97-6004-402a-9a12-8b4d24f5a18d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:42.631783 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0fef8d97-6004-402a-9a12-8b4d24f5a18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:42.641432 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:42.710457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 78/150] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:42.712419 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869e5c9-c6df-48be-8466-54794fc3488a None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:42.712928 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869e5c9-c6df-48be-8466-54794fc3488a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:42.713403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869e5c9-c6df-48be-8466-54794fc3488a None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:42.715211 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 79/151] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:42.720408 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b290e43-b16c-47cf-96c4-e5b96a63a91b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:42.721403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5eb05-fa4f-46d2-a29c-c2e78236bc91 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:42.721897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5eb05-fa4f-46d2-a29c-c2e78236bc91 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:42.722364 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5eb05-fa4f-46d2-a29c-c2e78236bc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:42.740411 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-48e5eb05-fa4f-46d2-a29c-c2e78236bc91 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:42.741972 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-48e5eb05-fa4f-46d2-a29c-c2e78236bc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:42.764860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:42.785489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f74d8-e67f-4c21-9b56-1e6ba251b075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:42.786096 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f74d8-e67f-4c21-9b56-1e6ba251b075 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:42.786383 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f74d8-e67f-4c21-9b56-1e6ba251b075 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:42.786842 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f74d8-e67f-4c21-9b56-1e6ba251b075 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:42.787749 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f74d8-e67f-4c21-9b56-1e6ba251b075 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:42.789318 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f74d8-e67f-4c21-9b56-1e6ba251b075 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:42.816901 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 73/152] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 16:19:42 2022] POST /identity/v3/users => generated 283 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:19:42.818231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f74d8-e67f-4c21-9b56-1e6ba251b075 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:42.845674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 80/153] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:42.945518 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5eb05-fa4f-46d2-a29c-c2e78236bc91 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:42.976240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f74d8-e67f-4c21-9b56-1e6ba251b075 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:43.026770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:43.041753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97f038-336a-4beb-ab90-203723a6fac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:43.042521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97f038-336a-4beb-ab90-203723a6fac0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:43.043149 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97f038-336a-4beb-ab90-203723a6fac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:43.043376 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97f038-336a-4beb-ab90-203723a6fac0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:43.067056 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97f038-336a-4beb-ab90-203723a6fac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:43.083030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ac97f038-336a-4beb-ab90-203723a6fac0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:19:43.083030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:43.083030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:43.083030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:43.083030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:43.083030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:43.083030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:43.083030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:43.083030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:43.083030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:43.083030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:43.083030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:43.083030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:43.083030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:43.083030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:43.083030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:43.084057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:43.084057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:43.084057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:43.084057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:43.084057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:43.084057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:43.084057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:43.084057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:43.084057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:43.084057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:43.084057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:43.084057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:19:43.084057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:43.084057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:43.084057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:43.084057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:43.085051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:43.085051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:43.085051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:43.085051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:43.085051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:43.085051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:43.085051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:43.085051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:43.085051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:43.085051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:43.085051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:19:43.085051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:19:43.085051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 74/154] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:43.098502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97f038-336a-4beb-ab90-203723a6fac0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:43.139066 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5eb05-fa4f-46d2-a29c-c2e78236bc91 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:43.190431 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe603170-9b72-4909-ab71-fad428736618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:43.191631 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe603170-9b72-4909-ab71-fad428736618 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:43.192139 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe603170-9b72-4909-ab71-fad428736618 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:43.192634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe603170-9b72-4909-ab71-fad428736618 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:43.215798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe603170-9b72-4909-ab71-fad428736618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:43.226034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-fe603170-9b72-4909-ab71-fad428736618 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:19:43.226034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:43.226034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:43.226034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:43.226034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:43.226034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:43.226034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:43.226034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:43.226034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:43.226034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:43.226034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:43.226034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:43.226034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:43.226034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:43.226034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:43.226034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:43.226945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:43.226945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:43.226945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:43.226945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:43.226945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:43.226945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:43.226945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:43.226945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:43.226945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:43.226945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:43.226945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:43.226945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:19:43.226945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:43.226945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:43.226945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:43.226945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:43.227918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:43.227918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:43.227918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:43.227918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:43.227918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:43.227918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:43.227918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:43.227918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:43.227918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:43.227918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:43.227918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:19:43.227918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:19:43.230822 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 81/155] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:19:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:19:43.240754 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe603170-9b72-4909-ab71-fad428736618 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:43.260435 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97f038-336a-4beb-ab90-203723a6fac0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:43.302808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:43.306015 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ff4e0-2580-40de-8635-b74da0a9edbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:43.306875 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ff4e0-2580-40de-8635-b74da0a9edbc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:43.307158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ff4e0-2580-40de-8635-b74da0a9edbc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:43.307834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ff4e0-2580-40de-8635-b74da0a9edbc None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:43.308671 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ff4e0-2580-40de-8635-b74da0a9edbc None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:43.309023 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ff4e0-2580-40de-8635-b74da0a9edbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:43.310464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ff4e0-2580-40de-8635-b74da0a9edbc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:43.324761 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 75/156] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:19:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:43.333757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ff4e0-2580-40de-8635-b74da0a9edbc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:43.372320 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe603170-9b72-4909-ab71-fad428736618 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:43.396359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:43.419975 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8b5e7-c18a-4d9f-b313-7ec120bb8548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:43.421337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8b5e7-c18a-4d9f-b313-7ec120bb8548 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:43.421918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8b5e7-c18a-4d9f-b313-7ec120bb8548 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:43.422418 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8b5e7-c18a-4d9f-b313-7ec120bb8548 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:43.423559 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8b5e7-c18a-4d9f-b313-7ec120bb8548 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:43.424640 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8b5e7-c18a-4d9f-b313-7ec120bb8548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:43.426298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8b5e7-c18a-4d9f-b313-7ec120bb8548 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:43.438150 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 82/157] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:19:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:43.444143 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8b5e7-c18a-4d9f-b313-7ec120bb8548 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:43.476689 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ff4e0-2580-40de-8635-b74da0a9edbc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:43.518132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83675c7-c791-43f9-af92-544e5b31f96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:43.519509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83675c7-c791-43f9-af92-544e5b31f96f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:43.522383 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83675c7-c791-43f9-af92-544e5b31f96f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:43.523057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83675c7-c791-43f9-af92-544e5b31f96f None admin] PATH_INFO: `/v3/users/8ef914cb95d3407db3772d63d8a4e129` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:43.524787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83675c7-c791-43f9-af92-544e5b31f96f None admin] RBAC: Authorizing `identity:get_user(user_id=8ef914cb95d3407db3772d63d8a4e129)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:43.526515 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83675c7-c791-43f9-af92-544e5b31f96f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:43.528951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 76/158] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:43 2022] GET /identity/v3/users/8ef914cb95d3407db3772d63d8a4e129 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:43.536039 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83675c7-c791-43f9-af92-544e5b31f96f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:43.556712 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:43.583422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8b5e7-c18a-4d9f-b313-7ec120bb8548 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:43.622520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273556fd-ae3e-462c-a3ec-9c96b91dbe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:43.624135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273556fd-ae3e-462c-a3ec-9c96b91dbe2b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:43.624135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273556fd-ae3e-462c-a3ec-9c96b91dbe2b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:43.624135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273556fd-ae3e-462c-a3ec-9c96b91dbe2b None admin] PATH_INFO: `/v3/users/8ef914cb95d3407db3772d63d8a4e129` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:43.625265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273556fd-ae3e-462c-a3ec-9c96b91dbe2b None admin] RBAC: Authorizing `identity:get_user(user_id=8ef914cb95d3407db3772d63d8a4e129)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:43.626740 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273556fd-ae3e-462c-a3ec-9c96b91dbe2b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:43.629584 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 83/159] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:43 2022] GET /identity/v3/users/8ef914cb95d3407db3772d63d8a4e129 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:43.635483 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273556fd-ae3e-462c-a3ec-9c96b91dbe2b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:43.655838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83675c7-c791-43f9-af92-544e5b31f96f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:43.693805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:43.695611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1711f6e-ab04-4cf1-9b68-7bf1885cf461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:43.696481 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1711f6e-ab04-4cf1-9b68-7bf1885cf461 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:43.696909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1711f6e-ab04-4cf1-9b68-7bf1885cf461 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:43.697251 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1711f6e-ab04-4cf1-9b68-7bf1885cf461 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:43.756478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273556fd-ae3e-462c-a3ec-9c96b91dbe2b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:43.779369 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1711f6e-ab04-4cf1-9b68-7bf1885cf461 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:43.781212 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1711f6e-ab04-4cf1-9b68-7bf1885cf461 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:43.792997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a13194-29fd-4f0a-86b6-ca33331be306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:43.793707 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a13194-29fd-4f0a-86b6-ca33331be306 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:43.794036 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a13194-29fd-4f0a-86b6-ca33331be306 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:43.794307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a13194-29fd-4f0a-86b6-ca33331be306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:43.813771 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:43.869900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a13194-29fd-4f0a-86b6-ca33331be306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:43.871547 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a13194-29fd-4f0a-86b6-ca33331be306 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:43.894572 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 77/160] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:19:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:19:43.900551 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1711f6e-ab04-4cf1-9b68-7bf1885cf461 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:43.936399 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:44.016065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1711f6e-ab04-4cf1-9b68-7bf1885cf461 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:44.029486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 84/161] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:19:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 16:19:44.035012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a13194-29fd-4f0a-86b6-ca33331be306 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:44.054470 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0e57a-1d2a-4477-ac29-d9e3d8af9e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:44.055487 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0e57a-1d2a-4477-ac29-d9e3d8af9e71 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:44.055930 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0e57a-1d2a-4477-ac29-d9e3d8af9e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:44.056305 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0e57a-1d2a-4477-ac29-d9e3d8af9e71 None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:44.057599 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0e57a-1d2a-4477-ac29-d9e3d8af9e71 None admin] RBAC: Authorizing `identity:get_project(project_id=f82f5c51617d45fc90355caaf5b8a8b2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:44.059373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0e57a-1d2a-4477-ac29-d9e3d8af9e71 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:44.061203 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 78/162] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:43 2022] GET /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:44.067288 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0e57a-1d2a-4477-ac29-d9e3d8af9e71 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:44.104346 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:44.168320 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:44.192846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0e57a-1d2a-4477-ac29-d9e3d8af9e71 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:44.225429 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a13194-29fd-4f0a-86b6-ca33331be306 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:44.247182 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32791161-53e6-4373-b759-ab10e5df14b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:44.248679 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32791161-53e6-4373-b759-ab10e5df14b3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:44.250824 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32791161-53e6-4373-b759-ab10e5df14b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:44.251413 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32791161-53e6-4373-b759-ab10e5df14b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:44.252466 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32791161-53e6-4373-b759-ab10e5df14b3 None admin] RBAC: Adding query filter params (role.id=91889a59745c4d8185400f69d84eb50e, scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2, user.id=8ef914cb95d3407db3772d63d8a4e129) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:44.253128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32791161-53e6-4373-b759-ab10e5df14b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:44.255139 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32791161-53e6-4373-b759-ab10e5df14b3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:44.267601 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 79/163] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:19:44 2022] GET /identity/v3/role_assignments?user.id=8ef914cb95d3407db3772d63d8a4e129&scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2&role.id=91889a59745c4d8185400f69d84eb50e => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:44.269229 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230db01e-01df-446b-ab13-2fc187bbeea6 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:44.269689 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230db01e-01df-446b-ab13-2fc187bbeea6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:44.270132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230db01e-01df-446b-ab13-2fc187bbeea6 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:44.271807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9096d65-2649-4cf5-beeb-2dda3884bfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:44.272603 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 80/164] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:44.272710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9096d65-2649-4cf5-beeb-2dda3884bfc0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:44.273097 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9096d65-2649-4cf5-beeb-2dda3884bfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:44.273432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9096d65-2649-4cf5-beeb-2dda3884bfc0 None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:44.274551 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a266606-148b-4a55-a3a5-be730bb5a4a0 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:44.274861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9096d65-2649-4cf5-beeb-2dda3884bfc0 None admin] RBAC: Authorizing `identity:get_project(project_id=f82f5c51617d45fc90355caaf5b8a8b2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:44.275191 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a266606-148b-4a55-a3a5-be730bb5a4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:44.275632 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a266606-148b-4a55-a3a5-be730bb5a4a0 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:44.280034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9096d65-2649-4cf5-beeb-2dda3884bfc0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:44.280034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 85/165] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:44 2022] GET /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:44.281850 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 81/166] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:44.284778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ff09f-b471-4e53-a217-a0a0a00b4014 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:44.285069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ff09f-b471-4e53-a217-a0a0a00b4014 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:44.285416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ff09f-b471-4e53-a217-a0a0a00b4014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:44.287753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a266606-148b-4a55-a3a5-be730bb5a4a0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:44.307676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0b1ff09f-b471-4e53-a217-a0a0a00b4014 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:44.309043 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0b1ff09f-b471-4e53-a217-a0a0a00b4014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:44.409995 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 86/167] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:44.411362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0042a60-2432-4d2e-964a-08220df7ef7a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:44.411912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0042a60-2432-4d2e-964a-08220df7ef7a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:44.412524 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0042a60-2432-4d2e-964a-08220df7ef7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:44.433040 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a0042a60-2432-4d2e-964a-08220df7ef7a None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:44.434219 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a0042a60-2432-4d2e-964a-08220df7ef7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:44.454864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a266606-148b-4a55-a3a5-be730bb5a4a0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:44.547610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5c65d-7fa6-4a4e-94fa-88e0f103129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:44.548411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5c65d-7fa6-4a4e-94fa-88e0f103129d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:44.548694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5c65d-7fa6-4a4e-94fa-88e0f103129d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:44.548966 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5c65d-7fa6-4a4e-94fa-88e0f103129d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:44.549861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:44.550707 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5c65d-7fa6-4a4e-94fa-88e0f103129d None admin] RBAC: Adding query filter params (role.id=60519d06a8c94e6c82462e5d79d9856b, scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2, user.id=8ef914cb95d3407db3772d63d8a4e129) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:44.553046 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5c65d-7fa6-4a4e-94fa-88e0f103129d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:44.554401 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5c65d-7fa6-4a4e-94fa-88e0f103129d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:44.570381 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 82/168] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:19:44 2022] GET /identity/v3/role_assignments?user.id=8ef914cb95d3407db3772d63d8a4e129&scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2&role.id=60519d06a8c94e6c82462e5d79d9856b => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:44.573481 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5c65d-7fa6-4a4e-94fa-88e0f103129d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:44.608320 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:44.622785 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 87/169] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:44.697416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0042a60-2432-4d2e-964a-08220df7ef7a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:44.779112 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5c65d-7fa6-4a4e-94fa-88e0f103129d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:44.869905 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00aa50b-ed83-4c97-9ab0-593cdec995f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:44.870735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00aa50b-ed83-4c97-9ab0-593cdec995f4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:44.871017 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00aa50b-ed83-4c97-9ab0-593cdec995f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:44.871291 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00aa50b-ed83-4c97-9ab0-593cdec995f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:44.901048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00aa50b-ed83-4c97-9ab0-593cdec995f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:44.902959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0042a60-2432-4d2e-964a-08220df7ef7a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:44.909184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d00aa50b-ed83-4c97-9ab0-593cdec995f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:19:44.909184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:44.909184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:44.909184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:44.909184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:44.909184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:44.909184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:44.909184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:44.909184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:44.909184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:44.909184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:44.909184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:44.909184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:44.909184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:44.909184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:44.909184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:44.910109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:44.910109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:44.910109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:44.910109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:44.910109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:44.910109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:44.910109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:44.910109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:44.910109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:44.910109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:44.910109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:44.910109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:19:44.910109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:44.910109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:44.910109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:44.910109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:44.910918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:44.910918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:44.910918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:44.910918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:44.910918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:44.910918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:44.910918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:44.910918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:44.910918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:44.910918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:44.910918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:19:44.910918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:19:44.910918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 83/170] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:44.921445 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00aa50b-ed83-4c97-9ab0-593cdec995f4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:44.966734 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c62ad5-ee7d-44b2-aa99-8b0f1b5e18b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:44.968697 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c62ad5-ee7d-44b2-aa99-8b0f1b5e18b8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:44.968981 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c62ad5-ee7d-44b2-aa99-8b0f1b5e18b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:44.969251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c62ad5-ee7d-44b2-aa99-8b0f1b5e18b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:44.996034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c62ad5-ee7d-44b2-aa99-8b0f1b5e18b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:45.007543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-63c62ad5-ee7d-44b2-aa99-8b0f1b5e18b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:19:45.007543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:45.007543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:45.007543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:45.007543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:45.007543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:45.007543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:45.007543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:45.007543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:45.007543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:45.007543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:45.007543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:45.007543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:45.007543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:45.007543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:45.007543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:45.008632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:45.008632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:45.008632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:45.008632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:45.008632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:45.008632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:45.008632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:45.008632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:45.008632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:45.008632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:45.008632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:45.008632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:19:45.008632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:45.008632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:45.008632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:45.008632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:45.009440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:45.009440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:45.009440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:45.009440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:45.009440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:45.009440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:45.009440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:45.009440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:45.009440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:45.009440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:45.009440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:19:45.009440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:19:45.018607 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 88/171] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:19:45.029424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c62ad5-ee7d-44b2-aa99-8b0f1b5e18b8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:45.082418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:45.091718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:45.110179 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00aa50b-ed83-4c97-9ab0-593cdec995f4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:45.148695 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649d12e-6c99-4f8d-b004-810130c8204e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:45.149376 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649d12e-6c99-4f8d-b004-810130c8204e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:45.149656 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649d12e-6c99-4f8d-b004-810130c8204e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:45.149928 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649d12e-6c99-4f8d-b004-810130c8204e None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:45.150696 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649d12e-6c99-4f8d-b004-810130c8204e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:45.150974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649d12e-6c99-4f8d-b004-810130c8204e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:45.152405 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649d12e-6c99-4f8d-b004-810130c8204e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:45.167863 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 84/172] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:19:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:45.174981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649d12e-6c99-4f8d-b004-810130c8204e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:45.192467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c62ad5-ee7d-44b2-aa99-8b0f1b5e18b8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:45.242365 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0708c5-05bb-4668-9938-cd4c3df2212a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:45.243419 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0708c5-05bb-4668-9938-cd4c3df2212a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:45.243919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0708c5-05bb-4668-9938-cd4c3df2212a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:45.244412 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0708c5-05bb-4668-9938-cd4c3df2212a None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:45.245373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0708c5-05bb-4668-9938-cd4c3df2212a None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:45.245875 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0708c5-05bb-4668-9938-cd4c3df2212a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:45.247492 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0708c5-05bb-4668-9938-cd4c3df2212a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:45.256935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 89/173] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:19:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:45.275679 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0708c5-05bb-4668-9938-cd4c3df2212a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:45.301882 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649d12e-6c99-4f8d-b004-810130c8204e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:45.338156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:45.343473 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79af7b-9a28-4082-b8fb-b90dd58f234c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:45.344723 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79af7b-9a28-4082-b8fb-b90dd58f234c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:45.345207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79af7b-9a28-4082-b8fb-b90dd58f234c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:45.345665 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79af7b-9a28-4082-b8fb-b90dd58f234c None admin] PATH_INFO: `/v3/users/906dbeb68d7c48f3bbe09217c0f9bee6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:45.347103 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79af7b-9a28-4082-b8fb-b90dd58f234c None admin] RBAC: Authorizing `identity:get_user(user_id=906dbeb68d7c48f3bbe09217c0f9bee6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:45.348890 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79af7b-9a28-4082-b8fb-b90dd58f234c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:45.350797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 85/174] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:45 2022] GET /identity/v3/users/906dbeb68d7c48f3bbe09217c0f9bee6 => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:45.357127 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79af7b-9a28-4082-b8fb-b90dd58f234c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:45.474457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:45.488042 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0708c5-05bb-4668-9938-cd4c3df2212a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:45.523292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1e79f-de3f-47df-9bf9-e9a8305c18a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:45.524117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1e79f-de3f-47df-9bf9-e9a8305c18a8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:45.524397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1e79f-de3f-47df-9bf9-e9a8305c18a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:45.524669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1e79f-de3f-47df-9bf9-e9a8305c18a8 None admin] PATH_INFO: `/v3/users/8ef914cb95d3407db3772d63d8a4e129` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:45.525077 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79af7b-9a28-4082-b8fb-b90dd58f234c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:45.525947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1e79f-de3f-47df-9bf9-e9a8305c18a8 None admin] RBAC: Authorizing `identity:get_user(user_id=8ef914cb95d3407db3772d63d8a4e129)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:45.527456 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1e79f-de3f-47df-9bf9-e9a8305c18a8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:45.529177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 90/175] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:45 2022] GET /identity/v3/users/8ef914cb95d3407db3772d63d8a4e129 => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:45.535134 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1e79f-de3f-47df-9bf9-e9a8305c18a8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:45.563699 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8b157-929e-406d-a8e2-07de77bb743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:45.564805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8b157-929e-406d-a8e2-07de77bb743d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:45.565100 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8b157-929e-406d-a8e2-07de77bb743d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:45.565374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8b157-929e-406d-a8e2-07de77bb743d None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:45.566575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8b157-929e-406d-a8e2-07de77bb743d None admin] RBAC: Authorizing `identity:get_project(project_id=f82f5c51617d45fc90355caaf5b8a8b2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:45.568356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f8b157-929e-406d-a8e2-07de77bb743d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:45.570403 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 86/176] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:45 2022] GET /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:45.577027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8b157-929e-406d-a8e2-07de77bb743d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:45.638151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1e79f-de3f-47df-9bf9-e9a8305c18a8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:45.671899 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd6519-2d4d-4508-b1e6-0dccf8aa4658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:45.672629 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd6519-2d4d-4508-b1e6-0dccf8aa4658 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:45.672909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd6519-2d4d-4508-b1e6-0dccf8aa4658 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:45.673182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd6519-2d4d-4508-b1e6-0dccf8aa4658 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:45.705407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:45.748047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd6519-2d4d-4508-b1e6-0dccf8aa4658 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:45.750062 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd6519-2d4d-4508-b1e6-0dccf8aa4658 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:45.785903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:45.859124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 91/177] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:19:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 16:19:45.866370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd6519-2d4d-4508-b1e6-0dccf8aa4658 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:45.898271 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8b157-929e-406d-a8e2-07de77bb743d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:45.956402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:45.978179 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3c208-f0f9-4bb7-baea-9d1e485765b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:45.979462 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3c208-f0f9-4bb7-baea-9d1e485765b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:45.979936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3c208-f0f9-4bb7-baea-9d1e485765b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:45.980459 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3c208-f0f9-4bb7-baea-9d1e485765b4 None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2/users/906dbeb68d7c48f3bbe09217c0f9bee6/roles/63f594b5fbbe4eb7b69119f8afda416f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:45.982623 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3c208-f0f9-4bb7-baea-9d1e485765b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f82f5c51617d45fc90355caaf5b8a8b2, user_id=906dbeb68d7c48f3bbe09217c0f9bee6, role_id=63f594b5fbbe4eb7b69119f8afda416f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:45.984311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3c208-f0f9-4bb7-baea-9d1e485765b4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:45.996038 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd6519-2d4d-4508-b1e6-0dccf8aa4658 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:46.007189 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 87/178] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:19:45 2022] PUT /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2/users/906dbeb68d7c48f3bbe09217c0f9bee6/roles/63f594b5fbbe4eb7b69119f8afda416f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:19:46.026838 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccac07-8ff1-40b8-8dff-16a67fb1d3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:46.027743 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccac07-8ff1-40b8-8dff-16a67fb1d3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:46.028065 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccac07-8ff1-40b8-8dff-16a67fb1d3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:46.028351 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccac07-8ff1-40b8-8dff-16a67fb1d3f5 None admin] PATH_INFO: `/v3/projects/be5498375a504138aca6cc376d3b4634` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:46.029631 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccac07-8ff1-40b8-8dff-16a67fb1d3f5 None admin] RBAC: Authorizing `identity:get_project(project_id=be5498375a504138aca6cc376d3b4634)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:46.031138 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccac07-8ff1-40b8-8dff-16a67fb1d3f5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:46.032936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 92/179] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:45 2022] GET /identity/v3/projects/be5498375a504138aca6cc376d3b4634 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:46.039149 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3c208-f0f9-4bb7-baea-9d1e485765b4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:46.174502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3c208-f0f9-4bb7-baea-9d1e485765b4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:46.208154 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:46.218571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da65cbb-fe90-4d15-802c-63e6dbb3ffc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:46.219345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da65cbb-fe90-4d15-802c-63e6dbb3ffc1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:46.219638 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da65cbb-fe90-4d15-802c-63e6dbb3ffc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:46.219912 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da65cbb-fe90-4d15-802c-63e6dbb3ffc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:46.220866 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da65cbb-fe90-4d15-802c-63e6dbb3ffc1 None admin] RBAC: Adding query filter params (role.id=91889a59745c4d8185400f69d84eb50e, scope.project.id=be5498375a504138aca6cc376d3b4634, user.id=8ef914cb95d3407db3772d63d8a4e129) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:46.221222 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da65cbb-fe90-4d15-802c-63e6dbb3ffc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:46.222935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da65cbb-fe90-4d15-802c-63e6dbb3ffc1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:46.230824 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 88/180] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:19:46 2022] GET /identity/v3/role_assignments?user.id=8ef914cb95d3407db3772d63d8a4e129&scope.project.id=be5498375a504138aca6cc376d3b4634&role.id=91889a59745c4d8185400f69d84eb50e => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:46.587799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb9ba2-a014-4ee2-81a2-4906f151e179 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:46.588335 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb9ba2-a014-4ee2-81a2-4906f151e179 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:46.588335 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb9ba2-a014-4ee2-81a2-4906f151e179 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:46.590142 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 93/181] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:46.596344 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d204c7-bb40-48ed-b824-5a138cdefade None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:46.596655 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d204c7-bb40-48ed-b824-5a138cdefade None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:46.596902 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d204c7-bb40-48ed-b824-5a138cdefade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:46.616791 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f7d204c7-bb40-48ed-b824-5a138cdefade None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:46.617977 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f7d204c7-bb40-48ed-b824-5a138cdefade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:46.690431 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 89/182] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:46.715497 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb9ba2-a014-4ee2-81a2-4906f151e179 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:46.785098 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bf998-ed0c-4086-81b3-b1c3affc854c None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:46.785733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bf998-ed0c-4086-81b3-b1c3affc854c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:46.786234 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bf998-ed0c-4086-81b3-b1c3affc854c None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:46.789140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 90/183] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:46.796546 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33a98a-aa42-4d95-8be3-9a10374eef0e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:46.797481 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33a98a-aa42-4d95-8be3-9a10374eef0e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:46.798222 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33a98a-aa42-4d95-8be3-9a10374eef0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:46.821348 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8c33a98a-aa42-4d95-8be3-9a10374eef0e None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:46.823932 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8c33a98a-aa42-4d95-8be3-9a10374eef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:46.841271 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb9ba2-a014-4ee2-81a2-4906f151e179 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:46.891019 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:46.898819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c891a5-951f-4bc2-997c-4377099f4843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:46.899951 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c891a5-951f-4bc2-997c-4377099f4843 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:46.900975 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c891a5-951f-4bc2-997c-4377099f4843 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:46.901460 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c891a5-951f-4bc2-997c-4377099f4843 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:46.916072 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 91/184] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:19:46.920990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c891a5-951f-4bc2-997c-4377099f4843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:46.930298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-34c891a5-951f-4bc2-997c-4377099f4843 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:19:46.930298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:46.930298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:46.930298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:46.930298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:46.930298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:46.930298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:46.930298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:46.930298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:46.930298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:46.930298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:46.930298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:46.930298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:46.930298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:46.930298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:46.930298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:46.931646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:46.931646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:46.931646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:46.931646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:46.931646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:46.931646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:46.931646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:46.931646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:46.931646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:46.931646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:46.931646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:46.931646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:19:46.931646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:46.931646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:46.931646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:46.931646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:46.932735 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:46.932735 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:46.932735 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:46.932735 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:46.932735 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:46.932735 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:46.932735 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:46.932735 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:46.932735 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:46.932735 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:46.932735 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:19:46.932735 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:19:46.935176 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 94/185] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:19:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:46.941167 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33a98a-aa42-4d95-8be3-9a10374eef0e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:46.945040 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c891a5-951f-4bc2-997c-4377099f4843 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:47.003522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:47.055317 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c891a5-951f-4bc2-997c-4377099f4843 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:47.055521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33a98a-aa42-4d95-8be3-9a10374eef0e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:47.092467 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb67d0-cd29-4f40-9f1c-b3f3bd933951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:47.092782 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf2b29-e7bb-48aa-b82e-472049fd5951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:47.093062 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb67d0-cd29-4f40-9f1c-b3f3bd933951 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:47.093344 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb67d0-cd29-4f40-9f1c-b3f3bd933951 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:47.093534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf2b29-e7bb-48aa-b82e-472049fd5951 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:47.093625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb67d0-cd29-4f40-9f1c-b3f3bd933951 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:47.093782 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf2b29-e7bb-48aa-b82e-472049fd5951 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:47.094061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf2b29-e7bb-48aa-b82e-472049fd5951 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:47.094361 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb67d0-cd29-4f40-9f1c-b3f3bd933951 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:47.094663 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb67d0-cd29-4f40-9f1c-b3f3bd933951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:47.096292 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb67d0-cd29-4f40-9f1c-b3f3bd933951 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:47.105099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf2b29-e7bb-48aa-b82e-472049fd5951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:47.106209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 92/186] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:47.107521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db82643-9801-4297-8988-c46349e63f95 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:47.107867 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db82643-9801-4297-8988-c46349e63f95 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:47.108184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db82643-9801-4297-8988-c46349e63f95 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:47.109490 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 93/187] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:47.112915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db82643-9801-4297-8988-c46349e63f95 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:47.115606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-b8cf2b29-e7bb-48aa-b82e-472049fd5951 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:19:47.115606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:47.115606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:47.115606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:47.115606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:47.115606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:47.115606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:47.115606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:47.115606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:47.115606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:47.115606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:47.115606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:47.115606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:47.115606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:47.115606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:47.115606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:47.116568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:47.116568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:47.116568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:47.116568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:47.116568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:47.116568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:47.116568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:47.116568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:47.116568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:47.116568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:47.116568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:47.116568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:19:47.116568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:47.116568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:47.116568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:47.116568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:47.117382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:47.117382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:47.117382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:47.117382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:47.117382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:47.117382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:47.117382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:47.117382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:47.117382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:47.117382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:47.117382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:19:47.117382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:19:47.117382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 95/188] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:19:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:47.119668 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb8c5e-820c-45ca-b302-6ced8cf6f3ab None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:47.119957 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb8c5e-820c-45ca-b302-6ced8cf6f3ab None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:47.120256 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb8c5e-820c-45ca-b302-6ced8cf6f3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:47.139955 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-27eb8c5e-820c-45ca-b302-6ced8cf6f3ab None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:47.141185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-27eb8c5e-820c-45ca-b302-6ced8cf6f3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:47.192799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:47.217399 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 96/189] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:47.218246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb8c5e-820c-45ca-b302-6ced8cf6f3ab None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:47.251461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db82643-9801-4297-8988-c46349e63f95 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:47.266287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:47.294761 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95b5e5-c62c-41ec-a6fa-abf9dc3e4edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:47.296112 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95b5e5-c62c-41ec-a6fa-abf9dc3e4edf None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:47.296418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95b5e5-c62c-41ec-a6fa-abf9dc3e4edf None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:47.296693 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95b5e5-c62c-41ec-a6fa-abf9dc3e4edf None admin] PATH_INFO: `/v3/users/d1c12330f74c43b5855d0cbad814ddf1` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:47.311738 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95b5e5-c62c-41ec-a6fa-abf9dc3e4edf None admin] RBAC: Authorizing `identity:get_user(user_id=d1c12330f74c43b5855d0cbad814ddf1)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:47.313277 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95b5e5-c62c-41ec-a6fa-abf9dc3e4edf None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:47.314988 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 94/190] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:47 2022] GET /identity/v3/users/d1c12330f74c43b5855d0cbad814ddf1 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:47.315757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95b5e5-c62c-41ec-a6fa-abf9dc3e4edf None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:47.348893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb8c5e-820c-45ca-b302-6ced8cf6f3ab None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:47.383568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8f252-ef05-4c4c-8d06-6dfba928c481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:47.384279 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8f252-ef05-4c4c-8d06-6dfba928c481 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:47.384560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8f252-ef05-4c4c-8d06-6dfba928c481 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:47.384833 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8f252-ef05-4c4c-8d06-6dfba928c481 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:47.385587 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8f252-ef05-4c4c-8d06-6dfba928c481 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:47.385886 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8f252-ef05-4c4c-8d06-6dfba928c481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:47.387290 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8f252-ef05-4c4c-8d06-6dfba928c481 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:47.396054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 97/191] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:19:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:47.396714 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8f252-ef05-4c4c-8d06-6dfba928c481 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:47.430794 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95b5e5-c62c-41ec-a6fa-abf9dc3e4edf None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:47.445376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:47.473227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50777f05-4eec-4b0f-a8a4-650f3c01183d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:47.474631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50777f05-4eec-4b0f-a8a4-650f3c01183d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:47.474631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50777f05-4eec-4b0f-a8a4-650f3c01183d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:47.474631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50777f05-4eec-4b0f-a8a4-650f3c01183d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:47.475843 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50777f05-4eec-4b0f-a8a4-650f3c01183d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:47.477400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50777f05-4eec-4b0f-a8a4-650f3c01183d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:47.479505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 95/192] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:19:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:47.480652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50777f05-4eec-4b0f-a8a4-650f3c01183d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:47.504188 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8f252-ef05-4c4c-8d06-6dfba928c481 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:47.533453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:47.543469 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbffcd0-8640-4844-8b91-dfcfa756a643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:47.544256 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbffcd0-8640-4844-8b91-dfcfa756a643 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:47.544649 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbffcd0-8640-4844-8b91-dfcfa756a643 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:47.544924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbffcd0-8640-4844-8b91-dfcfa756a643 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:47.603261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50777f05-4eec-4b0f-a8a4-650f3c01183d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:47.620356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbffcd0-8640-4844-8b91-dfcfa756a643 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:47.621946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbffcd0-8640-4844-8b91-dfcfa756a643 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:47.640917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bd409-6b47-48ec-b5e0-78d282402c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:47.642071 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bd409-6b47-48ec-b5e0-78d282402c89 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:47.642556 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bd409-6b47-48ec-b5e0-78d282402c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:47.643013 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bd409-6b47-48ec-b5e0-78d282402c89 None admin] PATH_INFO: `/v3/users/d1c12330f74c43b5855d0cbad814ddf1` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:47.644781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bd409-6b47-48ec-b5e0-78d282402c89 None admin] RBAC: Authorizing `identity:get_user(user_id=d1c12330f74c43b5855d0cbad814ddf1)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:47.646535 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bd409-6b47-48ec-b5e0-78d282402c89 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:47.648218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 96/193] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:47 2022] GET /identity/v3/users/d1c12330f74c43b5855d0cbad814ddf1 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:47.648954 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bd409-6b47-48ec-b5e0-78d282402c89 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:47.672520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:47.732298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 98/194] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:19:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:19:47.738003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbffcd0-8640-4844-8b91-dfcfa756a643 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:47.753182 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bd409-6b47-48ec-b5e0-78d282402c89 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:47.763241 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:47.791617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe8edc-fbb5-4083-852f-82aadb2dc64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:47.792320 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe8edc-fbb5-4083-852f-82aadb2dc64a None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:47.792605 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe8edc-fbb5-4083-852f-82aadb2dc64a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:47.792879 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe8edc-fbb5-4083-852f-82aadb2dc64a None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:47.794009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe8edc-fbb5-4083-852f-82aadb2dc64a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:47.795817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe8edc-fbb5-4083-852f-82aadb2dc64a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:47.821185 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 97/195] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 16:19:47 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:19:47.822026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe8edc-fbb5-4083-852f-82aadb2dc64a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:47.874315 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbffcd0-8640-4844-8b91-dfcfa756a643 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:47.923762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a1957-ba0b-482a-9f05-b5e7af66ad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:47.925454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a1957-ba0b-482a-9f05-b5e7af66ad17 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:47.925916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a1957-ba0b-482a-9f05-b5e7af66ad17 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:47.927032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a1957-ba0b-482a-9f05-b5e7af66ad17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:47.949782 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:47.960214 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe8edc-fbb5-4083-852f-82aadb2dc64a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:48.000946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc644ce6-abdd-484a-8eee-6286eb114163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:48.002255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc644ce6-abdd-484a-8eee-6286eb114163 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:48.002774 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc644ce6-abdd-484a-8eee-6286eb114163 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:48.003179 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc644ce6-abdd-484a-8eee-6286eb114163 None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:48.004614 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc644ce6-abdd-484a-8eee-6286eb114163 None admin] RBAC: Authorizing `identity:get_project(project_id=b99cf27cf22249fdb99befb43f95a1d6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:48.006389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc644ce6-abdd-484a-8eee-6286eb114163 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:48.008487 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 98/196] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:47 2022] GET /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:48.014944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc644ce6-abdd-484a-8eee-6286eb114163 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:48.027733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a1957-ba0b-482a-9f05-b5e7af66ad17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:48.030168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a1957-ba0b-482a-9f05-b5e7af66ad17 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:48.051521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:48.149378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc644ce6-abdd-484a-8eee-6286eb114163 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:48.164411 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 99/197] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:19:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:19:48.169947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a1957-ba0b-482a-9f05-b5e7af66ad17 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:48.197778 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8af1d-ed24-44b2-9c2c-96ab06eb8c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:48.198450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8af1d-ed24-44b2-9c2c-96ab06eb8c1c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:48.198731 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8af1d-ed24-44b2-9c2c-96ab06eb8c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:48.199004 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8af1d-ed24-44b2-9c2c-96ab06eb8c1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:48.199834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8af1d-ed24-44b2-9c2c-96ab06eb8c1c None admin] RBAC: Adding query filter params (role.id=e1e39192d3af465aa504728e32ab7cd2, scope.project.id=b99cf27cf22249fdb99befb43f95a1d6, user.id=d1c12330f74c43b5855d0cbad814ddf1) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:48.200271 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8af1d-ed24-44b2-9c2c-96ab06eb8c1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:48.201855 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8af1d-ed24-44b2-9c2c-96ab06eb8c1c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:48.210319 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 99/198] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:19:48 2022] GET /identity/v3/role_assignments?user.id=d1c12330f74c43b5855d0cbad814ddf1&scope.project.id=b99cf27cf22249fdb99befb43f95a1d6&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:48.233543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:48.303725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a1957-ba0b-482a-9f05-b5e7af66ad17 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:48.343104 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75800375-a77f-44ab-9a85-3a991622f188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:48.344020 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75800375-a77f-44ab-9a85-3a991622f188 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:48.344306 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75800375-a77f-44ab-9a85-3a991622f188 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:48.344581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75800375-a77f-44ab-9a85-3a991622f188 None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:48.345848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75800375-a77f-44ab-9a85-3a991622f188 None admin] RBAC: Authorizing `identity:get_project(project_id=b99cf27cf22249fdb99befb43f95a1d6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:48.347438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75800375-a77f-44ab-9a85-3a991622f188 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:48.349370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 100/199] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:48 2022] GET /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:48.355622 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8af1d-ed24-44b2-9c2c-96ab06eb8c1c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:48.468805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:48.475253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8af1d-ed24-44b2-9c2c-96ab06eb8c1c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:48.510754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d353c9-c39a-472f-adf9-b6e4e7cc3a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:48.511418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d353c9-c39a-472f-adf9-b6e4e7cc3a31 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:48.511700 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d353c9-c39a-472f-adf9-b6e4e7cc3a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:48.511973 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d353c9-c39a-472f-adf9-b6e4e7cc3a31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:48.512831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d353c9-c39a-472f-adf9-b6e4e7cc3a31 None admin] RBAC: Adding query filter params (role.id=60519d06a8c94e6c82462e5d79d9856b, scope.project.id=b99cf27cf22249fdb99befb43f95a1d6, user.id=d1c12330f74c43b5855d0cbad814ddf1) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:48.513142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d353c9-c39a-472f-adf9-b6e4e7cc3a31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:48.514617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d353c9-c39a-472f-adf9-b6e4e7cc3a31 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:48.520860 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 100/200] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:19:48 2022] GET /identity/v3/role_assignments?user.id=d1c12330f74c43b5855d0cbad814ddf1&scope.project.id=b99cf27cf22249fdb99befb43f95a1d6&role.id=60519d06a8c94e6c82462e5d79d9856b => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:48.604043 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9f3c5-9a83-4a29-b98d-326c97995a61 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:48.604339 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9f3c5-9a83-4a29-b98d-326c97995a61 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:48.604620 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9f3c5-9a83-4a29-b98d-326c97995a61 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:48.606285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 101/201] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:48.612260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4f54d-d1b1-43f8-b846-c4ec06748e9f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:48.612552 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4f54d-d1b1-43f8-b846-c4ec06748e9f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:48.612823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4f54d-d1b1-43f8-b846-c4ec06748e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:48.635800 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7ea4f54d-d1b1-43f8-b846-c4ec06748e9f None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:48.637047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7ea4f54d-d1b1-43f8-b846-c4ec06748e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:48.723544 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 101/202] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:48.755380 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9f3c5-9a83-4a29-b98d-326c97995a61 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:48.898158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9f3c5-9a83-4a29-b98d-326c97995a61 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:48.920280 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:48.952222 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0e144-eb43-477b-9f7f-57d1005dcb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:48.953043 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0e144-eb43-477b-9f7f-57d1005dcb4e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:48.953324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0e144-eb43-477b-9f7f-57d1005dcb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:48.953592 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0e144-eb43-477b-9f7f-57d1005dcb4e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:48.976235 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0e144-eb43-477b-9f7f-57d1005dcb4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:48.983973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-dab0e144-eb43-477b-9f7f-57d1005dcb4e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:19:48.983973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:48.983973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:48.983973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:48.983973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:48.983973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:48.983973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:48.983973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:48.983973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:48.983973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:48.983973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:48.983973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:48.983973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:48.983973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:48.983973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:48.983973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:48.984921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:48.984921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:48.984921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:48.984921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:48.984921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:48.984921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:48.984921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:48.984921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:48.984921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:48.984921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:48.984921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:48.984921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:19:48.984921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:48.984921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:48.984921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:48.984921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:48.985748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:48.985748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:48.985748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:48.985748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:48.985748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:48.985748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:48.985748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:48.985748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:48.985748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:48.985748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:48.985748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:19:48.985748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:19:48.985748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 102/203] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:48.993472 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4f54d-d1b1-43f8-b846-c4ec06748e9f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:49.136072 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:49.153065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4f54d-d1b1-43f8-b846-c4ec06748e9f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:49.203132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef005b-399b-49e6-866d-572367e9d9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:49.203828 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef005b-399b-49e6-866d-572367e9d9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:49.204137 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef005b-399b-49e6-866d-572367e9d9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:49.204451 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef005b-399b-49e6-866d-572367e9d9e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:49.205216 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef005b-399b-49e6-866d-572367e9d9e8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:49.205860 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef005b-399b-49e6-866d-572367e9d9e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:49.207305 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef005b-399b-49e6-866d-572367e9d9e8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:49.216502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 102/204] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:19:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:49.225267 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0e144-eb43-477b-9f7f-57d1005dcb4e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:49.373744 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0e144-eb43-477b-9f7f-57d1005dcb4e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:49.419467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba8caf-50f0-4492-bbfa-0f68d8722039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:49.420391 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba8caf-50f0-4492-bbfa-0f68d8722039 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:49.420678 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba8caf-50f0-4492-bbfa-0f68d8722039 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:49.420952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba8caf-50f0-4492-bbfa-0f68d8722039 None admin] PATH_INFO: `/v3/users/906dbeb68d7c48f3bbe09217c0f9bee6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:49.422193 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba8caf-50f0-4492-bbfa-0f68d8722039 None admin] RBAC: Authorizing `identity:get_user(user_id=906dbeb68d7c48f3bbe09217c0f9bee6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:49.423664 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba8caf-50f0-4492-bbfa-0f68d8722039 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:49.425358 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 103/205] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:49 2022] GET /identity/v3/users/906dbeb68d7c48f3bbe09217c0f9bee6 => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:49.431121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef005b-399b-49e6-866d-572367e9d9e8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:49.585516 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef005b-399b-49e6-866d-572367e9d9e8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:49.626290 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa8135-1517-42dd-b8f5-988f7fcd7b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:49.626946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa8135-1517-42dd-b8f5-988f7fcd7b72 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:49.627222 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa8135-1517-42dd-b8f5-988f7fcd7b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:49.627494 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa8135-1517-42dd-b8f5-988f7fcd7b72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:49.665175 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:49.717520 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa8135-1517-42dd-b8f5-988f7fcd7b72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:49.719006 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa8135-1517-42dd-b8f5-988f7fcd7b72 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:49.840400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 103/206] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:19:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:19:49.845909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba8caf-50f0-4492-bbfa-0f68d8722039 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:49.903057 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:49.974212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba8caf-50f0-4492-bbfa-0f68d8722039 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:50.023792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d8a46-1a55-4f6e-83ca-2cb367886cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:50.024714 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d8a46-1a55-4f6e-83ca-2cb367886cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:50.025001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d8a46-1a55-4f6e-83ca-2cb367886cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:50.025282 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d8a46-1a55-4f6e-83ca-2cb367886cf1 None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:50.026515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d8a46-1a55-4f6e-83ca-2cb367886cf1 None admin] RBAC: Authorizing `identity:get_project(project_id=f82f5c51617d45fc90355caaf5b8a8b2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:50.028078 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d8a46-1a55-4f6e-83ca-2cb367886cf1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:50.030117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 104/207] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:49 2022] GET /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:50.035627 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa8135-1517-42dd-b8f5-988f7fcd7b72 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:50.115743 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:50.174144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa8135-1517-42dd-b8f5-988f7fcd7b72 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:50.213683 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7a04c-edd2-43d5-bb14-a11c1eb2fbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:50.214354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7a04c-edd2-43d5-bb14-a11c1eb2fbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:50.214637 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7a04c-edd2-43d5-bb14-a11c1eb2fbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:50.214904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7a04c-edd2-43d5-bb14-a11c1eb2fbb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:50.215734 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7a04c-edd2-43d5-bb14-a11c1eb2fbb8 None admin] RBAC: Adding query filter params (role.id=63f594b5fbbe4eb7b69119f8afda416f, scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2, user.id=906dbeb68d7c48f3bbe09217c0f9bee6) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:50.216056 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7a04c-edd2-43d5-bb14-a11c1eb2fbb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:50.217526 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7a04c-edd2-43d5-bb14-a11c1eb2fbb8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:50.229075 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 104/208] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:19:50 2022] GET /identity/v3/role_assignments?user.id=906dbeb68d7c48f3bbe09217c0f9bee6&scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2&role.id=63f594b5fbbe4eb7b69119f8afda416f => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:50.791455 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca87a91-5f5b-447f-a9f0-d3259a4780ca None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:50.791845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca87a91-5f5b-447f-a9f0-d3259a4780ca None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:50.792068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca87a91-5f5b-447f-a9f0-d3259a4780ca None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:50.793444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 105/209] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:50.798839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228431df-1f7c-45ca-9067-063c75c5a921 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:50.799299 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228431df-1f7c-45ca-9067-063c75c5a921 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:50.799375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228431df-1f7c-45ca-9067-063c75c5a921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:50.822599 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-228431df-1f7c-45ca-9067-063c75c5a921 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:50.823797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-228431df-1f7c-45ca-9067-063c75c5a921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:50.920489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 105/210] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:50.948323 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca87a91-5f5b-447f-a9f0-d3259a4780ca None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:50.955027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16ce8a-f229-4968-8a1c-b38affbd5098 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:50.955940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16ce8a-f229-4968-8a1c-b38affbd5098 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:50.956421 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16ce8a-f229-4968-8a1c-b38affbd5098 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:50.958033 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 106/211] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:19:50.967787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6d4b6-1888-4c6b-81d2-43cb6a6b8d9d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:50.968264 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6d4b6-1888-4c6b-81d2-43cb6a6b8d9d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:50.968724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6d4b6-1888-4c6b-81d2-43cb6a6b8d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:50.987470 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-39f6d4b6-1888-4c6b-81d2-43cb6a6b8d9d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:50.988695 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-39f6d4b6-1888-4c6b-81d2-43cb6a6b8d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:51.043130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:51.071382 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 107/212] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:51.080135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca87a91-5f5b-447f-a9f0-d3259a4780ca None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:51.091748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:51.097864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6d4b6-1888-4c6b-81d2-43cb6a6b8d9d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:51.132704 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e08233-5a4f-4efd-90b7-db1a966f0b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:51.133992 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e08233-5a4f-4efd-90b7-db1a966f0b7b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:51.134511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e08233-5a4f-4efd-90b7-db1a966f0b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:51.134998 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e08233-5a4f-4efd-90b7-db1a966f0b7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:51.147792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e08233-5a4f-4efd-90b7-db1a966f0b7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:51.155762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-b4e08233-5a4f-4efd-90b7-db1a966f0b7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:19:51.155762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:51.155762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:51.155762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:51.155762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:51.155762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:51.155762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:51.155762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:51.155762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:51.155762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:51.155762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:51.155762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:51.155762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:51.155762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:51.155762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:51.155762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:51.156749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:51.156749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:51.156749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:51.156749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:51.156749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:51.156749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:51.156749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:51.156749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:51.156749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:51.156749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:51.156749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:51.156749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:19:51.156749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:51.156749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:51.156749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:51.156749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:51.157558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:51.157558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:51.157558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:51.157558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:51.157558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:51.157558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:51.157558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:51.157558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:51.157558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:51.157558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:51.157558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:19:51.157558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:19:51.157558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 106/213] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:51.158233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c78bc-a88f-48cf-b4e0-fa4a93febb59 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:51.159207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c78bc-a88f-48cf-b4e0-fa4a93febb59 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:51.159207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c78bc-a88f-48cf-b4e0-fa4a93febb59 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:51.164063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 107/214] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:51.165945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c78bc-a88f-48cf-b4e0-fa4a93febb59 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:51.217500 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6d4b6-1888-4c6b-81d2-43cb6a6b8d9d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:51.254728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ab902-0f93-4a91-9608-6dfbb578aeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:51.256173 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ab902-0f93-4a91-9608-6dfbb578aeaa None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:51.256452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ab902-0f93-4a91-9608-6dfbb578aeaa None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:51.256728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ab902-0f93-4a91-9608-6dfbb578aeaa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:51.257914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ab902-0f93-4a91-9608-6dfbb578aeaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:51.259419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ab902-0f93-4a91-9608-6dfbb578aeaa None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:51.261240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 108/215] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:19:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:51.262208 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e17553-31b5-4d11-9c80-a5addc4ee948 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:51.262490 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e17553-31b5-4d11-9c80-a5addc4ee948 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:51.262765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e17553-31b5-4d11-9c80-a5addc4ee948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:51.279177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c78bc-a88f-48cf-b4e0-fa4a93febb59 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:51.279505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-50e17553-31b5-4d11-9c80-a5addc4ee948 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:51.280729 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-50e17553-31b5-4d11-9c80-a5addc4ee948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:51.313580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6679897-13a5-4fc6-bfb0-3a3c9b0c2c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:51.314186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6679897-13a5-4fc6-bfb0-3a3c9b0c2c2a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:51.314471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6679897-13a5-4fc6-bfb0-3a3c9b0c2c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:51.314746 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6679897-13a5-4fc6-bfb0-3a3c9b0c2c2a None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:51.315493 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6679897-13a5-4fc6-bfb0-3a3c9b0c2c2a None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:51.315798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6679897-13a5-4fc6-bfb0-3a3c9b0c2c2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:51.317261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6679897-13a5-4fc6-bfb0-3a3c9b0c2c2a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:51.324468 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:51.330114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 108/216] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:19:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:51.330114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed65d1-a7c7-4f59-9451-518eb6d97933 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:51.330114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed65d1-a7c7-4f59-9451-518eb6d97933 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:51.330114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed65d1-a7c7-4f59-9451-518eb6d97933 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:51.330114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 109/217] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:51.330114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed65d1-a7c7-4f59-9451-518eb6d97933 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:51.357407 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 109/218] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:51.358585 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e17553-31b5-4d11-9c80-a5addc4ee948 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:51.373122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:51.446345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed65d1-a7c7-4f59-9451-518eb6d97933 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:51.458635 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e17553-31b5-4d11-9c80-a5addc4ee948 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:51.479577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6615634-97e7-4ccd-9d28-318062228171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:51.480287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6615634-97e7-4ccd-9d28-318062228171 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:51.480563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6615634-97e7-4ccd-9d28-318062228171 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:51.480833 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6615634-97e7-4ccd-9d28-318062228171 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:51.481535 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6615634-97e7-4ccd-9d28-318062228171 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:51.483000 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6615634-97e7-4ccd-9d28-318062228171 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:51.495594 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd4334-53ec-45ac-8bef-3f8a629cbb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:51.496537 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd4334-53ec-45ac-8bef-3f8a629cbb79 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:51.497584 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd4334-53ec-45ac-8bef-3f8a629cbb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:51.499147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd4334-53ec-45ac-8bef-3f8a629cbb79 None admin] PATH_INFO: `/v3/users/4188c7076ecb48fd8afa06bcba102902` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:51.524042 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 110/219] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 16:19:51 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:19:51.524042 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39007f-9dc3-447c-8fa7-3abb06cefda9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:51.524042 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39007f-9dc3-447c-8fa7-3abb06cefda9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:51.524042 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39007f-9dc3-447c-8fa7-3abb06cefda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:51.524495 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd4334-53ec-45ac-8bef-3f8a629cbb79 None admin] RBAC: Authorizing `identity:get_user(user_id=4188c7076ecb48fd8afa06bcba102902)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:51.524495 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd4334-53ec-45ac-8bef-3f8a629cbb79 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:51.524495 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 110/220] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:51 2022] GET /identity/v3/users/4188c7076ecb48fd8afa06bcba102902 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:51.524495 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd4334-53ec-45ac-8bef-3f8a629cbb79 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:51.530295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8c39007f-9dc3-447c-8fa7-3abb06cefda9 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:51.531509 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8c39007f-9dc3-447c-8fa7-3abb06cefda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:51.557325 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:51.611818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 111/221] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:51.612662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39007f-9dc3-447c-8fa7-3abb06cefda9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:51.637815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:51.649447 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd4334-53ec-45ac-8bef-3f8a629cbb79 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:51.686753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e39be9-c69d-4764-b532-611c8cd0e581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:51.687559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e39be9-c69d-4764-b532-611c8cd0e581 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:51.687842 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e39be9-c69d-4764-b532-611c8cd0e581 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:51.688150 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e39be9-c69d-4764-b532-611c8cd0e581 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:51.702242 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e39be9-c69d-4764-b532-611c8cd0e581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:51.710442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c5e39be9-c69d-4764-b532-611c8cd0e581 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:19:51.710442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:51.710442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:51.710442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:51.710442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:51.710442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:51.710442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:51.710442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:51.710442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:51.710442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:51.710442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:51.710442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:51.710442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:51.710442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:51.710442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:51.710442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:51.711404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:51.711404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:51.711404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:51.711404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:51.711404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:51.711404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:51.711404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:51.711404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:51.711404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:51.711404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:51.711404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:51.711404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:19:51.711404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:51.711404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:51.711404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:51.711404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:51.712279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:51.712279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:51.712279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:51.712279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:51.712279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:51.712279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:51.712279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:51.712279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:51.712279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:51.712279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:51.712279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:19:51.712279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:19:51.712279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 111/222] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:19:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:51.713106 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e39be9-c69d-4764-b532-611c8cd0e581 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:51.745917 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39007f-9dc3-447c-8fa7-3abb06cefda9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:51.782026 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3809d5-3681-4ca4-a230-16786901342d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:51.783366 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3809d5-3681-4ca4-a230-16786901342d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:51.783366 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3809d5-3681-4ca4-a230-16786901342d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:51.783366 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3809d5-3681-4ca4-a230-16786901342d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:51.813952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:51.827746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e39be9-c69d-4764-b532-611c8cd0e581 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:51.873907 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694fdc2-9b5c-494e-9ef5-dc71602a47e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:51.874648 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694fdc2-9b5c-494e-9ef5-dc71602a47e1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:51.874929 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694fdc2-9b5c-494e-9ef5-dc71602a47e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:51.875198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694fdc2-9b5c-494e-9ef5-dc71602a47e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:51.882333 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3809d5-3681-4ca4-a230-16786901342d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:51.884485 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3809d5-3681-4ca4-a230-16786901342d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:51.889672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694fdc2-9b5c-494e-9ef5-dc71602a47e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:51.898770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a694fdc2-9b5c-494e-9ef5-dc71602a47e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:19:51.898770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:51.898770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:51.898770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:51.898770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:51.898770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:51.898770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:51.898770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:51.898770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:51.898770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:51.898770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:51.898770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:51.898770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:51.898770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:51.898770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:51.898770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:51.899747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:51.899747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:51.899747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:51.899747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:51.899747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:51.899747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:51.899747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:51.899747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:51.899747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:51.899747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:51.899747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:51.899747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:19:51.899747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:51.899747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:51.899747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:51.899747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:51.900606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:51.900606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:51.900606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:51.900606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:51.900606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:51.900606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:51.900606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:51.900606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:51.900606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:51.900606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:51.900606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:19:51.900606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:19:51.902778 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 112/223] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:19:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:51.903700 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694fdc2-9b5c-494e-9ef5-dc71602a47e1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:51.908957 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:51.998468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 112/224] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:19:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:19:52.004332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3809d5-3681-4ca4-a230-16786901342d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:52.011486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694fdc2-9b5c-494e-9ef5-dc71602a47e1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:52.046870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5d399-0374-48b5-81c0-a0be7b8a0625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:52.047889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5d399-0374-48b5-81c0-a0be7b8a0625 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:52.048127 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5d399-0374-48b5-81c0-a0be7b8a0625 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:52.048546 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5d399-0374-48b5-81c0-a0be7b8a0625 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:52.049402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5d399-0374-48b5-81c0-a0be7b8a0625 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:52.049808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5d399-0374-48b5-81c0-a0be7b8a0625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:52.051338 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5d399-0374-48b5-81c0-a0be7b8a0625 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:52.065175 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 113/225] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:52.065175 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5d399-0374-48b5-81c0-a0be7b8a0625 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:52.083442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:52.117952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3809d5-3681-4ca4-a230-16786901342d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:52.136135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:52.156843 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f893c-cff1-4b9f-8633-c9a1c1d15320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:52.157764 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f893c-cff1-4b9f-8633-c9a1c1d15320 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:52.158272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f893c-cff1-4b9f-8633-c9a1c1d15320 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:52.158736 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f893c-cff1-4b9f-8633-c9a1c1d15320 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:52.159679 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f893c-cff1-4b9f-8633-c9a1c1d15320 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:52.160199 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f893c-cff1-4b9f-8633-c9a1c1d15320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:52.161930 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f893c-cff1-4b9f-8633-c9a1c1d15320 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:52.169756 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5d399-0374-48b5-81c0-a0be7b8a0625 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:52.171415 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 113/226] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:19:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:52.172440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f893c-cff1-4b9f-8633-c9a1c1d15320 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:52.206186 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d412a-7668-4733-a61d-19c36b37a236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:52.207113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d412a-7668-4733-a61d-19c36b37a236 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:52.207353 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d412a-7668-4733-a61d-19c36b37a236 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:52.207793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d412a-7668-4733-a61d-19c36b37a236 None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:52.209422 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d412a-7668-4733-a61d-19c36b37a236 None admin] RBAC: Authorizing `identity:get_project(project_id=b99cf27cf22249fdb99befb43f95a1d6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:52.211151 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d412a-7668-4733-a61d-19c36b37a236 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:52.217925 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 114/227] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:52 2022] GET /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:52.217925 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d412a-7668-4733-a61d-19c36b37a236 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:52.285015 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f893c-cff1-4b9f-8633-c9a1c1d15320 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:52.305420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:52.318055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d412a-7668-4733-a61d-19c36b37a236 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:52.327326 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c1cba-efb3-48cd-8f5f-8c6cfaea8437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:52.328657 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c1cba-efb3-48cd-8f5f-8c6cfaea8437 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:52.329132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c1cba-efb3-48cd-8f5f-8c6cfaea8437 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:52.329592 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c1cba-efb3-48cd-8f5f-8c6cfaea8437 None admin] PATH_INFO: `/v3/users/d1c12330f74c43b5855d0cbad814ddf1` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:52.331532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c1cba-efb3-48cd-8f5f-8c6cfaea8437 None admin] RBAC: Authorizing `identity:get_user(user_id=d1c12330f74c43b5855d0cbad814ddf1)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:52.333447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c1cba-efb3-48cd-8f5f-8c6cfaea8437 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:52.335503 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 114/228] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:52 2022] GET /identity/v3/users/d1c12330f74c43b5855d0cbad814ddf1 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:52.341158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c1cba-efb3-48cd-8f5f-8c6cfaea8437 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:52.356446 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb4c79-8ace-4f75-a923-13b60091eff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:52.357336 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb4c79-8ace-4f75-a923-13b60091eff6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:52.357627 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb4c79-8ace-4f75-a923-13b60091eff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:52.357904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb4c79-8ace-4f75-a923-13b60091eff6 None admin] PATH_INFO: `/v3/users/d1c12330f74c43b5855d0cbad814ddf1` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:52.359148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb4c79-8ace-4f75-a923-13b60091eff6 None admin] RBAC: Authorizing `identity:get_user(user_id=d1c12330f74c43b5855d0cbad814ddf1)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:52.361013 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb4c79-8ace-4f75-a923-13b60091eff6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:52.362698 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 115/229] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:52 2022] GET /identity/v3/users/d1c12330f74c43b5855d0cbad814ddf1 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:52.363555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb4c79-8ace-4f75-a923-13b60091eff6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:52.398804 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:52.456976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c1cba-efb3-48cd-8f5f-8c6cfaea8437 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:52.464584 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb4c79-8ace-4f75-a923-13b60091eff6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:52.493235 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4547183-8c7c-450b-9ca0-fd590e199146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:52.494265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4547183-8c7c-450b-9ca0-fd590e199146 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:52.494769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4547183-8c7c-450b-9ca0-fd590e199146 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:52.495232 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4547183-8c7c-450b-9ca0-fd590e199146 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:52.496410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4547183-8c7c-450b-9ca0-fd590e199146 None admin] RBAC: Adding query filter params (role.id=91889a59745c4d8185400f69d84eb50e, scope.project.id=b99cf27cf22249fdb99befb43f95a1d6, user.id=4188c7076ecb48fd8afa06bcba102902) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:52.496826 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4547183-8c7c-450b-9ca0-fd590e199146 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:52.498399 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4547183-8c7c-450b-9ca0-fd590e199146 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:52.499780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdda4d0-db2e-471b-a169-2f1f01c27155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:52.500846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdda4d0-db2e-471b-a169-2f1f01c27155 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:52.501270 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdda4d0-db2e-471b-a169-2f1f01c27155 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:52.501679 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdda4d0-db2e-471b-a169-2f1f01c27155 None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:52.503082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdda4d0-db2e-471b-a169-2f1f01c27155 None admin] RBAC: Authorizing `identity:get_project(project_id=b99cf27cf22249fdb99befb43f95a1d6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:52.504787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdda4d0-db2e-471b-a169-2f1f01c27155 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:52.505473 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 115/230] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:19:52 2022] GET /identity/v3/role_assignments?user.id=4188c7076ecb48fd8afa06bcba102902&scope.project.id=b99cf27cf22249fdb99befb43f95a1d6&role.id=91889a59745c4d8185400f69d84eb50e => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:52.507711 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 116/231] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:52 2022] GET /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:52.508839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4547183-8c7c-450b-9ca0-fd590e199146 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:52.519245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdda4d0-db2e-471b-a169-2f1f01c27155 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:52.559765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:52.658693 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdda4d0-db2e-471b-a169-2f1f01c27155 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:52.698679 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b550e51-9d90-4d2e-81d8-6f54ce7a6b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:52.699599 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b550e51-9d90-4d2e-81d8-6f54ce7a6b0a None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:52.699881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b550e51-9d90-4d2e-81d8-6f54ce7a6b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:52.700185 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b550e51-9d90-4d2e-81d8-6f54ce7a6b0a None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6/users/d1c12330f74c43b5855d0cbad814ddf1/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:52.703388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b550e51-9d90-4d2e-81d8-6f54ce7a6b0a None admin] RBAC: Authorizing `identity:create_grant(project_id=b99cf27cf22249fdb99befb43f95a1d6, user_id=d1c12330f74c43b5855d0cbad814ddf1, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:52.704916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b550e51-9d90-4d2e-81d8-6f54ce7a6b0a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:52.733828 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 117/232] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:19:52 2022] PUT /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6/users/d1c12330f74c43b5855d0cbad814ddf1/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:19:52.755054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4547183-8c7c-450b-9ca0-fd590e199146 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:52.767322 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:52.799634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc653b5-09b7-4479-8296-b894f65a3d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:52.800619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc653b5-09b7-4479-8296-b894f65a3d6e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:52.800906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc653b5-09b7-4479-8296-b894f65a3d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:52.801178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc653b5-09b7-4479-8296-b894f65a3d6e None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:52.802779 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc653b5-09b7-4479-8296-b894f65a3d6e None admin] RBAC: Authorizing `identity:get_project(project_id=b99cf27cf22249fdb99befb43f95a1d6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:52.804520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc653b5-09b7-4479-8296-b894f65a3d6e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:52.808036 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 116/233] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:52 2022] GET /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6 => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:52.813955 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b550e51-9d90-4d2e-81d8-6f54ce7a6b0a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:52.915308 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:52.942502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b550e51-9d90-4d2e-81d8-6f54ce7a6b0a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:53.003118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b159e-01ad-46d7-873d-c5b393dcc40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:53.004056 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b159e-01ad-46d7-873d-c5b393dcc40f None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:53.004341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b159e-01ad-46d7-873d-c5b393dcc40f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:53.004618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b159e-01ad-46d7-873d-c5b393dcc40f None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6/users/d1c12330f74c43b5855d0cbad814ddf1/roles/60519d06a8c94e6c82462e5d79d9856b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:53.009833 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b159e-01ad-46d7-873d-c5b393dcc40f None admin] RBAC: Authorizing `identity:create_grant(project_id=b99cf27cf22249fdb99befb43f95a1d6, user_id=d1c12330f74c43b5855d0cbad814ddf1, role_id=60519d06a8c94e6c82462e5d79d9856b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:53.011336 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b159e-01ad-46d7-873d-c5b393dcc40f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:53.035686 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 118/234] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:19:52 2022] PUT /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6/users/d1c12330f74c43b5855d0cbad814ddf1/roles/60519d06a8c94e6c82462e5d79d9856b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:19:53.986784 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59209c4c-9460-4f46-b5dd-5965f91d478d None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:53.987343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59209c4c-9460-4f46-b5dd-5965f91d478d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:53.987343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59209c4c-9460-4f46-b5dd-5965f91d478d None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:53.989014 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 117/235] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:54.008626 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794240c-31e8-464a-ac9c-7663687cda57 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:54.009159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794240c-31e8-464a-ac9c-7663687cda57 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:54.009399 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794240c-31e8-464a-ac9c-7663687cda57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:54.035519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b794240c-31e8-464a-ac9c-7663687cda57 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:54.037731 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b794240c-31e8-464a-ac9c-7663687cda57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:54.133693 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 119/236] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:54.168960 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59209c4c-9460-4f46-b5dd-5965f91d478d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:54.231166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d003-d3ef-4f21-8265-934bd11cea7b None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:54.231494 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d003-d3ef-4f21-8265-934bd11cea7b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:54.231724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d003-d3ef-4f21-8265-934bd11cea7b None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:54.233485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 120/237] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:19:54.249663 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2ea40-f2c6-4874-8a5e-d2031d8ffef5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:54.250148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2ea40-f2c6-4874-8a5e-d2031d8ffef5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:54.250573 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2ea40-f2c6-4874-8a5e-d2031d8ffef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:54.276168 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-49a2ea40-f2c6-4874-8a5e-d2031d8ffef5 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:54.279061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-49a2ea40-f2c6-4874-8a5e-d2031d8ffef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:54.324694 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59209c4c-9460-4f46-b5dd-5965f91d478d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:54.366101 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6623d-6a94-45c4-a064-b7c9c43ee815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:54.366608 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6623d-6a94-45c4-a064-b7c9c43ee815 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:54.366891 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6623d-6a94-45c4-a064-b7c9c43ee815 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:54.367167 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6623d-6a94-45c4-a064-b7c9c43ee815 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:54.379715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6623d-6a94-45c4-a064-b7c9c43ee815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:54.387808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-7cc6623d-6a94-45c4-a064-b7c9c43ee815 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:19:54.387808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:54.387808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:54.387808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:54.387808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:54.387808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:54.387808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:54.387808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:54.387808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:54.387808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:54.387808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:54.387808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:54.387808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:54.387808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:54.387808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:54.387808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:54.388817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:54.388817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:54.388817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:54.388817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:54.388817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:54.388817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:54.388817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:54.388817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:54.388817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:54.388817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:54.388817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:54.388817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:19:54.388817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:54.388817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:54.388817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:54.388817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:54.390424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:54.390424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:54.390424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:54.390424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:54.390424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:54.390424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:54.390424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:54.390424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:54.390424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:54.390424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:54.390424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:19:54.390424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:19:54.390424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 118/238] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:54.394699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6623d-6a94-45c4-a064-b7c9c43ee815 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:54.423004 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 121/239] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:19:54.423531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:54.459909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:54.483288 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2ea40-f2c6-4874-8a5e-d2031d8ffef5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:54.567719 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6623d-6a94-45c4-a064-b7c9c43ee815 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:54.615778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcc123-28c5-4066-b6cd-4427b7c6b5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:54.616493 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcc123-28c5-4066-b6cd-4427b7c6b5df None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:54.616775 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcc123-28c5-4066-b6cd-4427b7c6b5df None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:54.617057 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcc123-28c5-4066-b6cd-4427b7c6b5df None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:54.617814 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcc123-28c5-4066-b6cd-4427b7c6b5df None admin] RBAC: Adding query filter params (name=reader) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:54.618121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcc123-28c5-4066-b6cd-4427b7c6b5df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:54.619550 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcc123-28c5-4066-b6cd-4427b7c6b5df None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:54.638226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 119/240] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:19:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:54.644690 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcc123-28c5-4066-b6cd-4427b7c6b5df None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:54.696974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2ea40-f2c6-4874-8a5e-d2031d8ffef5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:54.777750 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc41263-c8bd-46f4-be19-356d1eac6a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:54.778695 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc41263-c8bd-46f4-be19-356d1eac6a5f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:54.778983 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc41263-c8bd-46f4-be19-356d1eac6a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:54.779258 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc41263-c8bd-46f4-be19-356d1eac6a5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:54.784845 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc41263-c8bd-46f4-be19-356d1eac6a5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:54.786596 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc41263-c8bd-46f4-be19-356d1eac6a5f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:54.788426 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 122/241] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:19:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:54.794033 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc41263-c8bd-46f4-be19-356d1eac6a5f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:54.802059 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:54.813987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcc123-28c5-4066-b6cd-4427b7c6b5df None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:54.857459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10d744-cdcb-4931-8802-0b73b995fa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:54.858274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10d744-cdcb-4931-8802-0b73b995fa92 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:54.858554 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10d744-cdcb-4931-8802-0b73b995fa92 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:54.858823 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10d744-cdcb-4931-8802-0b73b995fa92 None admin] PATH_INFO: `/v3/users/19b69619fcf542a8a54d9d3ed5d1010b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:54.881246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10d744-cdcb-4931-8802-0b73b995fa92 None admin] RBAC: Authorizing `identity:get_user(user_id=19b69619fcf542a8a54d9d3ed5d1010b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:54.882761 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10d744-cdcb-4931-8802-0b73b995fa92 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:54.885782 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 120/242] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:54 2022] GET /identity/v3/users/19b69619fcf542a8a54d9d3ed5d1010b => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:54.891191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10d744-cdcb-4931-8802-0b73b995fa92 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:54.916373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:54.965955 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc41263-c8bd-46f4-be19-356d1eac6a5f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:55.016977 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823079e-1edd-4618-8bae-b14312b0d221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:55.017679 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823079e-1edd-4618-8bae-b14312b0d221 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:55.017958 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823079e-1edd-4618-8bae-b14312b0d221 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:55.021019 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823079e-1edd-4618-8bae-b14312b0d221 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:55.021804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823079e-1edd-4618-8bae-b14312b0d221 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:55.025181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823079e-1edd-4618-8bae-b14312b0d221 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:55.062863 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 123/243] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 16:19:54 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:19:55.076362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10d744-cdcb-4931-8802-0b73b995fa92 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:55.120998 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d2586-115d-4ee8-8d05-b33cd1b54e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:55.121596 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d2586-115d-4ee8-8d05-b33cd1b54e0e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:55.121884 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d2586-115d-4ee8-8d05-b33cd1b54e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:55.122159 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d2586-115d-4ee8-8d05-b33cd1b54e0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:55.154732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:55.201721 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d2586-115d-4ee8-8d05-b33cd1b54e0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:55.203271 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d2586-115d-4ee8-8d05-b33cd1b54e0e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:55.310689 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 121/244] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:19:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:19:55.313747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc026d-4da1-47cb-9cf7-71399efdd529 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:55.314038 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc026d-4da1-47cb-9cf7-71399efdd529 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:55.314316 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc026d-4da1-47cb-9cf7-71399efdd529 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:55.315735 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d2586-115d-4ee8-8d05-b33cd1b54e0e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:55.315913 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 124/245] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:55.329865 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27cf28-ae8f-4f51-b562-f10a3f350b7f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:55.330665 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27cf28-ae8f-4f51-b562-f10a3f350b7f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:55.331682 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27cf28-ae8f-4f51-b562-f10a3f350b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:55.373273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4d27cf28-ae8f-4f51-b562-f10a3f350b7f None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:55.380298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4d27cf28-ae8f-4f51-b562-f10a3f350b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:55.408004 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:55.473025 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d2586-115d-4ee8-8d05-b33cd1b54e0e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:55.493811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 125/246] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:55.514246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12186a6d-0d09-412a-83f6-f38e633f179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:55.515568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12186a6d-0d09-412a-83f6-f38e633f179e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:55.516057 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12186a6d-0d09-412a-83f6-f38e633f179e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:55.516543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12186a6d-0d09-412a-83f6-f38e633f179e None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:55.517964 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12186a6d-0d09-412a-83f6-f38e633f179e None admin] RBAC: Authorizing `identity:get_project(project_id=b99cf27cf22249fdb99befb43f95a1d6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:55.519484 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27cf28-ae8f-4f51-b562-f10a3f350b7f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:55.519845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12186a6d-0d09-412a-83f6-f38e633f179e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:55.522147 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 122/247] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:55 2022] GET /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:55.529375 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12186a6d-0d09-412a-83f6-f38e633f179e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:55.580938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:55.636217 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12186a6d-0d09-412a-83f6-f38e633f179e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:55.639340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27cf28-ae8f-4f51-b562-f10a3f350b7f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:55.664840 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:55.674583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f31b7-8196-4dfc-a49c-fd487cad2dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:55.675251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f31b7-8196-4dfc-a49c-fd487cad2dae None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:55.675564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f31b7-8196-4dfc-a49c-fd487cad2dae None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:55.676651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f31b7-8196-4dfc-a49c-fd487cad2dae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:55.677413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f31b7-8196-4dfc-a49c-fd487cad2dae None admin] RBAC: Adding query filter params (role.id=63f594b5fbbe4eb7b69119f8afda416f, scope.project.id=b99cf27cf22249fdb99befb43f95a1d6, user.id=19b69619fcf542a8a54d9d3ed5d1010b) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:55.677726 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f31b7-8196-4dfc-a49c-fd487cad2dae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:55.679639 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f31b7-8196-4dfc-a49c-fd487cad2dae None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:55.681018 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ad74d-19e9-4fb4-b155-82b8f8aafcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:55.682152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ad74d-19e9-4fb4-b155-82b8f8aafcf7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:55.682641 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ad74d-19e9-4fb4-b155-82b8f8aafcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:55.683158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ad74d-19e9-4fb4-b155-82b8f8aafcf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:55.686290 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 123/248] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:19:55 2022] GET /identity/v3/role_assignments?user.id=19b69619fcf542a8a54d9d3ed5d1010b&scope.project.id=b99cf27cf22249fdb99befb43f95a1d6&role.id=63f594b5fbbe4eb7b69119f8afda416f => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:55.695950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e0c4c-05f5-4c3c-a44c-fe45a8dbffdd None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:55.696329 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e0c4c-05f5-4c3c-a44c-fe45a8dbffdd None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:55.696662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e0c4c-05f5-4c3c-a44c-fe45a8dbffdd None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:55.698315 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 124/249] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:19:55.699435 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ad74d-19e9-4fb4-b155-82b8f8aafcf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:55.704266 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a503400-f0ec-452f-b3f3-ecd49afa144d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:55.704547 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a503400-f0ec-452f-b3f3-ecd49afa144d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:55.704807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a503400-f0ec-452f-b3f3-ecd49afa144d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:55.708948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8b6ad74d-19e9-4fb4-b155-82b8f8aafcf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:19:55.708948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:55.708948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:55.708948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:55.708948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:55.708948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:55.708948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:55.708948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:55.708948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:55.708948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:55.708948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:55.708948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:55.708948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:55.708948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:55.708948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:55.708948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:55.710041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:55.710041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:55.710041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:55.710041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:55.710041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:55.710041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:55.710041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:55.710041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:55.710041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:55.710041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:55.710041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:55.710041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:19:55.710041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:55.710041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:55.710041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:55.710041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:55.710870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:55.710870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:55.710870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:55.710870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:55.710870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:55.710870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:55.710870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:55.710870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:55.710870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:55.710870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:55.710870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:19:55.710870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:19:55.711940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 126/250] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:19:55.718455 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ad74d-19e9-4fb4-b155-82b8f8aafcf7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:55.734557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4a503400-f0ec-452f-b3f3-ecd49afa144d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:55.735961 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4a503400-f0ec-452f-b3f3-ecd49afa144d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:55.820102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 125/251] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:55.847945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a503400-f0ec-452f-b3f3-ecd49afa144d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:55.856258 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ad74d-19e9-4fb4-b155-82b8f8aafcf7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:55.871974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:55.900576 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e15071-481d-4f74-acc9-480856b1b41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:55.901174 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e15071-481d-4f74-acc9-480856b1b41b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:55.901458 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e15071-481d-4f74-acc9-480856b1b41b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:55.901736 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e15071-481d-4f74-acc9-480856b1b41b None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:55.902496 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e15071-481d-4f74-acc9-480856b1b41b None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:55.902802 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e15071-481d-4f74-acc9-480856b1b41b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:55.904975 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e15071-481d-4f74-acc9-480856b1b41b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:55.920129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 127/252] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:19:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:55.928306 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e15071-481d-4f74-acc9-480856b1b41b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:55.991049 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a503400-f0ec-452f-b3f3-ecd49afa144d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:56.015088 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:56.039343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00c045-5670-4c12-804e-a8aa52d0cfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:56.040987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00c045-5670-4c12-804e-a8aa52d0cfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:56.041274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00c045-5670-4c12-804e-a8aa52d0cfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:56.041550 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00c045-5670-4c12-804e-a8aa52d0cfb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:56.054260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e15071-481d-4f74-acc9-480856b1b41b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:56.057987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00c045-5670-4c12-804e-a8aa52d0cfb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:56.068111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ec00c045-5670-4c12-804e-a8aa52d0cfb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:19:56.068111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:56.068111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:56.068111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:56.068111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:56.068111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:56.068111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:56.068111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:56.068111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:56.068111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:56.068111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:56.068111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:56.068111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:56.068111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:56.068111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:56.068111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:56.069061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:56.069061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:56.069061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:56.069061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:56.069061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:56.069061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:56.069061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:56.069061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:56.069061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:56.069061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:56.069061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:56.069061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:19:56.069061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:56.069061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:56.069061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:56.069061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:56.069893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:56.069893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:56.069893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:56.069893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:56.069893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:56.069893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:56.069893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:56.069893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:56.069893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:56.069893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:56.069893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:19:56.069893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:19:56.076245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 126/253] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:19:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:19:56.077544 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d17950-f241-4443-8126-f0bae44e8caf None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:56.078068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d17950-f241-4443-8126-f0bae44e8caf None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:56.078068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d17950-f241-4443-8126-f0bae44e8caf None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:56.080851 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 127/254] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:56.081426 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d17950-f241-4443-8126-f0bae44e8caf None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:56.104532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed64e8-ea29-4272-aebb-f1fe613000ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:56.105811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed64e8-ea29-4272-aebb-f1fe613000ff None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:56.106312 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed64e8-ea29-4272-aebb-f1fe613000ff None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:56.106790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed64e8-ea29-4272-aebb-f1fe613000ff None admin] PATH_INFO: `/v3/users/4188c7076ecb48fd8afa06bcba102902` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:56.108242 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed64e8-ea29-4272-aebb-f1fe613000ff None admin] RBAC: Authorizing `identity:get_user(user_id=4188c7076ecb48fd8afa06bcba102902)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:56.110527 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed64e8-ea29-4272-aebb-f1fe613000ff None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:56.112969 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 128/255] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:55 2022] GET /identity/v3/users/4188c7076ecb48fd8afa06bcba102902 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:56.115422 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dccb0-7518-422a-a7a6-ad833b09805e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:56.115939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dccb0-7518-422a-a7a6-ad833b09805e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:56.116453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dccb0-7518-422a-a7a6-ad833b09805e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:56.137333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b05dccb0-7518-422a-a7a6-ad833b09805e None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:56.139370 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b05dccb0-7518-422a-a7a6-ad833b09805e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:56.181329 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:56.221667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 129/256] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:56.223022 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05dccb0-7518-422a-a7a6-ad833b09805e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:56.308844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d17950-f241-4443-8126-f0bae44e8caf None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:56.344501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783d7f1-cdcc-439d-a7b0-8a28943330d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:56.345180 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d7f1-cdcc-439d-a7b0-8a28943330d6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:56.345461 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d7f1-cdcc-439d-a7b0-8a28943330d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:56.345738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783d7f1-cdcc-439d-a7b0-8a28943330d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:56.346484 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783d7f1-cdcc-439d-a7b0-8a28943330d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:56.346850 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783d7f1-cdcc-439d-a7b0-8a28943330d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:56.348218 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783d7f1-cdcc-439d-a7b0-8a28943330d6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:56.361965 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 128/257] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:56.361965 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783d7f1-cdcc-439d-a7b0-8a28943330d6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:56.362241 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05dccb0-7518-422a-a7a6-ad833b09805e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:56.412887 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:56.428956 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccbddd-697d-4ae7-85ff-e18e6c3e07d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:56.429848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccbddd-697d-4ae7-85ff-e18e6c3e07d1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:56.430901 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccbddd-697d-4ae7-85ff-e18e6c3e07d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:56.431436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccbddd-697d-4ae7-85ff-e18e6c3e07d1 None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:56.434414 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccbddd-697d-4ae7-85ff-e18e6c3e07d1 None admin] RBAC: Authorizing `identity:get_project(project_id=b99cf27cf22249fdb99befb43f95a1d6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:56.436596 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccbddd-697d-4ae7-85ff-e18e6c3e07d1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:56.439775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 130/258] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:56 2022] GET /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:56.440402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccbddd-697d-4ae7-85ff-e18e6c3e07d1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:56.496064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783d7f1-cdcc-439d-a7b0-8a28943330d6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:56.518841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:56.556431 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a93a9e-fca8-4b06-ad46-476aff463208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:56.557258 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a93a9e-fca8-4b06-ad46-476aff463208 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:56.557532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a93a9e-fca8-4b06-ad46-476aff463208 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:56.557799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a93a9e-fca8-4b06-ad46-476aff463208 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:56.580255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a93a9e-fca8-4b06-ad46-476aff463208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:56.594051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-59a93a9e-fca8-4b06-ad46-476aff463208 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:19:56.594051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:56.594051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:56.594051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:56.594051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:56.594051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:56.594051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:56.594051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:56.594051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:56.594051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:56.594051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:56.594051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:56.594051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:56.594051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:56.594051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:56.594051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:56.595012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:56.595012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:56.595012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:56.595012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:56.595012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:56.595012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:56.595012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:56.595012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:56.595012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:56.595012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:56.595012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:56.595012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:19:56.595012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:56.595012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:56.595012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:56.595012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:56.595818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:56.595818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:56.595818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:56.595818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:56.595818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:56.595818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:56.595818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:56.595818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:56.595818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:56.595818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:56.595818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:19:56.595818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:19:56.595818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 129/259] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:19:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:56.596526 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a93a9e-fca8-4b06-ad46-476aff463208 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:56.626629 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccbddd-697d-4ae7-85ff-e18e6c3e07d1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:56.693038 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18602ef-670a-401a-a523-dd079d2b73eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:56.693926 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18602ef-670a-401a-a523-dd079d2b73eb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:56.694207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18602ef-670a-401a-a523-dd079d2b73eb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:56.694481 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18602ef-670a-401a-a523-dd079d2b73eb None admin] PATH_INFO: `/v3/users/d1c12330f74c43b5855d0cbad814ddf1` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:56.697255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18602ef-670a-401a-a523-dd079d2b73eb None admin] RBAC: Authorizing `identity:get_user(user_id=d1c12330f74c43b5855d0cbad814ddf1)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:56.698731 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18602ef-670a-401a-a523-dd079d2b73eb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:56.700417 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 131/260] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:56 2022] GET /identity/v3/users/d1c12330f74c43b5855d0cbad814ddf1 => generated 283 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:56.701188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18602ef-670a-401a-a523-dd079d2b73eb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:56.773416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a93a9e-fca8-4b06-ad46-476aff463208 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:56.775246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:56.819767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18602ef-670a-401a-a523-dd079d2b73eb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:56.829361 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:56.845423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed10e6-dc74-4196-850d-af6ebafbf7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:56.846346 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed10e6-dc74-4196-850d-af6ebafbf7c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:56.846623 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed10e6-dc74-4196-850d-af6ebafbf7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:56.846891 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed10e6-dc74-4196-850d-af6ebafbf7c5 None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6/users/4188c7076ecb48fd8afa06bcba102902/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:56.848972 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed10e6-dc74-4196-850d-af6ebafbf7c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b99cf27cf22249fdb99befb43f95a1d6, user_id=4188c7076ecb48fd8afa06bcba102902, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:56.850449 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed10e6-dc74-4196-850d-af6ebafbf7c5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:56.865599 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38b52b-3816-4c72-83f0-e580c913c55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:56.866290 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38b52b-3816-4c72-83f0-e580c913c55d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:56.866578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38b52b-3816-4c72-83f0-e580c913c55d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:56.866867 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38b52b-3816-4c72-83f0-e580c913c55d None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:56.867590 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38b52b-3816-4c72-83f0-e580c913c55d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:56.867906 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38b52b-3816-4c72-83f0-e580c913c55d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:56.869359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38b52b-3816-4c72-83f0-e580c913c55d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:56.879260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 130/261] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:19:56 2022] PUT /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6/users/4188c7076ecb48fd8afa06bcba102902/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:19:56.880228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed10e6-dc74-4196-850d-af6ebafbf7c5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:56.892181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 132/262] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:19:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:56.901195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38b52b-3816-4c72-83f0-e580c913c55d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:57.114677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed10e6-dc74-4196-850d-af6ebafbf7c5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:57.127558 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38b52b-3816-4c72-83f0-e580c913c55d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:57.170894 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d1d98-8014-4af2-81f9-7a8d6bdd66f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:57.171808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d1d98-8014-4af2-81f9-7a8d6bdd66f4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:57.172119 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d1d98-8014-4af2-81f9-7a8d6bdd66f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:57.172395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d1d98-8014-4af2-81f9-7a8d6bdd66f4 None admin] PATH_INFO: `/v3/users/d1c12330f74c43b5855d0cbad814ddf1` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:57.174491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d1d98-8014-4af2-81f9-7a8d6bdd66f4 None admin] RBAC: Authorizing `identity:get_user(user_id=d1c12330f74c43b5855d0cbad814ddf1)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:57.176046 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d1d98-8014-4af2-81f9-7a8d6bdd66f4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:57.177857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 133/263] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:56 2022] GET /identity/v3/users/d1c12330f74c43b5855d0cbad814ddf1 => generated 283 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:57.178704 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea37e26-7f6f-4c7b-b356-16896631aa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:57.179443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37e26-7f6f-4c7b-b356-16896631aa6a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:57.179732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37e26-7f6f-4c7b-b356-16896631aa6a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:57.180027 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea37e26-7f6f-4c7b-b356-16896631aa6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:57.189075 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d1d98-8014-4af2-81f9-7a8d6bdd66f4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:57.232430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:57.256194 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:57.300034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea37e26-7f6f-4c7b-b356-16896631aa6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:57.300034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea37e26-7f6f-4c7b-b356-16896631aa6a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:57.359315 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d1d98-8014-4af2-81f9-7a8d6bdd66f4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:57.425281 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa60a9-ca4e-435b-9b1b-74765d124a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:57.426208 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa60a9-ca4e-435b-9b1b-74765d124a82 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:57.426636 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa60a9-ca4e-435b-9b1b-74765d124a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:57.427141 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa60a9-ca4e-435b-9b1b-74765d124a82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:57.470673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 131/264] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:19:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:19:57.477024 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea37e26-7f6f-4c7b-b356-16896631aa6a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:57.519071 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa60a9-ca4e-435b-9b1b-74765d124a82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:57.520952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa60a9-ca4e-435b-9b1b-74765d124a82 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:57.582982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:57.613663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:57.664986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea37e26-7f6f-4c7b-b356-16896631aa6a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:57.691683 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 134/265] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:19:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:19:57.697344 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa60a9-ca4e-435b-9b1b-74765d124a82 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:57.719748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cdf87-6762-480e-9c65-4496bbde4f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:57.720781 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cdf87-6762-480e-9c65-4496bbde4f21 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:57.721125 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cdf87-6762-480e-9c65-4496bbde4f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:57.721527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cdf87-6762-480e-9c65-4496bbde4f21 None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:57.722691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cdf87-6762-480e-9c65-4496bbde4f21 None admin] RBAC: Authorizing `identity:get_project(project_id=b99cf27cf22249fdb99befb43f95a1d6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:57.724349 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cdf87-6762-480e-9c65-4496bbde4f21 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:57.726303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 132/266] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:57 2022] GET /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:57.731908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cdf87-6762-480e-9c65-4496bbde4f21 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:57.833471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cdf87-6762-480e-9c65-4496bbde4f21 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:57.862562 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:57.872309 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d9ffb-2dc2-463f-85a1-c355d02a52c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:57.873156 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d9ffb-2dc2-463f-85a1-c355d02a52c8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:57.873708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d9ffb-2dc2-463f-85a1-c355d02a52c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:57.874174 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d9ffb-2dc2-463f-85a1-c355d02a52c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:57.875087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d9ffb-2dc2-463f-85a1-c355d02a52c8 None admin] RBAC: Adding query filter params (role.id=e1e39192d3af465aa504728e32ab7cd2, scope.project.id=b99cf27cf22249fdb99befb43f95a1d6, user.id=d1c12330f74c43b5855d0cbad814ddf1) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:57.875698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d9ffb-2dc2-463f-85a1-c355d02a52c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:57.877211 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d9ffb-2dc2-463f-85a1-c355d02a52c8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:57.886272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 133/267] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:19:57 2022] GET /identity/v3/role_assignments?user.id=d1c12330f74c43b5855d0cbad814ddf1&scope.project.id=b99cf27cf22249fdb99befb43f95a1d6&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:57.899655 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa60a9-ca4e-435b-9b1b-74765d124a82 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:57.946216 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863e4fd-4675-4b0c-a7a3-d9e3472d9e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:57.947017 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863e4fd-4675-4b0c-a7a3-d9e3472d9e97 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:57.947290 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863e4fd-4675-4b0c-a7a3-d9e3472d9e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:57.947557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863e4fd-4675-4b0c-a7a3-d9e3472d9e97 None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:57.953033 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863e4fd-4675-4b0c-a7a3-d9e3472d9e97 None admin] RBAC: Authorizing `identity:get_project(project_id=b99cf27cf22249fdb99befb43f95a1d6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:57.954566 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863e4fd-4675-4b0c-a7a3-d9e3472d9e97 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:57.956771 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 135/268] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:57 2022] GET /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:57.963160 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d9ffb-2dc2-463f-85a1-c355d02a52c8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:58.098514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d9ffb-2dc2-463f-85a1-c355d02a52c8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:58.142676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8342d5-e67b-4b95-b078-08ebe8465597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:58.144128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8342d5-e67b-4b95-b078-08ebe8465597 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:58.144620 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8342d5-e67b-4b95-b078-08ebe8465597 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:58.145069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8342d5-e67b-4b95-b078-08ebe8465597 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:58.146476 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8342d5-e67b-4b95-b078-08ebe8465597 None admin] RBAC: Adding query filter params (role.id=60519d06a8c94e6c82462e5d79d9856b, scope.project.id=b99cf27cf22249fdb99befb43f95a1d6, user.id=d1c12330f74c43b5855d0cbad814ddf1) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:58.147053 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8342d5-e67b-4b95-b078-08ebe8465597 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:58.148981 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8342d5-e67b-4b95-b078-08ebe8465597 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:58.161291 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 134/269] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:19:57 2022] GET /identity/v3/role_assignments?user.id=d1c12330f74c43b5855d0cbad814ddf1&scope.project.id=b99cf27cf22249fdb99befb43f95a1d6&role.id=60519d06a8c94e6c82462e5d79d9856b => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:58.467538 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890b39a-dbad-411d-a625-8c006ddc394f None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:58.468623 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890b39a-dbad-411d-a625-8c006ddc394f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:58.469102 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890b39a-dbad-411d-a625-8c006ddc394f None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:58.470979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 136/270] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:58.477062 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38db06-6f17-45df-9838-5a69e3595191 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:58.477675 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38db06-6f17-45df-9838-5a69e3595191 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:58.478140 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38db06-6f17-45df-9838-5a69e3595191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:58.497366 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1a38db06-6f17-45df-9838-5a69e3595191 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:58.498934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1a38db06-6f17-45df-9838-5a69e3595191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:58.566969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:58.589379 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 135/271] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:58.611156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890b39a-dbad-411d-a625-8c006ddc394f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:58.620687 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:58.744398 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890b39a-dbad-411d-a625-8c006ddc394f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:58.778912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1cd6e-f396-48af-8223-5ce578ee6573 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:58.779270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1cd6e-f396-48af-8223-5ce578ee6573 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:58.779468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1cd6e-f396-48af-8223-5ce578ee6573 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:58.781402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 136/272] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:58.788427 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de29e90-e9a0-45f9-bf2e-c77bfa246475 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:58.788973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de29e90-e9a0-45f9-bf2e-c77bfa246475 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:58.789452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de29e90-e9a0-45f9-bf2e-c77bfa246475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:58.795741 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117ca42-5e0b-43f8-aa7a-642485ae2a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:58.797011 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117ca42-5e0b-43f8-aa7a-642485ae2a13 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:58.797011 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117ca42-5e0b-43f8-aa7a-642485ae2a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:58.797182 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117ca42-5e0b-43f8-aa7a-642485ae2a13 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:58.810441 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9de29e90-e9a0-45f9-bf2e-c77bfa246475 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:58.812074 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9de29e90-e9a0-45f9-bf2e-c77bfa246475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:58.816087 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117ca42-5e0b-43f8-aa7a-642485ae2a13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:58.823817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2117ca42-5e0b-43f8-aa7a-642485ae2a13 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:19:58.823817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:58.823817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:58.823817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:58.823817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:58.823817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:58.823817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:58.823817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:58.823817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:58.823817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:58.823817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:58.823817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:58.823817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:58.823817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:58.823817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:58.823817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:58.824811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:58.824811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:58.824811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:58.824811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:58.824811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:58.824811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:58.824811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:58.824811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:58.824811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:58.824811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:58.824811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:58.824811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:19:58.824811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:58.824811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:58.824811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:58.824811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:58.825625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:58.825625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:58.825625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:58.825625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:58.825625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:58.825625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:58.825625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:58.825625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:58.825625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:58.825625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:58.825625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:19:58.825625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:19:58.828411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 137/273] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:58.832484 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117ca42-5e0b-43f8-aa7a-642485ae2a13 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:58.898662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 137/274] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:58.900137 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d3c93-e653-4c7d-abfd-0d935f15f887 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:58.900431 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d3c93-e653-4c7d-abfd-0d935f15f887 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:58.900710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d3c93-e653-4c7d-abfd-0d935f15f887 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:58.902066 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 138/275] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:19:58.908638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c5bf8-c1ca-4897-b15f-4ed9ce415ec7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:58.908935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c5bf8-c1ca-4897-b15f-4ed9ce415ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:58.909528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c5bf8-c1ca-4897-b15f-4ed9ce415ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:58.920355 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:58.931812 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6d7c5bf8-c1ca-4897-b15f-4ed9ce415ec7 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:58.933035 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6d7c5bf8-c1ca-4897-b15f-4ed9ce415ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:19:58.951870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117ca42-5e0b-43f8-aa7a-642485ae2a13 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:58.988847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28ffa1-9d93-47a4-b263-203af90d312f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:58.989585 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28ffa1-9d93-47a4-b263-203af90d312f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:58.990315 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28ffa1-9d93-47a4-b263-203af90d312f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:58.990600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28ffa1-9d93-47a4-b263-203af90d312f None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:58.991338 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28ffa1-9d93-47a4-b263-203af90d312f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:58.991689 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28ffa1-9d93-47a4-b263-203af90d312f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:58.993355 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28ffa1-9d93-47a4-b263-203af90d312f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:59.007450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 138/276] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:19:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:59.007650 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 139/277] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:19:59.009190 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c5bf8-c1ca-4897-b15f-4ed9ce415ec7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:59.012162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28ffa1-9d93-47a4-b263-203af90d312f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:59.071091 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:59.130989 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c5bf8-c1ca-4897-b15f-4ed9ce415ec7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:59.138135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28ffa1-9d93-47a4-b263-203af90d312f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:59.164897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:59.173457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375cb33-187b-402c-bfa5-df6ae9a5b6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:59.174356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375cb33-187b-402c-bfa5-df6ae9a5b6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:59.174643 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375cb33-187b-402c-bfa5-df6ae9a5b6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:59.174913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375cb33-187b-402c-bfa5-df6ae9a5b6d6 None admin] PATH_INFO: `/v3/users/19b69619fcf542a8a54d9d3ed5d1010b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:59.175979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9842f89-9ce4-43f0-a742-8f24b8051a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:59.176126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375cb33-187b-402c-bfa5-df6ae9a5b6d6 None admin] RBAC: Authorizing `identity:get_user(user_id=19b69619fcf542a8a54d9d3ed5d1010b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:59.176879 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9842f89-9ce4-43f0-a742-8f24b8051a2b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:59.177165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9842f89-9ce4-43f0-a742-8f24b8051a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:59.177440 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9842f89-9ce4-43f0-a742-8f24b8051a2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:59.178124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375cb33-187b-402c-bfa5-df6ae9a5b6d6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:59.178625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9842f89-9ce4-43f0-a742-8f24b8051a2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:59.179918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 140/278] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:59 2022] GET /identity/v3/users/19b69619fcf542a8a54d9d3ed5d1010b => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:19:59.184782 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9842f89-9ce4-43f0-a742-8f24b8051a2b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:59.184886 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375cb33-187b-402c-bfa5-df6ae9a5b6d6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:59.184961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 139/279] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:19:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:59.186997 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9842f89-9ce4-43f0-a742-8f24b8051a2b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:59.294746 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375cb33-187b-402c-bfa5-df6ae9a5b6d6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:59.297693 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9842f89-9ce4-43f0-a742-8f24b8051a2b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:59.312342 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:59.331874 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4b7fb-5f46-4d32-b069-088fed8c2bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:59.332782 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4b7fb-5f46-4d32-b069-088fed8c2bfb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:59.332992 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18caca-1727-4eb6-ae8f-d4d9413666e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:59.333133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4b7fb-5f46-4d32-b069-088fed8c2bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:59.333360 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4b7fb-5f46-4d32-b069-088fed8c2bfb None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:59.333802 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18caca-1727-4eb6-ae8f-d4d9413666e8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:59.334354 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18caca-1727-4eb6-ae8f-d4d9413666e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:59.334792 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4b7fb-5f46-4d32-b069-088fed8c2bfb None admin] RBAC: Authorizing `identity:get_project(project_id=b99cf27cf22249fdb99befb43f95a1d6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:59.334904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18caca-1727-4eb6-ae8f-d4d9413666e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:59.336081 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4b7fb-5f46-4d32-b069-088fed8c2bfb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:59.338040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 140/280] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:19:59 2022] GET /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:59.338611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4b7fb-5f46-4d32-b069-088fed8c2bfb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:59.348173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18caca-1727-4eb6-ae8f-d4d9413666e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:19:59.356289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-3d18caca-1727-4eb6-ae8f-d4d9413666e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:19:59.356289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:19:59.356289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:19:59.356289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:19:59.356289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:19:59.356289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:19:59.356289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:19:59.356289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:19:59.356289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:19:59.356289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:19:59.356289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:19:59.356289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:19:59.356289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:19:59.356289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:19:59.356289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:19:59.356289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:19:59.357295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:19:59.357295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:19:59.357295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:19:59.357295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:19:59.357295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:19:59.357295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:19:59.357295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:19:59.357295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:19:59.357295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:19:59.357295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:19:59.357295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:19:59.357295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:19:59.357295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:19:59.357295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:19:59.357295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:19:59.357295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:19:59.358465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:19:59.358465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:19:59.358465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:19:59.358465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:19:59.358465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:19:59.358465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:19:59.358465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:19:59.358465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:19:59.358465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:19:59.358465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:19:59.358465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:19:59.358465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:19:59.358465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 141/281] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:19:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:19:59.359453 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18caca-1727-4eb6-ae8f-d4d9413666e8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:59.429941 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:59.478240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4b7fb-5f46-4d32-b069-088fed8c2bfb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:59.481938 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18caca-1727-4eb6-ae8f-d4d9413666e8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:59.517885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314d763-21c6-4367-ac13-f93ec60442af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:59.518327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfaa5f9-602e-49c3-9723-76108043885a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:59.519079 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314d763-21c6-4367-ac13-f93ec60442af None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:59.519215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaa5f9-602e-49c3-9723-76108043885a None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:59.519500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaa5f9-602e-49c3-9723-76108043885a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:59.519776 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaa5f9-602e-49c3-9723-76108043885a None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6/users/19b69619fcf542a8a54d9d3ed5d1010b/roles/63f594b5fbbe4eb7b69119f8afda416f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:59.520031 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314d763-21c6-4367-ac13-f93ec60442af None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:59.520666 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314d763-21c6-4367-ac13-f93ec60442af None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:59.521674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314d763-21c6-4367-ac13-f93ec60442af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:59.521865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaa5f9-602e-49c3-9723-76108043885a None admin] RBAC: Authorizing `identity:create_grant(project_id=b99cf27cf22249fdb99befb43f95a1d6, user_id=19b69619fcf542a8a54d9d3ed5d1010b, role_id=63f594b5fbbe4eb7b69119f8afda416f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:59.523353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaa5f9-602e-49c3-9723-76108043885a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:59.523672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314d763-21c6-4367-ac13-f93ec60442af None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:59.551698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 142/282] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:19:59 2022] PUT /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6/users/19b69619fcf542a8a54d9d3ed5d1010b/roles/63f594b5fbbe4eb7b69119f8afda416f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:19:59.551698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfaa5f9-602e-49c3-9723-76108043885a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:59.560450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 141/283] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 16:19:59 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:19:59.599669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:59.686969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfaa5f9-602e-49c3-9723-76108043885a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:59.734100 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562299f-5739-4643-a547-8dbb476ef898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:59.735182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562299f-5739-4643-a547-8dbb476ef898 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:59.735657 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562299f-5739-4643-a547-8dbb476ef898 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:59.736157 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562299f-5739-4643-a547-8dbb476ef898 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:59.737260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562299f-5739-4643-a547-8dbb476ef898 None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:19:59.737732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562299f-5739-4643-a547-8dbb476ef898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:59.739669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562299f-5739-4643-a547-8dbb476ef898 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:59.751350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 143/284] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:19:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:59.764253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314d763-21c6-4367-ac13-f93ec60442af None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:59.891362 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314d763-21c6-4367-ac13-f93ec60442af None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:19:59.912349 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:19:59.929924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e96723-c370-4841-ad7f-6eb14da2e90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:19:59.930824 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e96723-c370-4841-ad7f-6eb14da2e90a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:59.931103 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e96723-c370-4841-ad7f-6eb14da2e90a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:59.931398 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e96723-c370-4841-ad7f-6eb14da2e90a None admin] PATH_INFO: `/v3/users/020ec1fc2f86486fa1ccfc6324357241` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:59.947183 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e96723-c370-4841-ad7f-6eb14da2e90a None admin] RBAC: Authorizing `identity:get_user(user_id=020ec1fc2f86486fa1ccfc6324357241)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:19:59.948659 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e96723-c370-4841-ad7f-6eb14da2e90a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:19:59.950693 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 142/285] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:19:59 2022] GET /identity/v3/users/020ec1fc2f86486fa1ccfc6324357241 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:19:59.951273 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2c9cc-81cd-4c2f-8bb0-6fecf15d51e5 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:59.951563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2c9cc-81cd-4c2f-8bb0-6fecf15d51e5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:59.951838 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2c9cc-81cd-4c2f-8bb0-6fecf15d51e5 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:59.953357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 144/286] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:19:59.956814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e96723-c370-4841-ad7f-6eb14da2e90a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:19:59.959937 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c1d1-8c18-4918-9de9-a1dcfd1ee79e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:19:59.960257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c1d1-8c18-4918-9de9-a1dcfd1ee79e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:19:59.960534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c1d1-8c18-4918-9de9-a1dcfd1ee79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:19:59.981528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9bc4c1d1-8c18-4918-9de9-a1dcfd1ee79e None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:19:59.982719 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9bc4c1d1-8c18-4918-9de9-a1dcfd1ee79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:00.066088 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 145/287] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:19:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:20:00.091600 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4c1d1-8c18-4918-9de9-a1dcfd1ee79e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:00.096346 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e96723-c370-4841-ad7f-6eb14da2e90a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:00.134354 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:00.167100 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6aa81-11dd-4bcf-be54-9f90c0eb08fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:00.167772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6aa81-11dd-4bcf-be54-9f90c0eb08fc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:00.168101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6aa81-11dd-4bcf-be54-9f90c0eb08fc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:00.168371 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6aa81-11dd-4bcf-be54-9f90c0eb08fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:00.169206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6aa81-11dd-4bcf-be54-9f90c0eb08fc None admin] RBAC: Adding query filter params (role.id=91889a59745c4d8185400f69d84eb50e, user.id=020ec1fc2f86486fa1ccfc6324357241, scope.system=all) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:00.169516 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6aa81-11dd-4bcf-be54-9f90c0eb08fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:00.171016 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6aa81-11dd-4bcf-be54-9f90c0eb08fc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:00.184031 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 143/288] 10.222.0.41 () {56 vars in 1308 bytes} [Fri May 27 16:19:59 2022] GET /identity/v3/role_assignments?user.id=020ec1fc2f86486fa1ccfc6324357241&scope.system=all&role.id=91889a59745c4d8185400f69d84eb50e => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:00.243448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4c1d1-8c18-4918-9de9-a1dcfd1ee79e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:00.282623 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023a9ed-247d-4c5c-a322-f9897d19362f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:00.283462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023a9ed-247d-4c5c-a322-f9897d19362f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:00.283752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023a9ed-247d-4c5c-a322-f9897d19362f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:00.284051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023a9ed-247d-4c5c-a322-f9897d19362f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:00.297172 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023a9ed-247d-4c5c-a322-f9897d19362f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:00.305848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-7023a9ed-247d-4c5c-a322-f9897d19362f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:20:00.305848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:00.305848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:00.305848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:00.305848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:00.305848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:00.305848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:00.305848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:00.305848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:00.305848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:00.305848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:00.305848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:00.305848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:00.305848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:00.305848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:00.305848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:00.306824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:00.306824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:00.306824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:00.306824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:00.306824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:00.306824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:00.306824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:00.306824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:00.306824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:00.306824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:00.306824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:00.306824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:00.306824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:00.306824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:00.306824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:00.306824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:00.308115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:00.308115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:00.308115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:00.308115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:00.308115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:00.308115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:00.308115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:00.308115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:00.308115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:00.308115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:00.308115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:20:00.308115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:00.308115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 146/289] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:00.313374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6aa81-11dd-4bcf-be54-9f90c0eb08fc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:00.372420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:00.424508 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6aa81-11dd-4bcf-be54-9f90c0eb08fc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:00.461837 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888fb91-f1d5-4af3-8672-3b8f3db3ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:00.462529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888fb91-f1d5-4af3-8672-3b8f3db3ba84 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:00.462816 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888fb91-f1d5-4af3-8672-3b8f3db3ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:00.463089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888fb91-f1d5-4af3-8672-3b8f3db3ba84 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:00.464054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888fb91-f1d5-4af3-8672-3b8f3db3ba84 None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:00.464247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888fb91-f1d5-4af3-8672-3b8f3db3ba84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:00.465799 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888fb91-f1d5-4af3-8672-3b8f3db3ba84 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:00.476513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 144/290] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:20:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:00.482246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023a9ed-247d-4c5c-a322-f9897d19362f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:00.582958 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:00.603075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023a9ed-247d-4c5c-a322-f9897d19362f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:00.641645 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6faab09-7d49-4fef-918c-0697914ccd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:00.642581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faab09-7d49-4fef-918c-0697914ccd5a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:00.642870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faab09-7d49-4fef-918c-0697914ccd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:00.643148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6faab09-7d49-4fef-918c-0697914ccd5a None admin] PATH_INFO: `/v3/users/4188c7076ecb48fd8afa06bcba102902` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:00.644389 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6faab09-7d49-4fef-918c-0697914ccd5a None admin] RBAC: Authorizing `identity:get_user(user_id=4188c7076ecb48fd8afa06bcba102902)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:00.646177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6faab09-7d49-4fef-918c-0697914ccd5a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:00.647829 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 147/291] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:20:00 2022] GET /identity/v3/users/4188c7076ecb48fd8afa06bcba102902 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:00.653555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888fb91-f1d5-4af3-8672-3b8f3db3ba84 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:00.758059 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888fb91-f1d5-4af3-8672-3b8f3db3ba84 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:00.760481 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:00.794334 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6e985-51bb-4c76-83f0-70d995133353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:00.795003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6e985-51bb-4c76-83f0-70d995133353 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:00.795291 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6e985-51bb-4c76-83f0-70d995133353 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:00.795689 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6e985-51bb-4c76-83f0-70d995133353 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:00.867510 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6e985-51bb-4c76-83f0-70d995133353 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:00.869090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6e985-51bb-4c76-83f0-70d995133353 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:00.977738 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 145/292] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:00.983374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6faab09-7d49-4fef-918c-0697914ccd5a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:01.121748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6faab09-7d49-4fef-918c-0697914ccd5a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:01.178421 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7f9f8-f901-4bbf-8aed-a3100d8cdab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:01.179332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7f9f8-f901-4bbf-8aed-a3100d8cdab8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:01.179615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7f9f8-f901-4bbf-8aed-a3100d8cdab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:01.179887 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7f9f8-f901-4bbf-8aed-a3100d8cdab8 None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:01.184803 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7f9f8-f901-4bbf-8aed-a3100d8cdab8 None admin] RBAC: Authorizing `identity:get_project(project_id=b99cf27cf22249fdb99befb43f95a1d6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:01.186300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7f9f8-f901-4bbf-8aed-a3100d8cdab8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:01.188360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 148/293] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:20:00 2022] GET /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:01.194414 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6e985-51bb-4c76-83f0-70d995133353 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:01.197676 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:01.376703 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6e985-51bb-4c76-83f0-70d995133353 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:01.434582 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10d810-9e9b-4a1a-84dd-00695c1674dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:01.435266 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10d810-9e9b-4a1a-84dd-00695c1674dd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:01.435551 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10d810-9e9b-4a1a-84dd-00695c1674dd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:01.435828 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10d810-9e9b-4a1a-84dd-00695c1674dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:01.436720 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10d810-9e9b-4a1a-84dd-00695c1674dd None admin] RBAC: Adding query filter params (role.id=91889a59745c4d8185400f69d84eb50e, scope.project.id=b99cf27cf22249fdb99befb43f95a1d6, user.id=4188c7076ecb48fd8afa06bcba102902) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:01.437032 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10d810-9e9b-4a1a-84dd-00695c1674dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:01.438551 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10d810-9e9b-4a1a-84dd-00695c1674dd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:01.449564 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 146/294] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:20:01 2022] GET /identity/v3/role_assignments?user.id=4188c7076ecb48fd8afa06bcba102902&scope.project.id=b99cf27cf22249fdb99befb43f95a1d6&role.id=91889a59745c4d8185400f69d84eb50e => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:02.183648 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63821ac2-56ed-424e-83a1-c12fd32b9525 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:02.184187 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63821ac2-56ed-424e-83a1-c12fd32b9525 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:02.184298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63821ac2-56ed-424e-83a1-c12fd32b9525 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:02.185667 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 149/295] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:02.191502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb673d59-8ec8-456f-b06e-369649e0f288 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:02.191939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb673d59-8ec8-456f-b06e-369649e0f288 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:02.192085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb673d59-8ec8-456f-b06e-369649e0f288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:02.214553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-eb673d59-8ec8-456f-b06e-369649e0f288 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:02.216045 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-eb673d59-8ec8-456f-b06e-369649e0f288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:02.299285 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 147/296] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:02.300389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:02.322594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63821ac2-56ed-424e-83a1-c12fd32b9525 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:02.349574 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:02.433946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63821ac2-56ed-424e-83a1-c12fd32b9525 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:02.465528 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c110ff3-5b75-4ffc-b381-6434492f4cc0 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:02.466182 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c110ff3-5b75-4ffc-b381-6434492f4cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:02.466657 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c110ff3-5b75-4ffc-b381-6434492f4cc0 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:02.468606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 148/297] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:02.475042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cb6b6-c433-4a5e-a73c-e3c06fa6c3bb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:02.475519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cb6b6-c433-4a5e-a73c-e3c06fa6c3bb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:02.476000 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cb6b6-c433-4a5e-a73c-e3c06fa6c3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:02.476844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda01c07-af60-40ca-9290-66cc34062f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:02.477669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01c07-af60-40ca-9290-66cc34062f58 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:02.477955 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01c07-af60-40ca-9290-66cc34062f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:02.478238 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda01c07-af60-40ca-9290-66cc34062f58 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:02.490438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda01c07-af60-40ca-9290-66cc34062f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:02.495088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-695cb6b6-c433-4a5e-a73c-e3c06fa6c3bb None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:02.496600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-695cb6b6-c433-4a5e-a73c-e3c06fa6c3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:02.498362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-bda01c07-af60-40ca-9290-66cc34062f58 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:20:02.498362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:02.498362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:02.498362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:02.498362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:02.498362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:02.498362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:02.498362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:02.498362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:02.498362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:02.498362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:02.498362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:02.498362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:02.498362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:02.498362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:02.498362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:02.499580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:02.499580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:02.499580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:02.499580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:02.499580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:02.499580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:02.499580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:02.499580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:02.499580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:02.499580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:02.499580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:02.499580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:02.499580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:02.499580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:02.499580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:02.499580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:02.500612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:02.500612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:02.500612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:02.500612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:02.500612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:02.500612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:02.500612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:02.500612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:02.500612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:02.500612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:02.500612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:20:02.500612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:02.500612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 150/298] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:02.508203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda01c07-af60-40ca-9290-66cc34062f58 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:02.588043 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 149/299] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:20:02.604991 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cb6b6-c433-4a5e-a73c-e3c06fa6c3bb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:02.626532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:02.646784 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda01c07-af60-40ca-9290-66cc34062f58 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:02.684765 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cdfb74-34be-4ccc-9a0e-981f7e54186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:02.685350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdfb74-34be-4ccc-9a0e-981f7e54186e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:02.685633 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdfb74-34be-4ccc-9a0e-981f7e54186e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:02.685906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdfb74-34be-4ccc-9a0e-981f7e54186e None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:02.686654 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cdfb74-34be-4ccc-9a0e-981f7e54186e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:02.686959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cdfb74-34be-4ccc-9a0e-981f7e54186e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:02.688890 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cdfb74-34be-4ccc-9a0e-981f7e54186e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:02.699068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 151/300] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:20:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:02.700425 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa99d19-6c0e-405f-8037-e21dc6b2d2d8 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:02.700716 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa99d19-6c0e-405f-8037-e21dc6b2d2d8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:02.700997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa99d19-6c0e-405f-8037-e21dc6b2d2d8 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:02.706957 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 152/301] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:02.706957 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa99d19-6c0e-405f-8037-e21dc6b2d2d8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:02.717689 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cb6b6-c433-4a5e-a73c-e3c06fa6c3bb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:02.747043 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:02.756452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e751c40-37f9-405d-a374-ab434c04db4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:02.757278 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e751c40-37f9-405d-a374-ab434c04db4a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:02.757735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e751c40-37f9-405d-a374-ab434c04db4a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:02.758017 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e751c40-37f9-405d-a374-ab434c04db4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:02.759711 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e751c40-37f9-405d-a374-ab434c04db4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:02.761500 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e751c40-37f9-405d-a374-ab434c04db4a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:02.768078 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 150/302] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:02.768078 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed416ce-8469-4eaa-bde9-b10da5175d55 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:02.768078 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed416ce-8469-4eaa-bde9-b10da5175d55 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:02.768078 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed416ce-8469-4eaa-bde9-b10da5175d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:02.789869 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4ed416ce-8469-4eaa-bde9-b10da5175d55 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:02.791494 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4ed416ce-8469-4eaa-bde9-b10da5175d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:02.820449 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa99d19-6c0e-405f-8037-e21dc6b2d2d8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:02.863236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473e046-8e5f-4aba-83ad-a28899e0ef30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:02.864224 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473e046-8e5f-4aba-83ad-a28899e0ef30 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:02.864708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473e046-8e5f-4aba-83ad-a28899e0ef30 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:02.864994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473e046-8e5f-4aba-83ad-a28899e0ef30 None admin] PATH_INFO: `/v3/users/19b69619fcf542a8a54d9d3ed5d1010b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:02.866057 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473e046-8e5f-4aba-83ad-a28899e0ef30 None admin] RBAC: Authorizing `identity:get_user(user_id=19b69619fcf542a8a54d9d3ed5d1010b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:02.867530 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473e046-8e5f-4aba-83ad-a28899e0ef30 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:02.877753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 151/303] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:02.877943 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 153/304] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:20:02 2022] GET /identity/v3/users/19b69619fcf542a8a54d9d3ed5d1010b => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:02.878026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed416ce-8469-4eaa-bde9-b10da5175d55 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:02.878097 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473e046-8e5f-4aba-83ad-a28899e0ef30 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:02.893313 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:02.994695 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473e046-8e5f-4aba-83ad-a28899e0ef30 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:03.001770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed416ce-8469-4eaa-bde9-b10da5175d55 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:03.032494 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:03.037719 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039148b2-0c70-42a5-aff2-f715b436842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:03.038562 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039148b2-0c70-42a5-aff2-f715b436842e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:03.038848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039148b2-0c70-42a5-aff2-f715b436842e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:03.039119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039148b2-0c70-42a5-aff2-f715b436842e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:03.044253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3308ba4-22b9-43e4-941b-39182e2456f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:03.044936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3308ba4-22b9-43e4-941b-39182e2456f5 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:03.045229 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3308ba4-22b9-43e4-941b-39182e2456f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:03.045492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3308ba4-22b9-43e4-941b-39182e2456f5 None admin] PATH_INFO: `/v3/groups` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:03.046173 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3308ba4-22b9-43e4-941b-39182e2456f5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:03.047793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3308ba4-22b9-43e4-941b-39182e2456f5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:03.065788 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 152/305] 10.222.0.41 () {60 vars in 1134 bytes} [Fri May 27 16:20:02 2022] POST /identity/v3/groups => generated 229 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:20:03.066621 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3308ba4-22b9-43e4-941b-39182e2456f5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:03.156142 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039148b2-0c70-42a5-aff2-f715b436842e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:03.158096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039148b2-0c70-42a5-aff2-f715b436842e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:03.177602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:03.186346 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3308ba4-22b9-43e4-941b-39182e2456f5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:03.225244 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c592576e-c96d-42cc-a806-2d57d1c099ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:03.226161 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592576e-c96d-42cc-a806-2d57d1c099ec None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:03.226340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592576e-c96d-42cc-a806-2d57d1c099ec None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:03.226616 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c592576e-c96d-42cc-a806-2d57d1c099ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:03.239046 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c592576e-c96d-42cc-a806-2d57d1c099ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:03.249448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c592576e-c96d-42cc-a806-2d57d1c099ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:20:03.249448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:03.249448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:03.249448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:03.249448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:03.249448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:03.249448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:03.249448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:03.249448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:03.249448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:03.249448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:03.249448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:03.249448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:03.249448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:03.249448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:03.249448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:03.250429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:03.250429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:03.250429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:03.250429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:03.250429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:03.250429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:03.250429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:03.250429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:03.250429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:03.250429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:03.250429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:03.250429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:03.250429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:03.250429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:03.250429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:03.250429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:03.251335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:03.251335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:03.251335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:03.251335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:03.251335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:03.251335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:03.251335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:03.251335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:03.251335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:03.251335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:03.251335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:20:03.251335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:03.251335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 153/306] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:03.258392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c1e6a-376c-45d4-96b4-6be311010a48 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:03.258971 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c1e6a-376c-45d4-96b4-6be311010a48 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:03.259258 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c1e6a-376c-45d4-96b4-6be311010a48 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:03.265126 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 154/307] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:03 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:03.265126 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c1e6a-376c-45d4-96b4-6be311010a48 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:03.279552 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 154/308] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 16:20:03.280686 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033de535-a788-41d8-b371-5b3b346d421c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:03.280973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033de535-a788-41d8-b371-5b3b346d421c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:03.281249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033de535-a788-41d8-b371-5b3b346d421c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:03.303279 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-033de535-a788-41d8-b371-5b3b346d421c None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:03.304506 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-033de535-a788-41d8-b371-5b3b346d421c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:03.329016 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:03.382449 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 155/309] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:03.383454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033de535-a788-41d8-b371-5b3b346d421c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:03.394530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c1e6a-376c-45d4-96b4-6be311010a48 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:03.429567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7bdc9-6cea-4334-8040-1da8f3cf65e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:03.430555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7bdc9-6cea-4334-8040-1da8f3cf65e3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:03.431018 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7bdc9-6cea-4334-8040-1da8f3cf65e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:03.431506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7bdc9-6cea-4334-8040-1da8f3cf65e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:03.432468 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7bdc9-6cea-4334-8040-1da8f3cf65e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:03.432949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7bdc9-6cea-4334-8040-1da8f3cf65e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:03.434544 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7bdc9-6cea-4334-8040-1da8f3cf65e3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:03.435340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:03.448023 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 155/310] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:20:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:03.448023 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7bdc9-6cea-4334-8040-1da8f3cf65e3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:03.499987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033de535-a788-41d8-b371-5b3b346d421c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:03.537118 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258ce4d-02db-443b-a0bf-3371d553c0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:03.538009 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258ce4d-02db-443b-a0bf-3371d553c0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:03.538274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258ce4d-02db-443b-a0bf-3371d553c0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:03.538546 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258ce4d-02db-443b-a0bf-3371d553c0b6 None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:03.539731 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258ce4d-02db-443b-a0bf-3371d553c0b6 None admin] RBAC: Authorizing `identity:get_project(project_id=b99cf27cf22249fdb99befb43f95a1d6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:03.541222 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258ce4d-02db-443b-a0bf-3371d553c0b6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:03.542912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 156/311] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:20:03 2022] GET /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:03.543669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258ce4d-02db-443b-a0bf-3371d553c0b6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:03.559330 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7bdc9-6cea-4334-8040-1da8f3cf65e3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:03.569888 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:03.602485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baa907-cd8d-42d1-8382-775816339836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:03.603291 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baa907-cd8d-42d1-8382-775816339836 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:03.603567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baa907-cd8d-42d1-8382-775816339836 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:03.603914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baa907-cd8d-42d1-8382-775816339836 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:03.614534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7baa907-cd8d-42d1-8382-775816339836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:03.622507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d7baa907-cd8d-42d1-8382-775816339836 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:20:03.622507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:03.622507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:03.622507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:03.622507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:03.622507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:03.622507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:03.622507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:03.622507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:03.622507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:03.622507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:03.622507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:03.622507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:03.622507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:03.622507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:03.622507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:03.623456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:03.623456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:03.623456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:03.623456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:03.623456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:03.623456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:03.623456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:03.623456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:03.623456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:03.623456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:03.623456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:03.623456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:03.623456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:03.623456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:03.623456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:03.623456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:03.624979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:03.624979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:03.624979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:03.624979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:03.624979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:03.624979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:03.624979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:03.624979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:03.624979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:03.624979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:03.624979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:20:03.624979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:03.624979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 156/312] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:03.624979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baa907-cd8d-42d1-8382-775816339836 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:03.651285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258ce4d-02db-443b-a0bf-3371d553c0b6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:03.665800 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:03.688350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8bbfa-a320-46f8-a330-2c5ca800db7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:03.689185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8bbfa-a320-46f8-a330-2c5ca800db7d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:03.689486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8bbfa-a320-46f8-a330-2c5ca800db7d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:03.689738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8bbfa-a320-46f8-a330-2c5ca800db7d None admin] PATH_INFO: `/v3/users/6579c0e03b424ddb9e41f34991a0fa59` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:03.704200 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8bbfa-a320-46f8-a330-2c5ca800db7d None admin] RBAC: Authorizing `identity:get_user(user_id=6579c0e03b424ddb9e41f34991a0fa59)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:03.706172 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8bbfa-a320-46f8-a330-2c5ca800db7d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:03.708373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 157/313] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:20:03 2022] GET /identity/v3/users/6579c0e03b424ddb9e41f34991a0fa59 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:03.709001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8bbfa-a320-46f8-a330-2c5ca800db7d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:03.743970 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baa907-cd8d-42d1-8382-775816339836 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:03.779157 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932635df-4862-4ade-83ca-5a9a3a8ec9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:03.779746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932635df-4862-4ade-83ca-5a9a3a8ec9be None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:03.780047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932635df-4862-4ade-83ca-5a9a3a8ec9be None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:03.780329 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932635df-4862-4ade-83ca-5a9a3a8ec9be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:03.781197 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932635df-4862-4ade-83ca-5a9a3a8ec9be None admin] RBAC: Adding query filter params (role.id=63f594b5fbbe4eb7b69119f8afda416f, scope.project.id=b99cf27cf22249fdb99befb43f95a1d6, user.id=19b69619fcf542a8a54d9d3ed5d1010b) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:03.781508 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932635df-4862-4ade-83ca-5a9a3a8ec9be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:03.782996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932635df-4862-4ade-83ca-5a9a3a8ec9be None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:03.789350 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 157/314] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:20:03 2022] GET /identity/v3/role_assignments?user.id=19b69619fcf542a8a54d9d3ed5d1010b&scope.project.id=b99cf27cf22249fdb99befb43f95a1d6&role.id=63f594b5fbbe4eb7b69119f8afda416f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:03.790155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932635df-4862-4ade-83ca-5a9a3a8ec9be None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:03.824533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:03.842880 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8bbfa-a320-46f8-a330-2c5ca800db7d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:03.892150 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef1cf6-1041-4192-9777-e829dedaa87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:03.893022 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef1cf6-1041-4192-9777-e829dedaa87c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:03.893159 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef1cf6-1041-4192-9777-e829dedaa87c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:03.893417 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef1cf6-1041-4192-9777-e829dedaa87c None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:03.894182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef1cf6-1041-4192-9777-e829dedaa87c None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:03.894490 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef1cf6-1041-4192-9777-e829dedaa87c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:03.896039 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef1cf6-1041-4192-9777-e829dedaa87c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:03.905814 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 158/315] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:20:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:03.911499 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef1cf6-1041-4192-9777-e829dedaa87c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:03.920738 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932635df-4862-4ade-83ca-5a9a3a8ec9be None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:03.950408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:03.958568 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1c7d1-d3ca-458c-acf7-9feb35722242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:03.959028 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1c7d1-d3ca-458c-acf7-9feb35722242 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:03.959309 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1c7d1-d3ca-458c-acf7-9feb35722242 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:03.959582 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1c7d1-d3ca-458c-acf7-9feb35722242 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:03.960463 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1c7d1-d3ca-458c-acf7-9feb35722242 None admin] RBAC: Adding query filter params (role.id=63f594b5fbbe4eb7b69119f8afda416f, user.id=6579c0e03b424ddb9e41f34991a0fa59, scope.system=all) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:03.960774 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1c7d1-d3ca-458c-acf7-9feb35722242 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:03.962274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1c7d1-d3ca-458c-acf7-9feb35722242 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:03.968406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 158/316] 10.222.0.41 () {56 vars in 1308 bytes} [Fri May 27 16:20:03 2022] GET /identity/v3/role_assignments?user.id=6579c0e03b424ddb9e41f34991a0fa59&scope.system=all&role.id=63f594b5fbbe4eb7b69119f8afda416f => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:04.046016 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef1cf6-1041-4192-9777-e829dedaa87c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:04.086676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff127ee-b6a2-41f1-99bd-406ef4cdaa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:04.087590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff127ee-b6a2-41f1-99bd-406ef4cdaa43 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:04.087871 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff127ee-b6a2-41f1-99bd-406ef4cdaa43 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:04.088176 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff127ee-b6a2-41f1-99bd-406ef4cdaa43 None admin] PATH_INFO: `/v3/users/020ec1fc2f86486fa1ccfc6324357241` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:04.089465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff127ee-b6a2-41f1-99bd-406ef4cdaa43 None admin] RBAC: Authorizing `identity:get_user(user_id=020ec1fc2f86486fa1ccfc6324357241)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:04.091072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff127ee-b6a2-41f1-99bd-406ef4cdaa43 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:04.093227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 159/317] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:20:03 2022] GET /identity/v3/users/020ec1fc2f86486fa1ccfc6324357241 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:04.098868 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1c7d1-d3ca-458c-acf7-9feb35722242 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:04.206098 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:04.213564 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1c7d1-d3ca-458c-acf7-9feb35722242 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:04.252311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2ecda-766a-466c-9f17-cfc86f865b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:04.253255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2ecda-766a-466c-9f17-cfc86f865b97 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:04.253535 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2ecda-766a-466c-9f17-cfc86f865b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:04.253807 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2ecda-766a-466c-9f17-cfc86f865b97 None admin] PATH_INFO: `/v3/system/users/020ec1fc2f86486fa1ccfc6324357241/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:04.255580 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2ecda-766a-466c-9f17-cfc86f865b97 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=020ec1fc2f86486fa1ccfc6324357241, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:04.257027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a2ecda-766a-466c-9f17-cfc86f865b97 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:04.268346 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 159/318] 10.222.0.41 () {58 vars in 1334 bytes} [Fri May 27 16:20:04 2022] PUT /identity/v3/system/users/020ec1fc2f86486fa1ccfc6324357241/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:20:05.358300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f20e38-c298-496a-bef6-9a1b622eef69 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:05.358927 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f20e38-c298-496a-bef6-9a1b622eef69 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:05.358927 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f20e38-c298-496a-bef6-9a1b622eef69 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:05.360226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 160/319] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:05.365944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b090482-2c5c-471e-9a8b-e4aaf274e92d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:05.366493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b090482-2c5c-471e-9a8b-e4aaf274e92d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:05.366493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b090482-2c5c-471e-9a8b-e4aaf274e92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:05.385776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8b090482-2c5c-471e-9a8b-e4aaf274e92d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:05.386997 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8b090482-2c5c-471e-9a8b-e4aaf274e92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:05.463423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 160/320] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:05.486852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f20e38-c298-496a-bef6-9a1b622eef69 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:05.618405 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:05.623355 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f20e38-c298-496a-bef6-9a1b622eef69 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:05.661768 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c439bcc-dbf4-4f73-abbd-5b65d3d7c158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:05.662664 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c439bcc-dbf4-4f73-abbd-5b65d3d7c158 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:05.662861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c439bcc-dbf4-4f73-abbd-5b65d3d7c158 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:05.663137 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c439bcc-dbf4-4f73-abbd-5b65d3d7c158 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:05.664406 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c439bcc-dbf4-4f73-abbd-5b65d3d7c158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:05.665882 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c439bcc-dbf4-4f73-abbd-5b65d3d7c158 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:05.667682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 161/321] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:05.673347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b090482-2c5c-471e-9a8b-e4aaf274e92d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:05.777124 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:05.790113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b090482-2c5c-471e-9a8b-e4aaf274e92d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:05.827037 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfa0ba-5f69-45db-9f58-b30aeab84ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:05.827715 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfa0ba-5f69-45db-9f58-b30aeab84ebe None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:05.827999 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfa0ba-5f69-45db-9f58-b30aeab84ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:05.828299 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfa0ba-5f69-45db-9f58-b30aeab84ebe None admin] PATH_INFO: `/v3/groups` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:05.828991 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfa0ba-5f69-45db-9f58-b30aeab84ebe None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:05.830816 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfa0ba-5f69-45db-9f58-b30aeab84ebe None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:05.856039 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 161/322] 10.222.0.41 () {60 vars in 1134 bytes} [Fri May 27 16:20:05 2022] POST /identity/v3/groups => generated 226 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:20:06.189540 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5666e8-16b9-4869-86cd-e43e00704a44 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:06.189940 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5666e8-16b9-4869-86cd-e43e00704a44 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:06.190119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5666e8-16b9-4869-86cd-e43e00704a44 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:06.191761 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 162/323] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:06.197901 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aebd2b-c380-45d7-9a45-cfc9a554d332 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:06.198205 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aebd2b-c380-45d7-9a45-cfc9a554d332 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:06.198451 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aebd2b-c380-45d7-9a45-cfc9a554d332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:06.216960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c9aebd2b-c380-45d7-9a45-cfc9a554d332 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:06.218164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c9aebd2b-c380-45d7-9a45-cfc9a554d332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:06.300555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 162/324] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:20:06.328102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5666e8-16b9-4869-86cd-e43e00704a44 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:06.457556 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5666e8-16b9-4869-86cd-e43e00704a44 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:06.498179 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c288c7-2b19-4a2f-b94e-bd33e4211f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:06.499399 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c288c7-2b19-4a2f-b94e-bd33e4211f6c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:06.499899 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c288c7-2b19-4a2f-b94e-bd33e4211f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:06.500400 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c288c7-2b19-4a2f-b94e-bd33e4211f6c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:06.509829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d58a5-e133-4f27-826c-f3be4d5baa19 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:06.510379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d58a5-e133-4f27-826c-f3be4d5baa19 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:06.510379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d58a5-e133-4f27-826c-f3be4d5baa19 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:06.513416 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 163/325] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:06.515291 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c288c7-2b19-4a2f-b94e-bd33e4211f6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:06.517880 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f3251-095e-4f93-b1d4-530eb0820a25 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:06.518169 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f3251-095e-4f93-b1d4-530eb0820a25 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:06.518449 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f3251-095e-4f93-b1d4-530eb0820a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:06.525407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-21c288c7-2b19-4a2f-b94e-bd33e4211f6c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:20:06.525407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:06.525407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:06.525407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:06.525407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:06.525407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:06.525407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:06.525407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:06.525407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:06.525407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:06.525407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:06.525407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:06.525407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:06.525407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:06.525407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:06.525407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:06.526407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:06.526407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:06.526407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:06.526407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:06.526407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:06.526407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:06.526407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:06.526407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:06.526407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:06.526407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:06.526407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:06.526407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:06.526407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:06.526407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:06.526407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:06.526407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:06.527299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:06.527299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:06.527299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:06.527299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:06.527299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:06.527299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:06.527299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:06.527299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:06.527299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:06.527299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:06.527299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:20:06.527299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:06.529830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 163/326] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:06.537562 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c288c7-2b19-4a2f-b94e-bd33e4211f6c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:06.538331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d11f3251-095e-4f93-b1d4-530eb0820a25 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:06.539580 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d11f3251-095e-4f93-b1d4-530eb0820a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:06.570435 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:06.624229 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 164/327] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:20:06.652847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f3251-095e-4f93-b1d4-530eb0820a25 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:06.670843 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:06.682194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c288c7-2b19-4a2f-b94e-bd33e4211f6c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:06.723016 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4fe8a-9e15-4dc5-90ce-abeb509b9d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:06.724190 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4fe8a-9e15-4dc5-90ce-abeb509b9d99 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:06.724683 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4fe8a-9e15-4dc5-90ce-abeb509b9d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:06.725182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4fe8a-9e15-4dc5-90ce-abeb509b9d99 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:06.726198 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4fe8a-9e15-4dc5-90ce-abeb509b9d99 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:06.726741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4fe8a-9e15-4dc5-90ce-abeb509b9d99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:06.728429 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4fe8a-9e15-4dc5-90ce-abeb509b9d99 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:06.738931 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 164/328] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:20:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:06.745528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4fe8a-9e15-4dc5-90ce-abeb509b9d99 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:06.787755 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f3251-095e-4f93-b1d4-530eb0820a25 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:06.831105 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ddc6f-8dcd-4d98-a473-548b6f25e3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:06.831940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ddc6f-8dcd-4d98-a473-548b6f25e3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:06.832247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ddc6f-8dcd-4d98-a473-548b6f25e3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:06.832518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ddc6f-8dcd-4d98-a473-548b6f25e3a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:06.851803 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:06.860696 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ddc6f-8dcd-4d98-a473-548b6f25e3a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:06.863380 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4fe8a-9e15-4dc5-90ce-abeb509b9d99 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:06.869428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-bf7ddc6f-8dcd-4d98-a473-548b6f25e3a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:20:06.869428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:06.869428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:06.869428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:06.869428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:06.869428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:06.869428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:06.869428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:06.869428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:06.869428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:06.869428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:06.869428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:06.869428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:06.869428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:06.869428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:06.869428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:06.870395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:06.870395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:06.870395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:06.870395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:06.870395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:06.870395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:06.870395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:06.870395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:06.870395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:06.870395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:06.870395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:06.870395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:06.870395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:06.870395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:06.870395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:06.870395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:06.876227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:06.876227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:06.876227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:06.876227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:06.876227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:06.876227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:06.876227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:06.876227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:06.876227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:06.876227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:06.876227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:20:06.876227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:06.876227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 165/329] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:06.888869 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ddc6f-8dcd-4d98-a473-548b6f25e3a5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:06.934035 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a3aa6-041c-4685-9394-12dc133b9507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:06.934940 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a3aa6-041c-4685-9394-12dc133b9507 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:06.935217 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a3aa6-041c-4685-9394-12dc133b9507 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:06.935484 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a3aa6-041c-4685-9394-12dc133b9507 None admin] PATH_INFO: `/v3/users/6579c0e03b424ddb9e41f34991a0fa59` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:06.940206 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a3aa6-041c-4685-9394-12dc133b9507 None admin] RBAC: Authorizing `identity:get_user(user_id=6579c0e03b424ddb9e41f34991a0fa59)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:06.941679 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a3aa6-041c-4685-9394-12dc133b9507 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:06.943862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 165/330] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:20:06 2022] GET /identity/v3/users/6579c0e03b424ddb9e41f34991a0fa59 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:06.949859 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a3aa6-041c-4685-9394-12dc133b9507 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:07.008358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:07.042887 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ddc6f-8dcd-4d98-a473-548b6f25e3a5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:07.080682 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb81dd-40ed-405d-9682-abc00a48b734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:07.081807 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb81dd-40ed-405d-9682-abc00a48b734 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:07.082300 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb81dd-40ed-405d-9682-abc00a48b734 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:07.082808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb81dd-40ed-405d-9682-abc00a48b734 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:07.084404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb81dd-40ed-405d-9682-abc00a48b734 None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:07.085038 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb81dd-40ed-405d-9682-abc00a48b734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:07.087744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb81dd-40ed-405d-9682-abc00a48b734 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:07.112609 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 166/331] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:20:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:07.135108 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb81dd-40ed-405d-9682-abc00a48b734 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:07.190615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a3aa6-041c-4685-9394-12dc133b9507 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:07.268245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f2bf6-d35b-4c20-8a4c-7e7cf768aac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:07.269543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f2bf6-d35b-4c20-8a4c-7e7cf768aac7 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:07.270032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f2bf6-d35b-4c20-8a4c-7e7cf768aac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:07.270696 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f2bf6-d35b-4c20-8a4c-7e7cf768aac7 None admin] PATH_INFO: `/v3/system/users/6579c0e03b424ddb9e41f34991a0fa59/roles/63f594b5fbbe4eb7b69119f8afda416f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:07.276841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f2bf6-d35b-4c20-8a4c-7e7cf768aac7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6579c0e03b424ddb9e41f34991a0fa59, role_id=63f594b5fbbe4eb7b69119f8afda416f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:07.278622 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f2bf6-d35b-4c20-8a4c-7e7cf768aac7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:07.294358 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 166/332] 10.222.0.41 () {58 vars in 1334 bytes} [Fri May 27 16:20:06 2022] PUT /identity/v3/system/users/6579c0e03b424ddb9e41f34991a0fa59/roles/63f594b5fbbe4eb7b69119f8afda416f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:20:07.295499 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb81dd-40ed-405d-9682-abc00a48b734 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:07.337466 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:07.341797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524528f-468e-47f1-965e-eccfbca95f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:07.342885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524528f-468e-47f1-965e-eccfbca95f28 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:07.343181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524528f-468e-47f1-965e-eccfbca95f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:07.343516 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524528f-468e-47f1-965e-eccfbca95f28 None admin] PATH_INFO: `/v3/users/020ec1fc2f86486fa1ccfc6324357241` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:07.347880 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524528f-468e-47f1-965e-eccfbca95f28 None admin] RBAC: Authorizing `identity:get_user(user_id=020ec1fc2f86486fa1ccfc6324357241)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:07.350326 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524528f-468e-47f1-965e-eccfbca95f28 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:07.352690 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 167/333] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:20:07 2022] GET /identity/v3/users/020ec1fc2f86486fa1ccfc6324357241 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:07.358244 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f2bf6-d35b-4c20-8a4c-7e7cf768aac7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:07.408118 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:07.517750 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f2bf6-d35b-4c20-8a4c-7e7cf768aac7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:07.559420 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c378e6-50c1-4c71-8a0d-e3ddf9995f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:07.560063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c378e6-50c1-4c71-8a0d-e3ddf9995f3d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:07.560342 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c378e6-50c1-4c71-8a0d-e3ddf9995f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:07.560620 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c378e6-50c1-4c71-8a0d-e3ddf9995f3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:07.561482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c378e6-50c1-4c71-8a0d-e3ddf9995f3d None admin] RBAC: Adding query filter params (role.id=91889a59745c4d8185400f69d84eb50e, user.id=020ec1fc2f86486fa1ccfc6324357241, scope.system=all) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:07.561804 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c378e6-50c1-4c71-8a0d-e3ddf9995f3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:07.563313 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c378e6-50c1-4c71-8a0d-e3ddf9995f3d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:07.581355 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 167/334] 10.222.0.41 () {56 vars in 1308 bytes} [Fri May 27 16:20:07 2022] GET /identity/v3/role_assignments?user.id=020ec1fc2f86486fa1ccfc6324357241&scope.system=all&role.id=91889a59745c4d8185400f69d84eb50e => generated 510 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:08.497296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8c7f0-517f-4188-856f-10f57efe3eb1 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:08.497978 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8c7f0-517f-4188-856f-10f57efe3eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:08.497978 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8c7f0-517f-4188-856f-10f57efe3eb1 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:08.499217 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 168/335] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:08.518097 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d594d-53e9-464e-832e-553f1862649b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:08.518622 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d594d-53e9-464e-832e-553f1862649b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:08.518622 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d594d-53e9-464e-832e-553f1862649b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:08.540565 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e18d594d-53e9-464e-832e-553f1862649b None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:08.541658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e18d594d-53e9-464e-832e-553f1862649b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:08.630868 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 168/336] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:08.664977 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8c7f0-517f-4188-856f-10f57efe3eb1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:08.803205 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8c7f0-517f-4188-856f-10f57efe3eb1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:08.840490 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff198b-199a-4ae8-96f7-abc3fd422095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:08.841301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff198b-199a-4ae8-96f7-abc3fd422095 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:08.841584 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff198b-199a-4ae8-96f7-abc3fd422095 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:08.841859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff198b-199a-4ae8-96f7-abc3fd422095 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:08.860594 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff198b-199a-4ae8-96f7-abc3fd422095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:08.868767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-3aff198b-199a-4ae8-96f7-abc3fd422095 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:20:08.868767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:08.868767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:08.868767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:08.868767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:08.868767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:08.868767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:08.868767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:08.868767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:08.868767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:08.868767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:08.868767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:08.868767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:08.868767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:08.868767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:08.868767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:08.869691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:08.869691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:08.869691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:08.869691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:08.869691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:08.869691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:08.869691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:08.869691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:08.869691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:08.869691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:08.869691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:08.869691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:08.869691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:08.869691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:08.869691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:08.869691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:08.870502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:08.870502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:08.870502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:08.870502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:08.870502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:08.870502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:08.870502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:08.870502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:08.870502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:08.870502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:08.870502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:20:08.870502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:08.876059 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 169/337] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:08.877774 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d594d-53e9-464e-832e-553f1862649b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:08.914709 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:09.023145 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d594d-53e9-464e-832e-553f1862649b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:09.062560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2858f8e-3686-4a84-824d-2e366eb5b9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:09.063157 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2858f8e-3686-4a84-824d-2e366eb5b9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:09.063439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2858f8e-3686-4a84-824d-2e366eb5b9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:09.063718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2858f8e-3686-4a84-824d-2e366eb5b9a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:09.064506 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2858f8e-3686-4a84-824d-2e366eb5b9a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:09.064814 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2858f8e-3686-4a84-824d-2e366eb5b9a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:09.066213 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2858f8e-3686-4a84-824d-2e366eb5b9a4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:09.075739 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 169/338] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:20:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:09.081660 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff198b-199a-4ae8-96f7-abc3fd422095 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:09.166742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:09.220302 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff198b-199a-4ae8-96f7-abc3fd422095 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:09.263081 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eef6ec-8167-454e-b00f-1680e001860c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:09.263744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eef6ec-8167-454e-b00f-1680e001860c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:09.264073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eef6ec-8167-454e-b00f-1680e001860c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:09.264353 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eef6ec-8167-454e-b00f-1680e001860c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:09.347754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eef6ec-8167-454e-b00f-1680e001860c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:09.353527 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eef6ec-8167-454e-b00f-1680e001860c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:09.435259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:09.484424 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 170/339] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:09.491131 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2858f8e-3686-4a84-824d-2e366eb5b9a4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:09.601711 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:09.637946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2858f8e-3686-4a84-824d-2e366eb5b9a4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:09.684964 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcc3d3-a700-4a42-b19a-e829724ed662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:09.685868 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcc3d3-a700-4a42-b19a-e829724ed662 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:09.686148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcc3d3-a700-4a42-b19a-e829724ed662 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:09.686424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcc3d3-a700-4a42-b19a-e829724ed662 None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:09.692799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcc3d3-a700-4a42-b19a-e829724ed662 None admin] RBAC: Authorizing `identity:get_project(project_id=f82f5c51617d45fc90355caaf5b8a8b2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:09.694303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcc3d3-a700-4a42-b19a-e829724ed662 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:09.696463 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 170/340] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:20:09 2022] GET /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:09.701831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eef6ec-8167-454e-b00f-1680e001860c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:09.849175 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eef6ec-8167-454e-b00f-1680e001860c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:09.891552 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc543a7-f16a-4202-8498-2b80d1c1aa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:09.892358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc543a7-f16a-4202-8498-2b80d1c1aa5e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:09.892640 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc543a7-f16a-4202-8498-2b80d1c1aa5e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:09.892917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc543a7-f16a-4202-8498-2b80d1c1aa5e None admin] PATH_INFO: `/v3/groups/fcb689c1837d41868e49f2af949f3d30` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:09.904794 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc543a7-f16a-4202-8498-2b80d1c1aa5e None admin] RBAC: Authorizing `identity:get_group(group_id=fcb689c1837d41868e49f2af949f3d30)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:09.906323 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc543a7-f16a-4202-8498-2b80d1c1aa5e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:09.908440 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 171/341] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 16:20:09 2022] GET /identity/v3/groups/fcb689c1837d41868e49f2af949f3d30 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:09.914616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcc3d3-a700-4a42-b19a-e829724ed662 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:09.948573 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07917b52-ef86-4f23-a1a5-4e0e2aa714cd None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:09.949232 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07917b52-ef86-4f23-a1a5-4e0e2aa714cd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:09.949728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07917b52-ef86-4f23-a1a5-4e0e2aa714cd None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:09.951927 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 172/342] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:09.957718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ae652-ad6e-41d1-a83b-159b9dc8b639 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:09.958138 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ae652-ad6e-41d1-a83b-159b9dc8b639 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:09.958655 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ae652-ad6e-41d1-a83b-159b9dc8b639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:09.992895 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-803ae652-ad6e-41d1-a83b-159b9dc8b639 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:10.000049 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-803ae652-ad6e-41d1-a83b-159b9dc8b639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:10.051754 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcc3d3-a700-4a42-b19a-e829724ed662 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:10.053962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:10.101247 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b13a1-0509-41be-aab9-3eeceddbee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:10.102210 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b13a1-0509-41be-aab9-3eeceddbee1a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:10.102646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b13a1-0509-41be-aab9-3eeceddbee1a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:10.103058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b13a1-0509-41be-aab9-3eeceddbee1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:10.104070 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b13a1-0509-41be-aab9-3eeceddbee1a None admin] RBAC: Adding query filter params (group.id=fcb689c1837d41868e49f2af949f3d30, role.id=91889a59745c4d8185400f69d84eb50e, scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:10.104572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b13a1-0509-41be-aab9-3eeceddbee1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:10.106181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b13a1-0509-41be-aab9-3eeceddbee1a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:10.117086 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 171/343] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 16:20:09 2022] GET /identity/v3/role_assignments?group.id=fcb689c1837d41868e49f2af949f3d30&scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2&role.id=91889a59745c4d8185400f69d84eb50e => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:10.125519 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99709537-e7fb-499c-ae13-ab5f04ed21de None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:10.126069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99709537-e7fb-499c-ae13-ab5f04ed21de None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:10.127330 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99709537-e7fb-499c-ae13-ab5f04ed21de None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:10.129137 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 172/344] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:10.135901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182b69f-2df0-44c8-bcf7-a36b30873ecf None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:10.136394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182b69f-2df0-44c8-bcf7-a36b30873ecf None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:10.136809 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182b69f-2df0-44c8-bcf7-a36b30873ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:10.164403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:10.171847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 173/345] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:20:10.177369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4182b69f-2df0-44c8-bcf7-a36b30873ecf None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:10.178835 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4182b69f-2df0-44c8-bcf7-a36b30873ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:10.210744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ae652-ad6e-41d1-a83b-159b9dc8b639 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:10.318372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 173/346] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:10.376039 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182b69f-2df0-44c8-bcf7-a36b30873ecf None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:10.378981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ae652-ad6e-41d1-a83b-159b9dc8b639 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:10.432989 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a66f2-2a41-4bcc-9600-0a1409b0cf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:10.433747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a66f2-2a41-4bcc-9600-0a1409b0cf62 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:10.434027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a66f2-2a41-4bcc-9600-0a1409b0cf62 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:10.434297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a66f2-2a41-4bcc-9600-0a1409b0cf62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:10.464528 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a66f2-2a41-4bcc-9600-0a1409b0cf62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:10.476962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-bf6a66f2-2a41-4bcc-9600-0a1409b0cf62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:20:10.476962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:10.476962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:10.476962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:10.476962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:10.476962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:10.476962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:10.476962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:10.476962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:10.476962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:10.476962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:10.476962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:10.476962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:10.476962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:10.476962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:10.476962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:10.477949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:10.477949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:10.477949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:10.477949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:10.477949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:10.477949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:10.477949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:10.477949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:10.477949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:10.477949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:10.477949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:10.477949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:10.477949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:10.477949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:10.477949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:10.477949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:10.479206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:10.479206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:10.479206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:10.479206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:10.479206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:10.479206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:10.479206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:10.479206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:10.479206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:10.479206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:10.479206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:20:10.479206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:10.479206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 174/347] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:20:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:10.484400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a66f2-2a41-4bcc-9600-0a1409b0cf62 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:10.513065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:10.552606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182b69f-2df0-44c8-bcf7-a36b30873ecf None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:10.638471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174ed3c-9f56-4db1-957d-2047ec7177c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:10.639302 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174ed3c-9f56-4db1-957d-2047ec7177c1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:10.639583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174ed3c-9f56-4db1-957d-2047ec7177c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:10.639859 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174ed3c-9f56-4db1-957d-2047ec7177c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:10.643746 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:10.656988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174ed3c-9f56-4db1-957d-2047ec7177c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:10.664779 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a66f2-2a41-4bcc-9600-0a1409b0cf62 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:10.665839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-b174ed3c-9f56-4db1-957d-2047ec7177c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:20:10.665839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:10.665839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:10.665839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:10.665839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:10.665839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:10.665839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:10.665839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:10.665839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:10.665839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:10.665839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:10.665839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:10.665839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:10.665839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:10.665839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:10.665839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:10.666745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:10.666745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:10.666745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:10.666745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:10.666745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:10.666745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:10.666745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:10.666745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:10.666745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:10.666745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:10.666745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:10.666745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:10.666745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:10.666745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:10.666745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:10.666745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:10.667660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:10.667660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:10.667660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:10.667660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:10.667660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:10.667660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:10.667660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:10.667660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:10.667660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:10.667660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:10.667660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:20:10.667660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:10.670625 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 174/348] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:10.672366 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbd957-f750-4ec7-a0ed-c262b0888aae None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:10.672880 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbd957-f750-4ec7-a0ed-c262b0888aae None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:10.673401 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbd957-f750-4ec7-a0ed-c262b0888aae None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:10.675173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 175/349] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:10.680983 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbd957-f750-4ec7-a0ed-c262b0888aae None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:10.719374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454f73c-342f-464f-af70-b20f80928281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:10.721252 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454f73c-342f-464f-af70-b20f80928281 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:10.722105 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454f73c-342f-464f-af70-b20f80928281 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:10.723041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454f73c-342f-464f-af70-b20f80928281 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:10.724670 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454f73c-342f-464f-af70-b20f80928281 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:10.726703 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454f73c-342f-464f-af70-b20f80928281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:10.729099 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454f73c-342f-464f-af70-b20f80928281 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:10.740611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 175/350] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:10.742328 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725d37-5c4f-45f3-9e3e-c119b864fad5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:10.742838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725d37-5c4f-45f3-9e3e-c119b864fad5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:10.743332 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725d37-5c4f-45f3-9e3e-c119b864fad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:10.767673 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9a725d37-5c4f-45f3-9e3e-c119b864fad5 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:10.770044 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9a725d37-5c4f-45f3-9e3e-c119b864fad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:10.823605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbd957-f750-4ec7-a0ed-c262b0888aae None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:10.863200 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9379fe-d525-4fe5-bd6f-08643074ea53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:10.864368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9379fe-d525-4fe5-bd6f-08643074ea53 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:10.864898 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9379fe-d525-4fe5-bd6f-08643074ea53 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:10.865368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9379fe-d525-4fe5-bd6f-08643074ea53 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:10.866342 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9379fe-d525-4fe5-bd6f-08643074ea53 None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:10.866867 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9379fe-d525-4fe5-bd6f-08643074ea53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:10.868533 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9379fe-d525-4fe5-bd6f-08643074ea53 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:10.878892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 176/351] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:20:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:10.880298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9379fe-d525-4fe5-bd6f-08643074ea53 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:10.941074 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 176/352] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:10.942006 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a725d37-5c4f-45f3-9e3e-c119b864fad5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:10.952516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:10.953758 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:11.019329 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9379fe-d525-4fe5-bd6f-08643074ea53 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:11.060156 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3e3c9-4767-4b68-bd95-8245120700ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:11.061227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3e3c9-4767-4b68-bd95-8245120700ed None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:11.061713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3e3c9-4767-4b68-bd95-8245120700ed None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:11.062295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3e3c9-4767-4b68-bd95-8245120700ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:11.139533 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3e3c9-4767-4b68-bd95-8245120700ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:11.141523 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3e3c9-4767-4b68-bd95-8245120700ed None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:11.148788 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a725d37-5c4f-45f3-9e3e-c119b864fad5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:11.188627 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf257ef-befb-40d6-a580-6f433ce05aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:11.189296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf257ef-befb-40d6-a580-6f433ce05aca None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:11.189574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf257ef-befb-40d6-a580-6f433ce05aca None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:11.189844 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf257ef-befb-40d6-a580-6f433ce05aca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:11.210057 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:11.265684 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 177/353] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:11.267187 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3e3c9-4767-4b68-bd95-8245120700ed None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:11.277875 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf257ef-befb-40d6-a580-6f433ce05aca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:11.279378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf257ef-befb-40d6-a580-6f433ce05aca None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:11.292045 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:11.379916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3e3c9-4767-4b68-bd95-8245120700ed None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:11.413327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 177/354] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:11.418806 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6eb385-6959-4e73-a416-f1ee6edd9272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:11.418806 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6eb385-6959-4e73-a416-f1ee6edd9272 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:11.419024 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da259b-d8bd-40f8-9dd9-24a351eebf49 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:11.419094 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6eb385-6959-4e73-a416-f1ee6edd9272 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:11.419199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da259b-d8bd-40f8-9dd9-24a351eebf49 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:11.419642 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6eb385-6959-4e73-a416-f1ee6edd9272 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:11.419739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da259b-d8bd-40f8-9dd9-24a351eebf49 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:11.421234 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 178/355] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:11.421990 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da259b-d8bd-40f8-9dd9-24a351eebf49 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:11.435293 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6eb385-6959-4e73-a416-f1ee6edd9272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:11.445741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-9a6eb385-6959-4e73-a416-f1ee6edd9272 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:20:11.445741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:11.445741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:11.445741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:11.445741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:11.445741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:11.445741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:11.445741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:11.445741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:11.445741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:11.445741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:11.445741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:11.445741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:11.445741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:11.445741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:11.445741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:11.446897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:11.446897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:11.446897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:11.446897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:11.446897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:11.446897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:11.446897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:11.446897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:11.446897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:11.446897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:11.446897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:11.446897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:11.446897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:11.446897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:11.446897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:11.446897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:11.447904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:11.447904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:11.447904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:11.447904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:11.447904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:11.447904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:11.447904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:11.447904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:11.447904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:11.447904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:11.447904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:20:11.447904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:11.450699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 178/356] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:20:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:11.451357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b178a3-35a2-4d48-a2bd-642607e6943f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:11.451708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b178a3-35a2-4d48-a2bd-642607e6943f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:11.452059 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b178a3-35a2-4d48-a2bd-642607e6943f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:11.453683 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 179/357] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:11.454307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b178a3-35a2-4d48-a2bd-642607e6943f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:11.481593 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:11.544839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da259b-d8bd-40f8-9dd9-24a351eebf49 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:11.554227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:11.585826 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770899f-5bb0-430f-8df3-d77d4d376267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:11.586810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770899f-5bb0-430f-8df3-d77d4d376267 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:11.587095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770899f-5bb0-430f-8df3-d77d4d376267 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:11.587371 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770899f-5bb0-430f-8df3-d77d4d376267 None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:11.588745 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770899f-5bb0-430f-8df3-d77d4d376267 None admin] RBAC: Authorizing `identity:get_project(project_id=f82f5c51617d45fc90355caaf5b8a8b2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:11.589988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b178a3-35a2-4d48-a2bd-642607e6943f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:11.590320 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770899f-5bb0-430f-8df3-d77d4d376267 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:11.592204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 179/358] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:20:11 2022] GET /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:11.593667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fa1b1-028c-4712-82d3-1f77a99d4151 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:11.593948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fa1b1-028c-4712-82d3-1f77a99d4151 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:11.594224 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fa1b1-028c-4712-82d3-1f77a99d4151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:11.611819 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4f5fa1b1-028c-4712-82d3-1f77a99d4151 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:11.613047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4f5fa1b1-028c-4712-82d3-1f77a99d4151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:11.632732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ce924-ceb4-410f-9aa5-67785cf6107b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:11.634022 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ce924-ceb4-410f-9aa5-67785cf6107b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:11.634499 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ce924-ceb4-410f-9aa5-67785cf6107b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:11.634995 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ce924-ceb4-410f-9aa5-67785cf6107b None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:11.637490 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ce924-ceb4-410f-9aa5-67785cf6107b None admin] RBAC: Authorizing `identity:get_project(project_id=b99cf27cf22249fdb99befb43f95a1d6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:11.638951 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ce924-ceb4-410f-9aa5-67785cf6107b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:11.640997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 180/359] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:20:11 2022] GET /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:11.641647 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ce924-ceb4-410f-9aa5-67785cf6107b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:11.694416 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 180/360] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:11.696219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00708a-e6c8-4cb9-92bd-f62b3c01d827 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:11.696726 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00708a-e6c8-4cb9-92bd-f62b3c01d827 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:11.697195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00708a-e6c8-4cb9-92bd-f62b3c01d827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:11.720438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-aa00708a-e6c8-4cb9-92bd-f62b3c01d827 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:11.721808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-aa00708a-e6c8-4cb9-92bd-f62b3c01d827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:11.738226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:11.757316 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ce924-ceb4-410f-9aa5-67785cf6107b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:11.802545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ecd689-29b9-4e23-bf71-ce01c52163b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:11.803686 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecd689-29b9-4e23-bf71-ce01c52163b6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:11.803979 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecd689-29b9-4e23-bf71-ce01c52163b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:11.804294 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecd689-29b9-4e23-bf71-ce01c52163b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:11.805535 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ecd689-29b9-4e23-bf71-ce01c52163b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:11.805858 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ecd689-29b9-4e23-bf71-ce01c52163b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:11.808915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ecd689-29b9-4e23-bf71-ce01c52163b6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:11.811297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 181/361] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:11.812003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00708a-e6c8-4cb9-92bd-f62b3c01d827 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:11.823822 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 181/362] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:11.824730 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ecd689-29b9-4e23-bf71-ce01c52163b6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:11.853187 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:11.944697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00708a-e6c8-4cb9-92bd-f62b3c01d827 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:11.951475 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ecd689-29b9-4e23-bf71-ce01c52163b6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:11.993495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6f8f6-7476-44e3-9c77-b8fdf581e0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:11.994376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6f8f6-7476-44e3-9c77-b8fdf581e0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:11.994656 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6f8f6-7476-44e3-9c77-b8fdf581e0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:11.994921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6f8f6-7476-44e3-9c77-b8fdf581e0e1 None admin] PATH_INFO: `/v3/groups/fcb689c1837d41868e49f2af949f3d30` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:11.996507 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6f8f6-7476-44e3-9c77-b8fdf581e0e1 None admin] RBAC: Authorizing `identity:get_group(group_id=fcb689c1837d41868e49f2af949f3d30)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:11.997974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6f8f6-7476-44e3-9c77-b8fdf581e0e1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:11.999793 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 182/363] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 16:20:11 2022] GET /identity/v3/groups/fcb689c1837d41868e49f2af949f3d30 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:12.000443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6f8f6-7476-44e3-9c77-b8fdf581e0e1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:12.002002 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d960b28-b7d6-49e6-aae6-78d0c9afee2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:12.002895 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960b28-b7d6-49e6-aae6-78d0c9afee2a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:12.003180 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960b28-b7d6-49e6-aae6-78d0c9afee2a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:12.003456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960b28-b7d6-49e6-aae6-78d0c9afee2a None admin] PATH_INFO: `/v3/groups/fcb689c1837d41868e49f2af949f3d30` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:12.005346 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d960b28-b7d6-49e6-aae6-78d0c9afee2a None admin] RBAC: Authorizing `identity:get_group(group_id=fcb689c1837d41868e49f2af949f3d30)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:12.006842 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d960b28-b7d6-49e6-aae6-78d0c9afee2a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:12.008599 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 182/364] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 16:20:11 2022] GET /identity/v3/groups/fcb689c1837d41868e49f2af949f3d30 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:12.009433 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d960b28-b7d6-49e6-aae6-78d0c9afee2a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:12.022941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:12.135217 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d960b28-b7d6-49e6-aae6-78d0c9afee2a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:12.137677 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:12.142089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6f8f6-7476-44e3-9c77-b8fdf581e0e1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:12.192091 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10810db-2970-4dee-8b88-e0cbd9873bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:12.192795 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49015bdd-e325-4ac5-a464-8f8dc47c0417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:12.192914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10810db-2970-4dee-8b88-e0cbd9873bab None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:12.193095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10810db-2970-4dee-8b88-e0cbd9873bab None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:12.193340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10810db-2970-4dee-8b88-e0cbd9873bab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:12.193619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49015bdd-e325-4ac5-a464-8f8dc47c0417 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:12.193956 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49015bdd-e325-4ac5-a464-8f8dc47c0417 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:12.194176 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49015bdd-e325-4ac5-a464-8f8dc47c0417 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:12.210746 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49015bdd-e325-4ac5-a464-8f8dc47c0417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:12.218674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-49015bdd-e325-4ac5-a464-8f8dc47c0417 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:20:12.218674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:12.218674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:12.218674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:12.218674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:12.218674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:12.218674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:12.218674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:12.218674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:12.218674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:12.218674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:12.218674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:12.218674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:12.218674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:12.218674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:12.218674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:12.219586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:12.219586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:12.219586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:12.219586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:12.219586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:12.219586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:12.219586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:12.219586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:12.219586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:12.219586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:12.219586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:12.219586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:12.219586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:12.219586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:12.219586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:12.219586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:12.220825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:12.220825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:12.220825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:12.220825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:12.220825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:12.220825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:12.220825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:12.220825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:12.220825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:12.220825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:12.220825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:20:12.220825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:12.220825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 183/365] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:20:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:12.220825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49015bdd-e325-4ac5-a464-8f8dc47c0417 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:12.297930 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10810db-2970-4dee-8b88-e0cbd9873bab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:12.299424 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10810db-2970-4dee-8b88-e0cbd9873bab None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:12.320246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:12.354194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49015bdd-e325-4ac5-a464-8f8dc47c0417 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:12.408789 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3890b2-b001-492d-aa02-8ae60523aa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:12.409623 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3890b2-b001-492d-aa02-8ae60523aa20 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:12.409903 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3890b2-b001-492d-aa02-8ae60523aa20 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:12.410175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3890b2-b001-492d-aa02-8ae60523aa20 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:12.427228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3890b2-b001-492d-aa02-8ae60523aa20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:12.427900 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 183/366] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:12.428790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10810db-2970-4dee-8b88-e0cbd9873bab None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:12.431332 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:12.435702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-bc3890b2-b001-492d-aa02-8ae60523aa20 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:20:12.435702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:12.435702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:12.435702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:12.435702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:12.435702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:12.435702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:12.435702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:12.435702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:12.435702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:12.435702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:12.435702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:12.435702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:12.435702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:12.435702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:12.435702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:12.436745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:12.436745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:12.436745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:12.436745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:12.436745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:12.436745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:12.436745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:12.436745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:12.436745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:12.436745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:12.436745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:12.436745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:12.436745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:12.436745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:12.436745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:12.436745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:12.437658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:12.437658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:12.437658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:12.437658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:12.437658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:12.437658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:12.437658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:12.437658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:12.437658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:12.437658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:12.437658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 16:20:12.437658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:12.437658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 184/367] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:12.439749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3890b2-b001-492d-aa02-8ae60523aa20 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:12.569493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10810db-2970-4dee-8b88-e0cbd9873bab None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:12.586345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3890b2-b001-492d-aa02-8ae60523aa20 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:12.614469 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b726ec-0502-48cc-9101-970a0c21be75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:12.615236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b726ec-0502-48cc-9101-970a0c21be75 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:12.615517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b726ec-0502-48cc-9101-970a0c21be75 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:12.615786 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b726ec-0502-48cc-9101-970a0c21be75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:12.616758 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b726ec-0502-48cc-9101-970a0c21be75 None admin] RBAC: Adding query filter params (group.id=fcb689c1837d41868e49f2af949f3d30, role.id=91889a59745c4d8185400f69d84eb50e, scope.project.id=b99cf27cf22249fdb99befb43f95a1d6) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:12.617066 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b726ec-0502-48cc-9101-970a0c21be75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:12.618610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b726ec-0502-48cc-9101-970a0c21be75 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:12.625948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 184/368] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 16:20:12 2022] GET /identity/v3/role_assignments?group.id=fcb689c1837d41868e49f2af949f3d30&scope.project.id=b99cf27cf22249fdb99befb43f95a1d6&role.id=91889a59745c4d8185400f69d84eb50e => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:12.626652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b726ec-0502-48cc-9101-970a0c21be75 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:12.635044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1d5ba-c55f-41a9-934a-5f5b2dba7cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:12.635839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1d5ba-c55f-41a9-934a-5f5b2dba7cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:12.636216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1d5ba-c55f-41a9-934a-5f5b2dba7cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:12.636562 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1d5ba-c55f-41a9-934a-5f5b2dba7cd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:12.637489 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1d5ba-c55f-41a9-934a-5f5b2dba7cd6 None admin] RBAC: Adding query filter params (group.id=fcb689c1837d41868e49f2af949f3d30, role.id=60519d06a8c94e6c82462e5d79d9856b, scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:12.637864 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1d5ba-c55f-41a9-934a-5f5b2dba7cd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:12.639599 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1d5ba-c55f-41a9-934a-5f5b2dba7cd6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:12.641874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:12.648241 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 185/369] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 16:20:12 2022] GET /identity/v3/role_assignments?group.id=fcb689c1837d41868e49f2af949f3d30&scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2&role.id=60519d06a8c94e6c82462e5d79d9856b => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:12.657477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1d5ba-c55f-41a9-934a-5f5b2dba7cd6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:12.716471 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:12.772182 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b726ec-0502-48cc-9101-970a0c21be75 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:12.813859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c53d27-cf3f-478c-a980-6ab752cffa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:12.815059 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c53d27-cf3f-478c-a980-6ab752cffa37 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:12.815546 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c53d27-cf3f-478c-a980-6ab752cffa37 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:12.816132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c53d27-cf3f-478c-a980-6ab752cffa37 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:12.817387 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c53d27-cf3f-478c-a980-6ab752cffa37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:12.817949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c53d27-cf3f-478c-a980-6ab752cffa37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:12.819653 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c53d27-cf3f-478c-a980-6ab752cffa37 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:12.830635 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 185/370] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:12.831843 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c53d27-cf3f-478c-a980-6ab752cffa37 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:12.845650 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1d5ba-c55f-41a9-934a-5f5b2dba7cd6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:12.890335 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479e443-c961-4bd3-aabb-7e1b7c2a6b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:12.891175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479e443-c961-4bd3-aabb-7e1b7c2a6b06 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:12.891457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479e443-c961-4bd3-aabb-7e1b7c2a6b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:12.891736 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479e443-c961-4bd3-aabb-7e1b7c2a6b06 None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:12.893112 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479e443-c961-4bd3-aabb-7e1b7c2a6b06 None admin] RBAC: Authorizing `identity:get_project(project_id=b99cf27cf22249fdb99befb43f95a1d6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:12.894668 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479e443-c961-4bd3-aabb-7e1b7c2a6b06 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:12.897019 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 186/371] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:20:12 2022] GET /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:12.897917 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479e443-c961-4bd3-aabb-7e1b7c2a6b06 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:12.962106 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c53d27-cf3f-478c-a980-6ab752cffa37 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:12.975334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:12.995906 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:13.007452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf124e7-cf15-4eeb-93fa-7b3a4364f2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:13.008426 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf124e7-cf15-4eeb-93fa-7b3a4364f2df None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:13.008733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf124e7-cf15-4eeb-93fa-7b3a4364f2df None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:13.009460 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf124e7-cf15-4eeb-93fa-7b3a4364f2df None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:13.010501 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf124e7-cf15-4eeb-93fa-7b3a4364f2df None admin] RBAC: Adding query filter params (name=reader) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:13.010817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf124e7-cf15-4eeb-93fa-7b3a4364f2df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:13.012745 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf124e7-cf15-4eeb-93fa-7b3a4364f2df None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:13.024271 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479e443-c961-4bd3-aabb-7e1b7c2a6b06 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:13.032887 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 186/372] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:20:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:13.033768 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf124e7-cf15-4eeb-93fa-7b3a4364f2df None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:13.087580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34ef08-7fbf-4094-8705-c72d790daa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:13.088264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34ef08-7fbf-4094-8705-c72d790daa6b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:13.088546 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34ef08-7fbf-4094-8705-c72d790daa6b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:13.088817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34ef08-7fbf-4094-8705-c72d790daa6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:13.182958 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34ef08-7fbf-4094-8705-c72d790daa6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:13.184911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34ef08-7fbf-4094-8705-c72d790daa6b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:13.225573 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf124e7-cf15-4eeb-93fa-7b3a4364f2df None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:13.262827 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:13.275760 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0be9f3-93e3-4936-ab19-ac82c49c718b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:13.277043 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0be9f3-93e3-4936-ab19-ac82c49c718b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:13.277575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0be9f3-93e3-4936-ab19-ac82c49c718b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:13.277987 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0be9f3-93e3-4936-ab19-ac82c49c718b None admin] PATH_INFO: `/v3/groups/fcb689c1837d41868e49f2af949f3d30` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:13.279354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0be9f3-93e3-4936-ab19-ac82c49c718b None admin] RBAC: Authorizing `identity:get_group(group_id=fcb689c1837d41868e49f2af949f3d30)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:13.281185 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0be9f3-93e3-4936-ab19-ac82c49c718b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:13.284342 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 187/373] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 16:20:13 2022] GET /identity/v3/groups/fcb689c1837d41868e49f2af949f3d30 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:13.285350 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0be9f3-93e3-4936-ab19-ac82c49c718b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:13.308549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 187/374] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:13.310008 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a047311-fc62-4a38-94c7-97cfe31a0e89 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:13.310328 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a047311-fc62-4a38-94c7-97cfe31a0e89 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:13.310772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a047311-fc62-4a38-94c7-97cfe31a0e89 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:13.311953 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 188/375] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:13.315449 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a047311-fc62-4a38-94c7-97cfe31a0e89 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:13.360071 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:13.405775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0be9f3-93e3-4936-ab19-ac82c49c718b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:13.433681 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a047311-fc62-4a38-94c7-97cfe31a0e89 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:13.442357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46241aa1-4b42-4292-a536-0c354899bb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:13.443541 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46241aa1-4b42-4292-a536-0c354899bb55 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:13.444115 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46241aa1-4b42-4292-a536-0c354899bb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:13.444559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46241aa1-4b42-4292-a536-0c354899bb55 None admin] PATH_INFO: `/v3/users/6579c0e03b424ddb9e41f34991a0fa59` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:13.446098 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46241aa1-4b42-4292-a536-0c354899bb55 None admin] RBAC: Authorizing `identity:get_user(user_id=6579c0e03b424ddb9e41f34991a0fa59)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:13.447784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46241aa1-4b42-4292-a536-0c354899bb55 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:13.450141 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 188/376] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:20:13 2022] GET /identity/v3/users/6579c0e03b424ddb9e41f34991a0fa59 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:13.451500 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15cdab-b1c2-4318-9683-71eccb53c995 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:13.451939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15cdab-b1c2-4318-9683-71eccb53c995 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:13.452385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15cdab-b1c2-4318-9683-71eccb53c995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:13.470771 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-dc15cdab-b1c2-4318-9683-71eccb53c995 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:13.472375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dc15cdab-b1c2-4318-9683-71eccb53c995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:13.478951 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6facd-2989-4bf5-a7af-89f39f976868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:13.479638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6facd-2989-4bf5-a7af-89f39f976868 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:13.479983 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6facd-2989-4bf5-a7af-89f39f976868 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:13.480422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6facd-2989-4bf5-a7af-89f39f976868 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:13.481334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6facd-2989-4bf5-a7af-89f39f976868 None admin] RBAC: Adding query filter params (group.id=fcb689c1837d41868e49f2af949f3d30, role.id=60519d06a8c94e6c82462e5d79d9856b, scope.project.id=b99cf27cf22249fdb99befb43f95a1d6) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:13.481708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6facd-2989-4bf5-a7af-89f39f976868 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:13.483998 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6facd-2989-4bf5-a7af-89f39f976868 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:13.508617 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 189/377] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 16:20:13 2022] GET /identity/v3/role_assignments?group.id=fcb689c1837d41868e49f2af949f3d30&scope.project.id=b99cf27cf22249fdb99befb43f95a1d6&role.id=60519d06a8c94e6c82462e5d79d9856b => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:13.509552 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6facd-2989-4bf5-a7af-89f39f976868 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:13.582844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:13.586007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 189/378] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:13.587182 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15cdab-b1c2-4318-9683-71eccb53c995 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:13.716830 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:13.764969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6facd-2989-4bf5-a7af-89f39f976868 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:13.833526 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163706b2-5dc8-4770-8b63-6dbf284f280f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:13.833758 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15cdab-b1c2-4318-9683-71eccb53c995 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:13.834396 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163706b2-5dc8-4770-8b63-6dbf284f280f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:13.835224 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163706b2-5dc8-4770-8b63-6dbf284f280f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:13.835224 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163706b2-5dc8-4770-8b63-6dbf284f280f None admin] PATH_INFO: `/v3/projects/e4a92a8dcb534d23b8816fa07dbb1878` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:13.845612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163706b2-5dc8-4770-8b63-6dbf284f280f None admin] RBAC: Authorizing `identity:get_project(project_id=e4a92a8dcb534d23b8816fa07dbb1878)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:13.850152 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163706b2-5dc8-4770-8b63-6dbf284f280f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:13.855375 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 190/379] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:20:13 2022] GET /identity/v3/projects/e4a92a8dcb534d23b8816fa07dbb1878 => generated 344 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:13.856094 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163706b2-5dc8-4770-8b63-6dbf284f280f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:13.956753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf8896-7de9-4b12-914a-ac606e173aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:13.957506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf8896-7de9-4b12-914a-ac606e173aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:13.957793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf8896-7de9-4b12-914a-ac606e173aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:13.958388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf8896-7de9-4b12-914a-ac606e173aa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:13.959190 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf8896-7de9-4b12-914a-ac606e173aa2 None admin] RBAC: Adding query filter params (role.id=63f594b5fbbe4eb7b69119f8afda416f, user.id=6579c0e03b424ddb9e41f34991a0fa59, scope.system=all) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:13.959508 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf8896-7de9-4b12-914a-ac606e173aa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:13.964046 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf8896-7de9-4b12-914a-ac606e173aa2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:14.001219 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:14.002240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 190/380] 10.222.0.41 () {56 vars in 1308 bytes} [Fri May 27 16:20:13 2022] GET /identity/v3/role_assignments?user.id=6579c0e03b424ddb9e41f34991a0fa59&scope.system=all&role.id=63f594b5fbbe4eb7b69119f8afda416f => generated 510 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:14.002926 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf8896-7de9-4b12-914a-ac606e173aa2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:14.013600 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163706b2-5dc8-4770-8b63-6dbf284f280f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:14.142396 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb557a-f239-4167-94aa-ce0416820994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:14.146549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb557a-f239-4167-94aa-ce0416820994 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:14.146852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb557a-f239-4167-94aa-ce0416820994 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:14.147481 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb557a-f239-4167-94aa-ce0416820994 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:14.196895 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb557a-f239-4167-94aa-ce0416820994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:14.215409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-b6bb557a-f239-4167-94aa-ce0416820994 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:20:14.215409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:14.215409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:14.215409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:14.215409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:14.215409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:14.215409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:14.215409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:14.215409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:14.215409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:14.215409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:14.215409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:14.215409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:14.215409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:14.215409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:14.215409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:14.216432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:14.216432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:14.216432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:14.216432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:14.216432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:14.216432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:14.216432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:14.216432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:14.216432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:14.216432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:14.216432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:14.216432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:14.216432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:14.216432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:14.216432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:14.216432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:14.217233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:14.217233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:14.217233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:14.217233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:14.217233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:14.217233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:14.217233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:14.217233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:14.217233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:14.217233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:14.217233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:20:14.217233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:14.217233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 191/381] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:14.229819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb557a-f239-4167-94aa-ce0416820994 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:14.285677 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf8896-7de9-4b12-914a-ac606e173aa2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:14.322335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:14.374320 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217c571-0648-4348-8f65-39663cbb7987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:14.375207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217c571-0648-4348-8f65-39663cbb7987 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:14.375493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217c571-0648-4348-8f65-39663cbb7987 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:14.375772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217c571-0648-4348-8f65-39663cbb7987 None admin] PATH_INFO: `/v3/groups/b61388b5bf4f4153a25d648cf683927d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:14.390901 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217c571-0648-4348-8f65-39663cbb7987 None admin] RBAC: Authorizing `identity:get_group(group_id=b61388b5bf4f4153a25d648cf683927d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:14.392508 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217c571-0648-4348-8f65-39663cbb7987 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:14.394486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 191/382] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 16:20:14 2022] GET /identity/v3/groups/b61388b5bf4f4153a25d648cf683927d => generated 229 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:14.400868 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217c571-0648-4348-8f65-39663cbb7987 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:14.479400 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb557a-f239-4167-94aa-ce0416820994 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:14.525757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe9199-a0dc-402f-9043-d21b64c27804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:14.526446 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe9199-a0dc-402f-9043-d21b64c27804 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:14.526727 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe9199-a0dc-402f-9043-d21b64c27804 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:14.526999 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe9199-a0dc-402f-9043-d21b64c27804 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:14.527747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe9199-a0dc-402f-9043-d21b64c27804 None admin] RBAC: Adding query filter params (name=member) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:14.528069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe9199-a0dc-402f-9043-d21b64c27804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:14.529479 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe9199-a0dc-402f-9043-d21b64c27804 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:14.543201 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 192/383] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:20:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:14.555541 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217c571-0648-4348-8f65-39663cbb7987 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:14.569426 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe9199-a0dc-402f-9043-d21b64c27804 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:14.608118 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:14.608559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bf58b-f430-48b9-a50e-d8528e52d0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:14.611118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bf58b-f430-48b9-a50e-d8528e52d0ef None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:14.611479 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bf58b-f430-48b9-a50e-d8528e52d0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:14.611761 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bf58b-f430-48b9-a50e-d8528e52d0ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:14.612865 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bf58b-f430-48b9-a50e-d8528e52d0ef None admin] RBAC: Adding query filter params (group.id=b61388b5bf4f4153a25d648cf683927d, role.id=e1e39192d3af465aa504728e32ab7cd2, scope.project.id=e4a92a8dcb534d23b8816fa07dbb1878) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:14.613188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bf58b-f430-48b9-a50e-d8528e52d0ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:14.615524 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bf58b-f430-48b9-a50e-d8528e52d0ef None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:14.622237 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 192/384] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 16:20:14 2022] GET /identity/v3/role_assignments?group.id=b61388b5bf4f4153a25d648cf683927d&scope.project.id=e4a92a8dcb534d23b8816fa07dbb1878&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:14.730874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe9199-a0dc-402f-9043-d21b64c27804 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:14.780080 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05545024-e591-4106-8b33-02d09e11b39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:14.780991 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05545024-e591-4106-8b33-02d09e11b39a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:14.781278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05545024-e591-4106-8b33-02d09e11b39a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:14.781558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05545024-e591-4106-8b33-02d09e11b39a None admin] PATH_INFO: `/v3/groups/fcb689c1837d41868e49f2af949f3d30` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:14.782861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05545024-e591-4106-8b33-02d09e11b39a None admin] RBAC: Authorizing `identity:get_group(group_id=fcb689c1837d41868e49f2af949f3d30)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:14.784422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05545024-e591-4106-8b33-02d09e11b39a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:14.786834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 193/385] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 16:20:14 2022] GET /identity/v3/groups/fcb689c1837d41868e49f2af949f3d30 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:14.792582 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bf58b-f430-48b9-a50e-d8528e52d0ef None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:14.843418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:14.918602 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bf58b-f430-48b9-a50e-d8528e52d0ef None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:14.957191 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ea9d0-1aec-4c79-bf15-045a5f340371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:14.958179 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ea9d0-1aec-4c79-bf15-045a5f340371 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:14.958473 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ea9d0-1aec-4c79-bf15-045a5f340371 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:14.958712 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ea9d0-1aec-4c79-bf15-045a5f340371 None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:14.959950 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ea9d0-1aec-4c79-bf15-045a5f340371 None admin] RBAC: Authorizing `identity:get_project(project_id=f82f5c51617d45fc90355caaf5b8a8b2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:14.961480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ea9d0-1aec-4c79-bf15-045a5f340371 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:14.963678 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 193/386] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:20:14 2022] GET /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:14.969422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05545024-e591-4106-8b33-02d09e11b39a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:15.062637 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:15.077190 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05545024-e591-4106-8b33-02d09e11b39a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:15.112932 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6543cc-dfdd-4fd6-88be-7454fe4f2295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:15.113883 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6543cc-dfdd-4fd6-88be-7454fe4f2295 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:15.114166 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6543cc-dfdd-4fd6-88be-7454fe4f2295 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:15.114468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6543cc-dfdd-4fd6-88be-7454fe4f2295 None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2/groups/fcb689c1837d41868e49f2af949f3d30/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:15.116579 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6543cc-dfdd-4fd6-88be-7454fe4f2295 None admin] RBAC: Authorizing `identity:create_grant(project_id=f82f5c51617d45fc90355caaf5b8a8b2, group_id=fcb689c1837d41868e49f2af949f3d30, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:15.118065 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6543cc-dfdd-4fd6-88be-7454fe4f2295 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:15.133575 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 194/387] 10.222.0.41 () {58 vars in 1442 bytes} [Fri May 27 16:20:14 2022] PUT /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2/groups/fcb689c1837d41868e49f2af949f3d30/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:20:15.415645 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb07a32-c9d8-4df6-88b2-f266a757cff2 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:15.416384 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb07a32-c9d8-4df6-88b2-f266a757cff2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:15.416868 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb07a32-c9d8-4df6-88b2-f266a757cff2 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:15.418762 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 194/388] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:15.424766 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec0794-429b-43ab-a9ae-d14facf44fc5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:15.425328 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec0794-429b-43ab-a9ae-d14facf44fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:15.425810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec0794-429b-43ab-a9ae-d14facf44fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:15.447579 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b5ec0794-429b-43ab-a9ae-d14facf44fc5 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:15.449463 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b5ec0794-429b-43ab-a9ae-d14facf44fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:15.543496 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 195/389] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:15.569910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb07a32-c9d8-4df6-88b2-f266a757cff2 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:15.716209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb07a32-c9d8-4df6-88b2-f266a757cff2 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:15.729782 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:15.757620 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a74b0-2ee4-4e75-9183-e5f7e0ad5689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:15.758448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a74b0-2ee4-4e75-9183-e5f7e0ad5689 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:15.758726 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a74b0-2ee4-4e75-9183-e5f7e0ad5689 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:15.758995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a74b0-2ee4-4e75-9183-e5f7e0ad5689 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:15.770442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a74b0-2ee4-4e75-9183-e5f7e0ad5689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:15.778914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a31a74b0-2ee4-4e75-9183-e5f7e0ad5689 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:20:15.778914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:15.778914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:15.778914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:15.778914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:15.778914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:15.778914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:15.778914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:15.778914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:15.778914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:15.778914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:15.778914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:15.778914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:15.778914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:15.778914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:15.778914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:15.779831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:15.779831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:15.779831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:15.779831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:15.779831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:15.779831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:15.779831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:15.779831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:15.779831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:15.779831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:15.779831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:15.779831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:15.779831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:15.779831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:15.779831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:15.779831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:15.780687 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:15.780687 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:15.780687 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:15.780687 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:15.780687 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:15.780687 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:15.780687 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:15.780687 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:15.780687 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:15.780687 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:15.780687 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:20:15.780687 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:15.780687 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 195/390] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:20:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:15.786709 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec0794-429b-43ab-a9ae-d14facf44fc5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:15.882858 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:15.909890 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec0794-429b-43ab-a9ae-d14facf44fc5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:15.960326 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f1905-6b74-4a26-ba4f-8a01b0c4865d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:15.961007 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f1905-6b74-4a26-ba4f-8a01b0c4865d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:15.961286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f1905-6b74-4a26-ba4f-8a01b0c4865d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:15.961556 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f1905-6b74-4a26-ba4f-8a01b0c4865d None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:15.962307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f1905-6b74-4a26-ba4f-8a01b0c4865d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:15.962608 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f1905-6b74-4a26-ba4f-8a01b0c4865d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:15.965471 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c1826-fc27-42ab-81f1-0248168c2819 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:15.965923 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c1826-fc27-42ab-81f1-0248168c2819 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:15.965997 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c1826-fc27-42ab-81f1-0248168c2819 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:15.967627 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 196/391] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:15.967734 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f1905-6b74-4a26-ba4f-8a01b0c4865d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:15.972707 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35394ba7-d18b-4e53-bcf4-5838e7baa4d1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:15.973123 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35394ba7-d18b-4e53-bcf4-5838e7baa4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:15.973443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35394ba7-d18b-4e53-bcf4-5838e7baa4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:15.987344 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 196/392] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:15.994356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f1905-6b74-4a26-ba4f-8a01b0c4865d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:15.997496 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-35394ba7-d18b-4e53-bcf4-5838e7baa4d1 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:15.998875 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-35394ba7-d18b-4e53-bcf4-5838e7baa4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:16.070684 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 197/393] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:20:16.092936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35394ba7-d18b-4e53-bcf4-5838e7baa4d1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:16.211118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:16.212113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f1905-6b74-4a26-ba4f-8a01b0c4865d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:16.215630 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35394ba7-d18b-4e53-bcf4-5838e7baa4d1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:16.261991 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876dff2-cd58-4f3c-986c-e510d6d81759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:16.263202 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876dff2-cd58-4f3c-986c-e510d6d81759 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:16.263684 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876dff2-cd58-4f3c-986c-e510d6d81759 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:16.264245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876dff2-cd58-4f3c-986c-e510d6d81759 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:16.278392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876dff2-cd58-4f3c-986c-e510d6d81759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:16.286737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-4876dff2-cd58-4f3c-986c-e510d6d81759 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:20:16.286737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:16.286737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:16.286737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:16.286737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:16.286737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:16.286737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:16.286737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:16.286737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:16.286737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:16.286737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:16.286737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:16.286737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:16.286737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:16.286737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:16.286737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:16.287667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:16.287667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:16.287667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:16.287667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:16.287667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:16.287667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:16.287667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:16.287667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:16.287667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:16.287667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:16.287667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:16.287667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:16.287667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:16.287667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:16.287667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:16.287667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:16.288509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:16.288509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:16.288509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:16.288509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:16.288509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:16.288509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:16.288509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:16.288509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:16.288509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:16.288509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:16.288509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:20:16.288509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:16.289203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50c4cd-7f58-4fa2-917b-7c554b04a3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:16.289203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50c4cd-7f58-4fa2-917b-7c554b04a3fd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:16.289203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50c4cd-7f58-4fa2-917b-7c554b04a3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:16.289905 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50c4cd-7f58-4fa2-917b-7c554b04a3fd None admin] PATH_INFO: `/v3/groups/fcb689c1837d41868e49f2af949f3d30` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:16.292387 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 198/394] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:16.292821 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50c4cd-7f58-4fa2-917b-7c554b04a3fd None admin] RBAC: Authorizing `identity:get_group(group_id=fcb689c1837d41868e49f2af949f3d30)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:16.294308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50c4cd-7f58-4fa2-917b-7c554b04a3fd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:16.296108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 197/395] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 16:20:15 2022] GET /identity/v3/groups/fcb689c1837d41868e49f2af949f3d30 => generated 226 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:16.301648 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876dff2-cd58-4f3c-986c-e510d6d81759 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:16.304109 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50c4cd-7f58-4fa2-917b-7c554b04a3fd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:16.336391 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:16.480786 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876dff2-cd58-4f3c-986c-e510d6d81759 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:16.522477 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cdab4c-ef4a-42b3-af8d-0bf2ae04abbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:16.523400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdab4c-ef4a-42b3-af8d-0bf2ae04abbe None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:16.523841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdab4c-ef4a-42b3-af8d-0bf2ae04abbe None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:16.524281 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cdab4c-ef4a-42b3-af8d-0bf2ae04abbe None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:16.525933 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cdab4c-ef4a-42b3-af8d-0bf2ae04abbe None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:16.527761 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cdab4c-ef4a-42b3-af8d-0bf2ae04abbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:16.529350 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cdab4c-ef4a-42b3-af8d-0bf2ae04abbe None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:16.534590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50c4cd-7f58-4fa2-917b-7c554b04a3fd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:16.550517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 199/396] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:20:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:16.555921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cdab4c-ef4a-42b3-af8d-0bf2ae04abbe None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:16.599386 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:16.632748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc9dac-2072-4ffa-ad43-530047eee2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:16.633651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc9dac-2072-4ffa-ad43-530047eee2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:16.633936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc9dac-2072-4ffa-ad43-530047eee2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:16.634212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc9dac-2072-4ffa-ad43-530047eee2c2 None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:16.635463 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc9dac-2072-4ffa-ad43-530047eee2c2 None admin] RBAC: Authorizing `identity:get_project(project_id=f82f5c51617d45fc90355caaf5b8a8b2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:16.636970 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc9dac-2072-4ffa-ad43-530047eee2c2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:16.639004 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 198/397] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:20:16 2022] GET /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2 => generated 298 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:16.661105 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc9dac-2072-4ffa-ad43-530047eee2c2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:16.694991 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cdab4c-ef4a-42b3-af8d-0bf2ae04abbe None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:16.738385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbafd3-6564-4ade-8244-b3af5e2883b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:16.741898 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbafd3-6564-4ade-8244-b3af5e2883b7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:16.742387 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbafd3-6564-4ade-8244-b3af5e2883b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:16.744148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbafd3-6564-4ade-8244-b3af5e2883b7 None admin] PATH_INFO: `/v3/groups/fcb689c1837d41868e49f2af949f3d30` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:16.746571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbafd3-6564-4ade-8244-b3af5e2883b7 None admin] RBAC: Authorizing `identity:get_group(group_id=fcb689c1837d41868e49f2af949f3d30)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:16.748335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbafd3-6564-4ade-8244-b3af5e2883b7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:16.754752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 200/398] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 16:20:16 2022] GET /identity/v3/groups/fcb689c1837d41868e49f2af949f3d30 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:16.761645 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbafd3-6564-4ade-8244-b3af5e2883b7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:16.812841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:16.837292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc9dac-2072-4ffa-ad43-530047eee2c2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:16.872726 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:16.881182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efab18b-0c9d-436e-8e71-5e2f4990c01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:16.882088 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efab18b-0c9d-436e-8e71-5e2f4990c01f None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:16.882369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efab18b-0c9d-436e-8e71-5e2f4990c01f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:16.882648 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efab18b-0c9d-436e-8e71-5e2f4990c01f None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2/groups/fcb689c1837d41868e49f2af949f3d30/roles/60519d06a8c94e6c82462e5d79d9856b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:16.884026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbafd3-6564-4ade-8244-b3af5e2883b7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:16.884926 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efab18b-0c9d-436e-8e71-5e2f4990c01f None admin] RBAC: Authorizing `identity:create_grant(project_id=f82f5c51617d45fc90355caaf5b8a8b2, group_id=fcb689c1837d41868e49f2af949f3d30, role_id=60519d06a8c94e6c82462e5d79d9856b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:16.887641 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efab18b-0c9d-436e-8e71-5e2f4990c01f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:16.905279 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 199/399] 10.222.0.41 () {58 vars in 1442 bytes} [Fri May 27 16:20:16 2022] PUT /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2/groups/fcb689c1837d41868e49f2af949f3d30/roles/60519d06a8c94e6c82462e5d79d9856b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:20:16.914958 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dbcf0-31ee-4d5b-9783-dfd161089be1 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:16.915739 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dbcf0-31ee-4d5b-9783-dfd161089be1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:16.916558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dbcf0-31ee-4d5b-9783-dfd161089be1 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:16.924848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 200/400] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:16 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:16.928922 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed653154-0a71-4b86-aa91-6d34284a1807 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:16.929735 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed653154-0a71-4b86-aa91-6d34284a1807 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:16.930501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed653154-0a71-4b86-aa91-6d34284a1807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:16.951662 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e206e13-700d-43cc-a52a-3c839b3900d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:16.953756 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e206e13-700d-43cc-a52a-3c839b3900d3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:16.955751 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e206e13-700d-43cc-a52a-3c839b3900d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:16.957740 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e206e13-700d-43cc-a52a-3c839b3900d3 None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:16.960216 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e206e13-700d-43cc-a52a-3c839b3900d3 None admin] RBAC: Authorizing `identity:get_project(project_id=b99cf27cf22249fdb99befb43f95a1d6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:16.964419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e206e13-700d-43cc-a52a-3c839b3900d3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:16.967625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 201/401] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:20:16 2022] GET /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:16.970284 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ed653154-0a71-4b86-aa91-6d34284a1807 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:16.971760 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ed653154-0a71-4b86-aa91-6d34284a1807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:16.974871 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e206e13-700d-43cc-a52a-3c839b3900d3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:17.093543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 201/402] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:17.132391 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed653154-0a71-4b86-aa91-6d34284a1807 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:17.181632 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e206e13-700d-43cc-a52a-3c839b3900d3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:17.220502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1678bc9-6c13-4b4b-8022-b7ecd54db362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:17.221772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1678bc9-6c13-4b4b-8022-b7ecd54db362 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:17.222247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1678bc9-6c13-4b4b-8022-b7ecd54db362 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:17.222708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1678bc9-6c13-4b4b-8022-b7ecd54db362 None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6/groups/fcb689c1837d41868e49f2af949f3d30/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:17.225182 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1678bc9-6c13-4b4b-8022-b7ecd54db362 None admin] RBAC: Authorizing `identity:create_grant(project_id=b99cf27cf22249fdb99befb43f95a1d6, group_id=fcb689c1837d41868e49f2af949f3d30, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:17.226863 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1678bc9-6c13-4b4b-8022-b7ecd54db362 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:17.234717 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:17.250871 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 202/403] 10.222.0.41 () {58 vars in 1442 bytes} [Fri May 27 16:20:16 2022] PUT /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6/groups/fcb689c1837d41868e49f2af949f3d30/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:20:17.289952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed653154-0a71-4b86-aa91-6d34284a1807 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:17.333315 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfd392-a5d0-46d8-99e7-ebbd1461380b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:17.334289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfd392-a5d0-46d8-99e7-ebbd1461380b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:17.334637 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfd392-a5d0-46d8-99e7-ebbd1461380b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:17.334909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfd392-a5d0-46d8-99e7-ebbd1461380b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:17.348109 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfd392-a5d0-46d8-99e7-ebbd1461380b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:17.356698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-56cfd392-a5d0-46d8-99e7-ebbd1461380b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:20:17.356698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:17.356698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:17.356698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:17.356698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:17.356698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:17.356698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:17.356698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:17.356698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:17.356698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:17.356698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:17.356698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:17.356698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:17.356698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:17.356698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:17.356698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:17.357706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:17.357706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:17.357706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:17.357706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:17.357706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:17.357706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:17.357706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:17.357706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:17.357706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:17.357706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:17.357706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:17.357706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:17.357706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:17.357706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:17.357706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:17.357706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:17.358520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:17.358520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:17.358520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:17.358520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:17.358520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:17.358520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:17.358520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:17.358520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:17.358520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:17.358520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:17.358520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:20:17.358520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:17.363103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 202/404] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:20:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:17.364661 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1678bc9-6c13-4b4b-8022-b7ecd54db362 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:17.391312 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:17.488642 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a50abd-a7b3-4536-9264-44c7276d0979 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:17.489066 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a50abd-a7b3-4536-9264-44c7276d0979 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:17.489424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a50abd-a7b3-4536-9264-44c7276d0979 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:17.490822 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 203/405] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:17.496754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1678bc9-6c13-4b4b-8022-b7ecd54db362 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:17.497549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103605d1-d773-45c1-8980-ad5c8a8af052 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:17.497915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103605d1-d773-45c1-8980-ad5c8a8af052 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:17.498253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103605d1-d773-45c1-8980-ad5c8a8af052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:17.533270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-103605d1-d773-45c1-8980-ad5c8a8af052 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:17.534597 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-103605d1-d773-45c1-8980-ad5c8a8af052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:17.545671 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6ebec-1cf8-4af1-9ee3-6bca264adfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:17.546375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6ebec-1cf8-4af1-9ee3-6bca264adfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:17.546661 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6ebec-1cf8-4af1-9ee3-6bca264adfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:17.546938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6ebec-1cf8-4af1-9ee3-6bca264adfe8 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:17.547719 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6ebec-1cf8-4af1-9ee3-6bca264adfe8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:17.548041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6ebec-1cf8-4af1-9ee3-6bca264adfe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:17.549505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6ebec-1cf8-4af1-9ee3-6bca264adfe8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:17.566842 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 203/406] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:17.573451 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6ebec-1cf8-4af1-9ee3-6bca264adfe8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:17.626267 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 204/407] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:17.648927 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103605d1-d773-45c1-8980-ad5c8a8af052 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:17.684383 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:17.711084 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6ebec-1cf8-4af1-9ee3-6bca264adfe8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:17.754396 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:17.777814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6215f47-936c-4a34-ad87-1d6ab399e575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:17.778760 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6215f47-936c-4a34-ad87-1d6ab399e575 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:17.779046 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6215f47-936c-4a34-ad87-1d6ab399e575 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:17.779322 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6215f47-936c-4a34-ad87-1d6ab399e575 None admin] PATH_INFO: `/v3/groups/fcb689c1837d41868e49f2af949f3d30` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:17.784792 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6215f47-936c-4a34-ad87-1d6ab399e575 None admin] RBAC: Authorizing `identity:get_group(group_id=fcb689c1837d41868e49f2af949f3d30)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:17.786476 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6215f47-936c-4a34-ad87-1d6ab399e575 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:17.788555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 204/408] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 16:20:17 2022] GET /identity/v3/groups/fcb689c1837d41868e49f2af949f3d30 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:17.802724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6215f47-936c-4a34-ad87-1d6ab399e575 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:17.809014 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103605d1-d773-45c1-8980-ad5c8a8af052 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:17.845368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86526a4e-6428-4186-884a-b1bb3508c7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:17.846178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86526a4e-6428-4186-884a-b1bb3508c7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:17.846458 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86526a4e-6428-4186-884a-b1bb3508c7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:17.846727 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86526a4e-6428-4186-884a-b1bb3508c7d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:17.857642 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86526a4e-6428-4186-884a-b1bb3508c7d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:17.865725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-86526a4e-6428-4186-884a-b1bb3508c7d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:20:17.865725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:17.865725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:17.865725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:17.865725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:17.865725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:17.865725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:17.865725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:17.865725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:17.865725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:17.865725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:17.865725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:17.865725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:17.865725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:17.865725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:17.865725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:17.866663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:17.866663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:17.866663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:17.866663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:17.866663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:17.866663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:17.866663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:17.866663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:17.866663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:17.866663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:17.866663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:17.866663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:17.866663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:17.866663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:17.866663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:17.866663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:17.867477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:17.867477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:17.867477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:17.867477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:17.867477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:17.867477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:17.867477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:17.867477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:17.867477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:17.867477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:17.867477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:20:17.867477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:17.868135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 205/409] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:20:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:17.872990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86526a4e-6428-4186-884a-b1bb3508c7d5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:17.977089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6215f47-936c-4a34-ad87-1d6ab399e575 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:17.991229 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86526a4e-6428-4186-884a-b1bb3508c7d5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:18.012607 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:18.014590 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96416964-b67c-49a6-b5ed-2ac44dd0a47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:18.015893 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96416964-b67c-49a6-b5ed-2ac44dd0a47d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:18.016289 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96416964-b67c-49a6-b5ed-2ac44dd0a47d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:18.016637 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96416964-b67c-49a6-b5ed-2ac44dd0a47d None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:18.018364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96416964-b67c-49a6-b5ed-2ac44dd0a47d None admin] RBAC: Authorizing `identity:get_project(project_id=b99cf27cf22249fdb99befb43f95a1d6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:18.020069 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96416964-b67c-49a6-b5ed-2ac44dd0a47d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:18.022488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 205/410] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:20:17 2022] GET /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:18.023834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23eab60-bfcb-4c9f-bc58-640bd5c15f3f None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:18.024215 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23eab60-bfcb-4c9f-bc58-640bd5c15f3f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:18.024561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23eab60-bfcb-4c9f-bc58-640bd5c15f3f None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:18.026135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 206/411] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:18.030964 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23eab60-bfcb-4c9f-bc58-640bd5c15f3f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:18.040697 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d7780-deef-468e-b721-a13acc8024fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:18.041519 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d7780-deef-468e-b721-a13acc8024fa None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:18.041906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d7780-deef-468e-b721-a13acc8024fa None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:18.042283 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d7780-deef-468e-b721-a13acc8024fa None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:18.043145 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d7780-deef-468e-b721-a13acc8024fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:18.043553 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d7780-deef-468e-b721-a13acc8024fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:18.045125 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d7780-deef-468e-b721-a13acc8024fa None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:18.054728 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 206/412] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:18.060720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2da7bb-bbd4-41c9-abd4-470d673a0c5e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:18.061111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2da7bb-bbd4-41c9-abd4-470d673a0c5e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:18.061492 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2da7bb-bbd4-41c9-abd4-470d673a0c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:18.061836 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:18.079721 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8c2da7bb-bbd4-41c9-abd4-470d673a0c5e None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:18.081674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8c2da7bb-bbd4-41c9-abd4-470d673a0c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:18.140081 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23eab60-bfcb-4c9f-bc58-640bd5c15f3f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:18.160396 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 207/413] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:18.161443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2da7bb-bbd4-41c9-abd4-470d673a0c5e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:18.178216 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f1fac-c98b-4d3b-b6c6-45cccd99b9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:18.179192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f1fac-c98b-4d3b-b6c6-45cccd99b9d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:18.179524 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f1fac-c98b-4d3b-b6c6-45cccd99b9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:18.179908 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f1fac-c98b-4d3b-b6c6-45cccd99b9d3 None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6/groups/fcb689c1837d41868e49f2af949f3d30/roles/60519d06a8c94e6c82462e5d79d9856b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:18.182191 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f1fac-c98b-4d3b-b6c6-45cccd99b9d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b99cf27cf22249fdb99befb43f95a1d6, group_id=fcb689c1837d41868e49f2af949f3d30, role_id=60519d06a8c94e6c82462e5d79d9856b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:18.183713 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f1fac-c98b-4d3b-b6c6-45cccd99b9d3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:18.208310 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 207/414] 10.222.0.41 () {58 vars in 1442 bytes} [Fri May 27 16:20:18 2022] PUT /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6/groups/fcb689c1837d41868e49f2af949f3d30/roles/60519d06a8c94e6c82462e5d79d9856b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:20:18.209286 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f1fac-c98b-4d3b-b6c6-45cccd99b9d3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:18.325834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2da7bb-bbd4-41c9-abd4-470d673a0c5e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:18.337257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:18.360911 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:18.379180 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c111365-9c41-430c-b035-cde79dd49359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:18.380108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c111365-9c41-430c-b035-cde79dd49359 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:18.380397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c111365-9c41-430c-b035-cde79dd49359 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:18.380674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c111365-9c41-430c-b035-cde79dd49359 None admin] PATH_INFO: `/v3/groups/b61388b5bf4f4153a25d648cf683927d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:18.383284 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c111365-9c41-430c-b035-cde79dd49359 None admin] RBAC: Authorizing `identity:get_group(group_id=b61388b5bf4f4153a25d648cf683927d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:18.384935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c111365-9c41-430c-b035-cde79dd49359 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:18.386953 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 208/415] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 16:20:18 2022] GET /identity/v3/groups/b61388b5bf4f4153a25d648cf683927d => generated 229 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:18.387675 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f1fac-c98b-4d3b-b6c6-45cccd99b9d3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:18.397190 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c111365-9c41-430c-b035-cde79dd49359 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:18.443727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6631a6-d85e-4e1e-a559-08e5d6d9decc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:18.444843 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6631a6-d85e-4e1e-a559-08e5d6d9decc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:18.446530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6631a6-d85e-4e1e-a559-08e5d6d9decc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:18.446951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6631a6-d85e-4e1e-a559-08e5d6d9decc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:18.468653 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6631a6-d85e-4e1e-a559-08e5d6d9decc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:18.477130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-fb6631a6-d85e-4e1e-a559-08e5d6d9decc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:20:18.477130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:18.477130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:18.477130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:18.477130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:18.477130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:18.477130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:18.477130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:18.477130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:18.477130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:18.477130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:18.477130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:18.477130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:18.477130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:18.477130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:18.477130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:18.478165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:18.478165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:18.478165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:18.478165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:18.478165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:18.478165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:18.478165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:18.478165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:18.478165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:18.478165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:18.478165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:18.478165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:18.478165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:18.478165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:18.478165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:18.478165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:18.479559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:18.479559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:18.479559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:18.479559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:18.479559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:18.479559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:18.479559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:18.479559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:18.479559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:18.479559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:18.479559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:20:18.479559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:18.479559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 208/416] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:18.489741 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6631a6-d85e-4e1e-a559-08e5d6d9decc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:18.545724 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c111365-9c41-430c-b035-cde79dd49359 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:18.601998 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d954d4-26b1-4d7a-a333-c6fb6739cb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:18.603368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d954d4-26b1-4d7a-a333-c6fb6739cb52 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:18.603841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d954d4-26b1-4d7a-a333-c6fb6739cb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:18.604325 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d954d4-26b1-4d7a-a333-c6fb6739cb52 None admin] PATH_INFO: `/v3/projects/e4a92a8dcb534d23b8816fa07dbb1878` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:18.605826 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d954d4-26b1-4d7a-a333-c6fb6739cb52 None admin] RBAC: Authorizing `identity:get_project(project_id=e4a92a8dcb534d23b8816fa07dbb1878)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:18.607507 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d954d4-26b1-4d7a-a333-c6fb6739cb52 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:18.609798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 209/417] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:20:18 2022] GET /identity/v3/projects/e4a92a8dcb534d23b8816fa07dbb1878 => generated 344 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:18.616609 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d954d4-26b1-4d7a-a333-c6fb6739cb52 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:18.672142 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:18.730163 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d954d4-26b1-4d7a-a333-c6fb6739cb52 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:18.742187 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6631a6-d85e-4e1e-a559-08e5d6d9decc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:18.766094 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184ccac-7a98-42fa-930d-17fe85db1a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:18.767345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184ccac-7a98-42fa-930d-17fe85db1a51 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:18.767818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184ccac-7a98-42fa-930d-17fe85db1a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:18.768349 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184ccac-7a98-42fa-930d-17fe85db1a51 None admin] PATH_INFO: `/v3/projects/e4a92a8dcb534d23b8816fa07dbb1878/groups/b61388b5bf4f4153a25d648cf683927d/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:18.770655 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184ccac-7a98-42fa-930d-17fe85db1a51 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4a92a8dcb534d23b8816fa07dbb1878, group_id=b61388b5bf4f4153a25d648cf683927d, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:18.772438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184ccac-7a98-42fa-930d-17fe85db1a51 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:18.791693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 210/418] 10.222.0.41 () {58 vars in 1442 bytes} [Fri May 27 16:20:18 2022] PUT /identity/v3/projects/e4a92a8dcb534d23b8816fa07dbb1878/groups/b61388b5bf4f4153a25d648cf683927d/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:20:18.810897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d0bb9-6c5c-40ed-b36e-91729758c854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:18.811986 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d0bb9-6c5c-40ed-b36e-91729758c854 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:18.812554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d0bb9-6c5c-40ed-b36e-91729758c854 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:18.813048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d0bb9-6c5c-40ed-b36e-91729758c854 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:18.814092 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d0bb9-6c5c-40ed-b36e-91729758c854 None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:18.814586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d0bb9-6c5c-40ed-b36e-91729758c854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:18.816248 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d0bb9-6c5c-40ed-b36e-91729758c854 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:18.819439 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:18.829856 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 209/419] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:20:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:18.837648 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184ccac-7a98-42fa-930d-17fe85db1a51 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:18.990373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184ccac-7a98-42fa-930d-17fe85db1a51 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:18.993332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:19.035828 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f67fd-5a9c-46e1-9420-672c1219e39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:19.037084 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f67fd-5a9c-46e1-9420-672c1219e39a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:19.037370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f67fd-5a9c-46e1-9420-672c1219e39a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:19.037650 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f67fd-5a9c-46e1-9420-672c1219e39a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:19.116057 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f67fd-5a9c-46e1-9420-672c1219e39a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:19.117510 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f67fd-5a9c-46e1-9420-672c1219e39a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:19.242837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 211/420] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:19.249860 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d0bb9-6c5c-40ed-b36e-91729758c854 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:19.408679 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d0bb9-6c5c-40ed-b36e-91729758c854 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:19.454142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5aeb37-5642-453c-9d77-e997454b2838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:19.456077 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aeb37-5642-453c-9d77-e997454b2838 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:19.456605 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aeb37-5642-453c-9d77-e997454b2838 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:19.457113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aeb37-5642-453c-9d77-e997454b2838 None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:19.458890 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5aeb37-5642-453c-9d77-e997454b2838 None admin] RBAC: Authorizing `identity:get_project(project_id=f82f5c51617d45fc90355caaf5b8a8b2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:19.460799 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5aeb37-5642-453c-9d77-e997454b2838 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:19.462949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 210/421] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:20:19 2022] GET /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:19.468607 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f67fd-5a9c-46e1-9420-672c1219e39a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:19.471852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:19.603555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f67fd-5a9c-46e1-9420-672c1219e39a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:19.652668 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e5b71-5a95-4c89-8437-b091467cd76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:19.653552 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e5b71-5a95-4c89-8437-b091467cd76f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:19.653833 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e5b71-5a95-4c89-8437-b091467cd76f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:19.654111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e5b71-5a95-4c89-8437-b091467cd76f None admin] PATH_INFO: `/v3/groups/fcb689c1837d41868e49f2af949f3d30` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:19.656715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e5b71-5a95-4c89-8437-b091467cd76f None admin] RBAC: Authorizing `identity:get_group(group_id=fcb689c1837d41868e49f2af949f3d30)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:19.658181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e5b71-5a95-4c89-8437-b091467cd76f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:19.660139 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 212/422] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 16:20:19 2022] GET /identity/v3/groups/fcb689c1837d41868e49f2af949f3d30 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:19.665919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5aeb37-5642-453c-9d77-e997454b2838 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:19.783536 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:19.837107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5aeb37-5642-453c-9d77-e997454b2838 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:19.880292 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391047b7-0e34-44cc-af8c-3ecfd97d04ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:19.880973 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391047b7-0e34-44cc-af8c-3ecfd97d04ba None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:19.881264 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391047b7-0e34-44cc-af8c-3ecfd97d04ba None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:19.881534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391047b7-0e34-44cc-af8c-3ecfd97d04ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:19.882365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391047b7-0e34-44cc-af8c-3ecfd97d04ba None admin] RBAC: Adding query filter params (group.id=fcb689c1837d41868e49f2af949f3d30, role.id=91889a59745c4d8185400f69d84eb50e, scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:19.882681 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391047b7-0e34-44cc-af8c-3ecfd97d04ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:19.884192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391047b7-0e34-44cc-af8c-3ecfd97d04ba None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:19.897892 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 211/423] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 16:20:19 2022] GET /identity/v3/role_assignments?group.id=fcb689c1837d41868e49f2af949f3d30&scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2&role.id=91889a59745c4d8185400f69d84eb50e => generated 611 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:19.995990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e3a99-6643-4361-a95e-5b3f6f3c97d0 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:19.996509 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e3a99-6643-4361-a95e-5b3f6f3c97d0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:19.996509 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e3a99-6643-4361-a95e-5b3f6f3c97d0 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:19.997894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 213/424] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:20.000636 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07b3de-8881-43ea-be00-7a4c1089df7a None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:20.000924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07b3de-8881-43ea-be00-7a4c1089df7a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:20.001200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07b3de-8881-43ea-be00-7a4c1089df7a None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:20.002858 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 212/425] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:20.003826 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862ae97-fe76-40a8-9970-21c2d83aa246 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:20.004228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862ae97-fe76-40a8-9970-21c2d83aa246 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:20.004633 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862ae97-fe76-40a8-9970-21c2d83aa246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:20.017085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49614834-9697-4f60-a8bc-b035ca5538da None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:20.017409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49614834-9697-4f60-a8bc-b035ca5538da None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:20.017638 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49614834-9697-4f60-a8bc-b035ca5538da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:20.031427 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0862ae97-fe76-40a8-9970-21c2d83aa246 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:20.032668 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0862ae97-fe76-40a8-9970-21c2d83aa246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:20.052998 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-49614834-9697-4f60-a8bc-b035ca5538da None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:20.054253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-49614834-9697-4f60-a8bc-b035ca5538da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:20.158546 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 214/426] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:20:20.176564 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 213/427] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:20:20.186579 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862ae97-fe76-40a8-9970-21c2d83aa246 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:20.188845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:20.209487 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49614834-9697-4f60-a8bc-b035ca5538da None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:20.284482 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:20.303224 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862ae97-fe76-40a8-9970-21c2d83aa246 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:20.324717 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49614834-9697-4f60-a8bc-b035ca5538da None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:20.347922 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d16f51-e67e-4b15-808b-8b94e1b42406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:20.349507 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d16f51-e67e-4b15-808b-8b94e1b42406 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:20.349791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d16f51-e67e-4b15-808b-8b94e1b42406 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:20.350064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d16f51-e67e-4b15-808b-8b94e1b42406 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:20.368349 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d16f51-e67e-4b15-808b-8b94e1b42406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:20.370593 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b0355-28c6-46e7-b1ba-e28b3d2dd5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:20.371446 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b0355-28c6-46e7-b1ba-e28b3d2dd5bb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:20.371727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b0355-28c6-46e7-b1ba-e28b3d2dd5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:20.372067 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b0355-28c6-46e7-b1ba-e28b3d2dd5bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:20.377194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-20d16f51-e67e-4b15-808b-8b94e1b42406 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:20:20.377194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:20.377194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:20.377194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:20.377194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:20.377194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:20.377194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:20.377194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:20.377194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:20.377194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:20.377194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:20.377194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:20.377194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:20.377194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:20.377194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:20.377194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:20.378108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:20.378108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:20.378108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:20.378108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:20.378108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:20.378108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:20.378108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:20.378108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:20.378108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:20.378108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:20.378108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:20.378108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:20.378108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:20.378108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:20.378108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:20.378108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:20.378924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:20.378924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:20.378924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:20.378924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:20.378924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:20.378924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:20.378924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:20.378924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:20.378924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:20.378924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:20.378924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:20:20.378924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:20.378924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 215/428] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:20:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:20.384673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d16f51-e67e-4b15-808b-8b94e1b42406 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:20.390474 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b0355-28c6-46e7-b1ba-e28b3d2dd5bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:20.404117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ba3b0355-28c6-46e7-b1ba-e28b3d2dd5bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 16:20:20.404117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:20.404117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:20.404117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:20.404117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:20.404117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:20.404117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:20.404117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:20.404117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:20.404117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:20.404117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:20.404117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:20.404117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:20.404117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:20.404117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:20.404117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:20.405358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:20.405358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:20.405358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:20.405358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:20.405358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:20.405358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:20.405358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:20.405358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:20.405358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:20.405358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:20.405358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:20.405358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:20.405358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:20.405358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:20.405358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:20.405358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:20.406275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:20.406275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:20.406275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:20.406275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:20.406275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:20.406275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:20.406275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:20.406275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:20.406275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:20.406275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:20.406275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 16:20:20.406275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:20.406275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 214/429] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:20.417090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b0355-28c6-46e7-b1ba-e28b3d2dd5bb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:20.465236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:20.521467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d16f51-e67e-4b15-808b-8b94e1b42406 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:20.550951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b0355-28c6-46e7-b1ba-e28b3d2dd5bb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:20.564489 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee4d62-93a2-4943-a9e3-9547c587a975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:20.565352 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee4d62-93a2-4943-a9e3-9547c587a975 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:20.565790 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee4d62-93a2-4943-a9e3-9547c587a975 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:20.566121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee4d62-93a2-4943-a9e3-9547c587a975 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:20.567772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee4d62-93a2-4943-a9e3-9547c587a975 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:20.568248 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee4d62-93a2-4943-a9e3-9547c587a975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:20.569771 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee4d62-93a2-4943-a9e3-9547c587a975 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:20.579423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 216/430] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:20.580679 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:20.590129 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee4d62-93a2-4943-a9e3-9547c587a975 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:20.598166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733a586-8f15-47fd-8009-2f359de0b81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:20.599054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733a586-8f15-47fd-8009-2f359de0b81e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:20.599230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733a586-8f15-47fd-8009-2f359de0b81e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:20.599459 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733a586-8f15-47fd-8009-2f359de0b81e None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:20.600254 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733a586-8f15-47fd-8009-2f359de0b81e None admin] RBAC: Adding query filter params (name=member) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:20.600558 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733a586-8f15-47fd-8009-2f359de0b81e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:20.601969 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733a586-8f15-47fd-8009-2f359de0b81e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:20.615027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 215/431] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:20:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:20.619580 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733a586-8f15-47fd-8009-2f359de0b81e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:20.726492 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee4d62-93a2-4943-a9e3-9547c587a975 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:20.757514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:20.770346 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733a586-8f15-47fd-8009-2f359de0b81e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:20.772996 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158f75d-cd41-4bb4-b75f-ce1dd7ebb7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:20.773661 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158f75d-cd41-4bb4-b75f-ce1dd7ebb7ac None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:20.773945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158f75d-cd41-4bb4-b75f-ce1dd7ebb7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:20.774227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158f75d-cd41-4bb4-b75f-ce1dd7ebb7ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:20.825952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0668a-c3ab-46a6-b636-2359ccb6def6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:20.827852 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0668a-c3ab-46a6-b636-2359ccb6def6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:20.828373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0668a-c3ab-46a6-b636-2359ccb6def6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:20.828825 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0668a-c3ab-46a6-b636-2359ccb6def6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:20.876975 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158f75d-cd41-4bb4-b75f-ce1dd7ebb7ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:20.878804 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158f75d-cd41-4bb4-b75f-ce1dd7ebb7ac None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:20.905130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:20.930100 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0668a-c3ab-46a6-b636-2359ccb6def6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:20.931773 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0668a-c3ab-46a6-b636-2359ccb6def6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:21.001333 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 217/432] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:21.001333 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba523848-004d-4ca2-a393-ad43fb675914 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:21.001333 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba523848-004d-4ca2-a393-ad43fb675914 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:21.001333 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba523848-004d-4ca2-a393-ad43fb675914 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:21.001333 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 218/433] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:21.002977 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba523848-004d-4ca2-a393-ad43fb675914 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:21.031738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:21.062958 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 216/434] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:21.064301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7863aba-eddd-4b80-996f-5123d8eeef03 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:21.064591 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7863aba-eddd-4b80-996f-5123d8eeef03 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:21.064865 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7863aba-eddd-4b80-996f-5123d8eeef03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:21.082406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f7863aba-eddd-4b80-996f-5123d8eeef03 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:21.083502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f7863aba-eddd-4b80-996f-5123d8eeef03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:21.124638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba523848-004d-4ca2-a393-ad43fb675914 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:21.160677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cdf55-9235-4c74-8a63-c979f90e2341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:21.162139 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cdf55-9235-4c74-8a63-c979f90e2341 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:21.162632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cdf55-9235-4c74-8a63-c979f90e2341 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:21.163103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cdf55-9235-4c74-8a63-c979f90e2341 None admin] PATH_INFO: `/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:21.164637 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2cdf55-9235-4c74-8a63-c979f90e2341 None admin] RBAC: Authorizing `identity:get_project(project_id=f82f5c51617d45fc90355caaf5b8a8b2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:21.165861 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 217/435] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:21.166631 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2cdf55-9235-4c74-8a63-c979f90e2341 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:21.166739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7863aba-eddd-4b80-996f-5123d8eeef03 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:21.168956 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 219/436] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:20:21 2022] GET /identity/v3/projects/f82f5c51617d45fc90355caaf5b8a8b2 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:21.174673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cdf55-9235-4c74-8a63-c979f90e2341 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:21.186434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:21.281747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7863aba-eddd-4b80-996f-5123d8eeef03 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:21.290748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:21.301288 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cdf55-9235-4c74-8a63-c979f90e2341 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:21.318393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb4edd-5332-4510-a620-b4c12fef28b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:21.319408 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4edd-5332-4510-a620-b4c12fef28b2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:21.319762 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4edd-5332-4510-a620-b4c12fef28b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:21.320159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb4edd-5332-4510-a620-b4c12fef28b2 None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:21.321423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb4edd-5332-4510-a620-b4c12fef28b2 None admin] RBAC: Authorizing `identity:get_project(project_id=b99cf27cf22249fdb99befb43f95a1d6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:21.322979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb4edd-5332-4510-a620-b4c12fef28b2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:21.324798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 218/437] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:20:21 2022] GET /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:21.325629 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb4edd-5332-4510-a620-b4c12fef28b2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:21.342112 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8459c85-88ec-43c4-badc-047f211ca78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:21.342985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8459c85-88ec-43c4-badc-047f211ca78c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:21.343260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8459c85-88ec-43c4-badc-047f211ca78c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:21.343529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8459c85-88ec-43c4-badc-047f211ca78c None admin] PATH_INFO: `/v3/groups/fcb689c1837d41868e49f2af949f3d30` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:21.344706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8459c85-88ec-43c4-badc-047f211ca78c None admin] RBAC: Authorizing `identity:get_group(group_id=fcb689c1837d41868e49f2af949f3d30)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:21.346158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8459c85-88ec-43c4-badc-047f211ca78c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:21.352536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 220/438] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 16:20:21 2022] GET /identity/v3/groups/fcb689c1837d41868e49f2af949f3d30 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:21.352536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8459c85-88ec-43c4-badc-047f211ca78c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:21.421899 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:21.445951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb4edd-5332-4510-a620-b4c12fef28b2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:21.466898 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8459c85-88ec-43c4-badc-047f211ca78c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:21.483778 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55af94-f14c-4bfc-b090-14cbf4ff2146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:21.484651 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55af94-f14c-4bfc-b090-14cbf4ff2146 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:21.484936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55af94-f14c-4bfc-b090-14cbf4ff2146 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:21.485205 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55af94-f14c-4bfc-b090-14cbf4ff2146 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:21.495761 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55af94-f14c-4bfc-b090-14cbf4ff2146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:21.503150 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38aad3f-4a63-462d-ae0c-96e86ecafe6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:21.503944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ff55af94-f14c-4bfc-b090-14cbf4ff2146 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:20:21.503944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:21.503944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:21.503944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:21.503944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:21.503944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:21.503944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:21.503944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:21.503944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:21.503944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:21.503944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:21.503944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:21.503944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:21.503944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:21.503944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:21.503944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:21.505611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:21.505611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:21.505611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:21.505611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:21.505611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:21.505611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:21.505611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:21.505611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:21.505611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:21.505611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:21.505611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:21.505611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:21.505611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:21.505611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:21.505611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:21.505611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:21.506443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:21.506443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:21.506443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:21.506443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:21.506443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:21.506443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:21.506443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:21.506443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:21.506443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:21.506443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:21.506443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:20:21.506443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:21.507076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38aad3f-4a63-462d-ae0c-96e86ecafe6b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:21.507076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38aad3f-4a63-462d-ae0c-96e86ecafe6b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:21.507076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38aad3f-4a63-462d-ae0c-96e86ecafe6b None admin] PATH_INFO: `/v3/groups/fcb689c1837d41868e49f2af949f3d30` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:21.507251 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 219/439] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:20:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:21.507251 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55af94-f14c-4bfc-b090-14cbf4ff2146 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:21.508397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38aad3f-4a63-462d-ae0c-96e86ecafe6b None admin] RBAC: Authorizing `identity:get_group(group_id=fcb689c1837d41868e49f2af949f3d30)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:21.510387 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38aad3f-4a63-462d-ae0c-96e86ecafe6b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:21.517324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 221/440] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 16:20:21 2022] GET /identity/v3/groups/fcb689c1837d41868e49f2af949f3d30 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:21.517324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38aad3f-4a63-462d-ae0c-96e86ecafe6b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:21.545121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:21.617869 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38aad3f-4a63-462d-ae0c-96e86ecafe6b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:21.619040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55af94-f14c-4bfc-b090-14cbf4ff2146 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:21.653919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4016d3-cc0a-4415-9e43-bb3c4210bd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:21.654609 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4016d3-cc0a-4415-9e43-bb3c4210bd24 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:21.654890 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4016d3-cc0a-4415-9e43-bb3c4210bd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:21.655036 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8df25-adf5-419e-a059-2a4c90000c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:21.655143 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4016d3-cc0a-4415-9e43-bb3c4210bd24 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:21.655642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8df25-adf5-419e-a059-2a4c90000c37 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:21.655878 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4016d3-cc0a-4415-9e43-bb3c4210bd24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:21.655972 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8df25-adf5-419e-a059-2a4c90000c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:21.656212 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d8df25-adf5-419e-a059-2a4c90000c37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:21.656305 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4016d3-cc0a-4415-9e43-bb3c4210bd24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:21.657031 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8df25-adf5-419e-a059-2a4c90000c37 None admin] RBAC: Adding query filter params (group.id=fcb689c1837d41868e49f2af949f3d30, role.id=60519d06a8c94e6c82462e5d79d9856b, scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:21.657336 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8df25-adf5-419e-a059-2a4c90000c37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:21.657589 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4016d3-cc0a-4415-9e43-bb3c4210bd24 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:21.658780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d8df25-adf5-419e-a059-2a4c90000c37 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:21.664808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 220/441] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 16:20:21 2022] GET /identity/v3/role_assignments?group.id=fcb689c1837d41868e49f2af949f3d30&scope.project.id=f82f5c51617d45fc90355caaf5b8a8b2&role.id=60519d06a8c94e6c82462e5d79d9856b => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:21.665586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8df25-adf5-419e-a059-2a4c90000c37 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:21.666223 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 222/442] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:21.667422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05c841-e7f3-4439-95a8-c6061b092cf0 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:21.667716 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05c841-e7f3-4439-95a8-c6061b092cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:21.667982 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05c841-e7f3-4439-95a8-c6061b092cf0 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:21.669329 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 223/443] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:21.676047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5421520-a253-415c-ad1b-586320e4325e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:21.676047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5421520-a253-415c-ad1b-586320e4325e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:21.676328 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5421520-a253-415c-ad1b-586320e4325e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:21.682422 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:21.696388 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b5421520-a253-415c-ad1b-586320e4325e None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:21.697768 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b5421520-a253-415c-ad1b-586320e4325e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:21.784290 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 224/444] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:21.784290 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5421520-a253-415c-ad1b-586320e4325e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:21.808674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d8df25-adf5-419e-a059-2a4c90000c37 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:21.828251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:21.853723 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38c1e9-afc6-4016-83dc-41ebaeb89131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:21.854396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38c1e9-afc6-4016-83dc-41ebaeb89131 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:21.854682 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38c1e9-afc6-4016-83dc-41ebaeb89131 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:21.854950 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38c1e9-afc6-4016-83dc-41ebaeb89131 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:21.855804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38c1e9-afc6-4016-83dc-41ebaeb89131 None admin] RBAC: Adding query filter params (group.id=fcb689c1837d41868e49f2af949f3d30, role.id=91889a59745c4d8185400f69d84eb50e, scope.project.id=b99cf27cf22249fdb99befb43f95a1d6) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:21.856207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38c1e9-afc6-4016-83dc-41ebaeb89131 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:21.857673 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38c1e9-afc6-4016-83dc-41ebaeb89131 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:21.867585 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 221/445] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 16:20:21 2022] GET /identity/v3/role_assignments?group.id=fcb689c1837d41868e49f2af949f3d30&scope.project.id=b99cf27cf22249fdb99befb43f95a1d6&role.id=91889a59745c4d8185400f69d84eb50e => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:21.867585 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38c1e9-afc6-4016-83dc-41ebaeb89131 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:21.965671 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:21.966731 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5421520-a253-415c-ad1b-586320e4325e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:22.017318 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38c1e9-afc6-4016-83dc-41ebaeb89131 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:22.020677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f478-7ec8-485a-9189-ed783dc768ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:22.022422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f478-7ec8-485a-9189-ed783dc768ba None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:22.022730 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f478-7ec8-485a-9189-ed783dc768ba None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:22.022999 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f478-7ec8-485a-9189-ed783dc768ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:22.070321 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f42c3a-9a27-489b-b704-f300501db87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:22.071266 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f42c3a-9a27-489b-b704-f300501db87d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:22.071577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f42c3a-9a27-489b-b704-f300501db87d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:22.071854 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f42c3a-9a27-489b-b704-f300501db87d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:22.088204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f42c3a-9a27-489b-b704-f300501db87d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:22.097513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-94f42c3a-9a27-489b-b704-f300501db87d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:20:22.097513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:22.097513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:22.097513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:22.097513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:22.097513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:22.097513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:22.097513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:22.097513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:22.097513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:22.097513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:22.097513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:22.097513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:22.097513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:22.097513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:22.097513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:22.098555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:22.098555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:22.098555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:22.098555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:22.098555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:22.098555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:22.098555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:22.098555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:22.098555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:22.098555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:22.098555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:22.098555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:22.098555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:22.098555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:22.098555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:22.098555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:22.099368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:22.099368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:22.099368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:22.099368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:22.099368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:22.099368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:22.099368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:22.099368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:22.099368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:22.099368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:22.099368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:20:22.099368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:22.103948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 222/446] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:20:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:22.105465 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f42c3a-9a27-489b-b704-f300501db87d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:22.125314 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7f478-7ec8-485a-9189-ed783dc768ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:22.127907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7f478-7ec8-485a-9189-ed783dc768ba None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:22.155983 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:22.238829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f42c3a-9a27-489b-b704-f300501db87d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:22.264117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 225/447] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:22.267647 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:22.272581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f478-7ec8-485a-9189-ed783dc768ba None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:22.279105 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa02a7d-e447-4d6a-a675-734c8108671c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:22.279929 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa02a7d-e447-4d6a-a675-734c8108671c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:22.280283 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa02a7d-e447-4d6a-a675-734c8108671c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:22.280559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa02a7d-e447-4d6a-a675-734c8108671c None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:22.281307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa02a7d-e447-4d6a-a675-734c8108671c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:22.281607 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa02a7d-e447-4d6a-a675-734c8108671c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:22.283040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa02a7d-e447-4d6a-a675-734c8108671c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:22.297842 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 223/448] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:22.301702 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa02a7d-e447-4d6a-a675-734c8108671c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:22.395486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f478-7ec8-485a-9189-ed783dc768ba None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:22.413352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa02a7d-e447-4d6a-a675-734c8108671c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:22.419954 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:22.435406 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254eb9a-e707-4d18-8db4-28de12f10ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:22.436318 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254eb9a-e707-4d18-8db4-28de12f10ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:22.436603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254eb9a-e707-4d18-8db4-28de12f10ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:22.436907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254eb9a-e707-4d18-8db4-28de12f10ff4 None admin] PATH_INFO: `/v3/projects/b99cf27cf22249fdb99befb43f95a1d6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:22.438180 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254eb9a-e707-4d18-8db4-28de12f10ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=b99cf27cf22249fdb99befb43f95a1d6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:22.439667 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254eb9a-e707-4d18-8db4-28de12f10ff4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:22.441441 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 226/449] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:20:22 2022] GET /identity/v3/projects/b99cf27cf22249fdb99befb43f95a1d6 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:22.447064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254eb9a-e707-4d18-8db4-28de12f10ff4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:22.467386 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340aa7f-7ca1-4a34-962a-c5c7be2eff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:22.468544 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340aa7f-7ca1-4a34-962a-c5c7be2eff28 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:22.469054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340aa7f-7ca1-4a34-962a-c5c7be2eff28 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:22.469554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340aa7f-7ca1-4a34-962a-c5c7be2eff28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:22.548784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:22.560633 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340aa7f-7ca1-4a34-962a-c5c7be2eff28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:22.562087 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340aa7f-7ca1-4a34-962a-c5c7be2eff28 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:22.563909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254eb9a-e707-4d18-8db4-28de12f10ff4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:22.606699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a26dd9-b64e-4232-b655-f1a0bd426bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:22.608115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a26dd9-b64e-4232-b655-f1a0bd426bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:22.608568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a26dd9-b64e-4232-b655-f1a0bd426bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:22.609013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a26dd9-b64e-4232-b655-f1a0bd426bc5 None admin] PATH_INFO: `/v3/groups/fcb689c1837d41868e49f2af949f3d30` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:22.610851 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a26dd9-b64e-4232-b655-f1a0bd426bc5 None admin] RBAC: Authorizing `identity:get_group(group_id=fcb689c1837d41868e49f2af949f3d30)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:22.613363 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a26dd9-b64e-4232-b655-f1a0bd426bc5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:22.615928 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 227/450] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 16:20:22 2022] GET /identity/v3/groups/fcb689c1837d41868e49f2af949f3d30 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:22.625234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a26dd9-b64e-4232-b655-f1a0bd426bc5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:22.688851 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 224/451] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 16:20:22.690482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:22.695046 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340aa7f-7ca1-4a34-962a-c5c7be2eff28 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:22.735939 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a26dd9-b64e-4232-b655-f1a0bd426bc5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:22.768929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3816e3-b7fb-46a5-81a9-063a2ebbfc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:22.769563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3816e3-b7fb-46a5-81a9-063a2ebbfc30 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:22.770124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3816e3-b7fb-46a5-81a9-063a2ebbfc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:22.770394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3816e3-b7fb-46a5-81a9-063a2ebbfc30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:22.771221 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3816e3-b7fb-46a5-81a9-063a2ebbfc30 None admin] RBAC: Adding query filter params (group.id=fcb689c1837d41868e49f2af949f3d30, role.id=60519d06a8c94e6c82462e5d79d9856b, scope.project.id=b99cf27cf22249fdb99befb43f95a1d6) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:22.771528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3816e3-b7fb-46a5-81a9-063a2ebbfc30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:22.773006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3816e3-b7fb-46a5-81a9-063a2ebbfc30 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:22.778981 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 228/452] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 16:20:22 2022] GET /identity/v3/role_assignments?group.id=fcb689c1837d41868e49f2af949f3d30&scope.project.id=b99cf27cf22249fdb99befb43f95a1d6&role.id=60519d06a8c94e6c82462e5d79d9856b => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:22.786159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:22.798212 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340aa7f-7ca1-4a34-962a-c5c7be2eff28 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:22.839736 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853aadc0-cd73-4c07-ac1e-1e129bd47da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:22.840465 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853aadc0-cd73-4c07-ac1e-1e129bd47da3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:22.840823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853aadc0-cd73-4c07-ac1e-1e129bd47da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:22.841102 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853aadc0-cd73-4c07-ac1e-1e129bd47da3 None admin] PATH_INFO: `/v3/projects/e4a92a8dcb534d23b8816fa07dbb1878` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:22.842466 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853aadc0-cd73-4c07-ac1e-1e129bd47da3 None admin] RBAC: Authorizing `identity:get_project(project_id=e4a92a8dcb534d23b8816fa07dbb1878)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:22.843996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853aadc0-cd73-4c07-ac1e-1e129bd47da3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:22.846079 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 225/453] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:20:22 2022] GET /identity/v3/projects/e4a92a8dcb534d23b8816fa07dbb1878 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:22.852929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3816e3-b7fb-46a5-81a9-063a2ebbfc30 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:22.980550 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3816e3-b7fb-46a5-81a9-063a2ebbfc30 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:23.002656 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:23.018719 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3128a2-74cb-48fe-ac33-0b375beb9e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:23.019794 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3128a2-74cb-48fe-ac33-0b375beb9e86 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:23.020103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3128a2-74cb-48fe-ac33-0b375beb9e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:23.020390 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3128a2-74cb-48fe-ac33-0b375beb9e86 None admin] PATH_INFO: `/v3/groups/b61388b5bf4f4153a25d648cf683927d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:23.021780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3128a2-74cb-48fe-ac33-0b375beb9e86 None admin] RBAC: Authorizing `identity:get_group(group_id=b61388b5bf4f4153a25d648cf683927d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:23.023264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3128a2-74cb-48fe-ac33-0b375beb9e86 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:23.025037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 229/454] 10.222.0.41 () {56 vars in 1180 bytes} [Fri May 27 16:20:22 2022] GET /identity/v3/groups/b61388b5bf4f4153a25d648cf683927d => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:23.031150 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853aadc0-cd73-4c07-ac1e-1e129bd47da3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:23.149081 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853aadc0-cd73-4c07-ac1e-1e129bd47da3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:23.188420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c705bfd-12d2-448f-8f33-49a7b44937dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:23.189912 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c705bfd-12d2-448f-8f33-49a7b44937dd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:23.189912 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c705bfd-12d2-448f-8f33-49a7b44937dd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:23.189912 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c705bfd-12d2-448f-8f33-49a7b44937dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:23.190420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c705bfd-12d2-448f-8f33-49a7b44937dd None admin] RBAC: Adding query filter params (group.id=b61388b5bf4f4153a25d648cf683927d, role.id=e1e39192d3af465aa504728e32ab7cd2, scope.project.id=e4a92a8dcb534d23b8816fa07dbb1878) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:23.190728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c705bfd-12d2-448f-8f33-49a7b44937dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:23.192619 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c705bfd-12d2-448f-8f33-49a7b44937dd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:23.199201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 226/455] 10.222.0.41 () {56 vars in 1376 bytes} [Fri May 27 16:20:23 2022] GET /identity/v3/role_assignments?group.id=b61388b5bf4f4153a25d648cf683927d&scope.project.id=e4a92a8dcb534d23b8816fa07dbb1878&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:25.997023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f8624-cf39-497f-8e17-ccd33e266b2a None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:25.998076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f8624-cf39-497f-8e17-ccd33e266b2a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:25.998559 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f8624-cf39-497f-8e17-ccd33e266b2a None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:26.000499 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 230/456] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:26.005959 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc9a01-79a0-4b5b-8f9a-d8bf2a3cf97c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:26.006420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc9a01-79a0-4b5b-8f9a-d8bf2a3cf97c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:26.006495 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc9a01-79a0-4b5b-8f9a-d8bf2a3cf97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:26.033541 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ecfc9a01-79a0-4b5b-8f9a-d8bf2a3cf97c None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:26.034741 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ecfc9a01-79a0-4b5b-8f9a-d8bf2a3cf97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:26.060136 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:26.082788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c2802-b5e6-44ee-ae4e-f0a8b4c11f45 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:26.083078 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c2802-b5e6-44ee-ae4e-f0a8b4c11f45 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:26.083857 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c2802-b5e6-44ee-ae4e-f0a8b4c11f45 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:26.084918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 231/457] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:20:26.092087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bdd54-f0f2-4a2f-89f9-d9fb8aaf08c6 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:26.092668 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bdd54-f0f2-4a2f-89f9-d9fb8aaf08c6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:26.093128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05bdd54-f0f2-4a2f-89f9-d9fb8aaf08c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:26.125156 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b05bdd54-f0f2-4a2f-89f9-d9fb8aaf08c6 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:26.126674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b05bdd54-f0f2-4a2f-89f9-d9fb8aaf08c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:26.131561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 227/458] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:26.157485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc9a01-79a0-4b5b-8f9a-d8bf2a3cf97c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:26.231811 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 232/459] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:20:26.274081 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bdd54-f0f2-4a2f-89f9-d9fb8aaf08c6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:26.345138 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc9a01-79a0-4b5b-8f9a-d8bf2a3cf97c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:26.391826 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cec67-6eb9-4b36-aa49-b587f8ff5736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:26.392947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cec67-6eb9-4b36-aa49-b587f8ff5736 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:26.393390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cec67-6eb9-4b36-aa49-b587f8ff5736 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:26.395344 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cec67-6eb9-4b36-aa49-b587f8ff5736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:26.409587 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cec67-6eb9-4b36-aa49-b587f8ff5736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:26.411440 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cec67-6eb9-4b36-aa49-b587f8ff5736 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:26.437158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-223cec67-6eb9-4b36-aa49-b587f8ff5736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:26.437158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:26.437158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:26.437158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:26.437158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:26.437158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:26.437158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:26.437158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:26.437158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:26.437158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:26.437158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:26.437158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:26.437158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:26.437158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:26.437158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:26.438307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:26.438307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:26.438307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:26.438307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:26.438307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:26.438307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:26.438307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:26.438307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:26.438307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:26.438307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:26.438307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:26.438307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:26.438307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:26.438307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:26.438307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:26.438307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:26.438307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:26.439406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:26.439406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:26.439406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:26.439406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:26.442234 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 228/460] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:26.443875 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e4e7d-fe04-4fae-adbc-703409f0eebd None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:26.444315 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e4e7d-fe04-4fae-adbc-703409f0eebd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:26.444719 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e4e7d-fe04-4fae-adbc-703409f0eebd None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:26.446537 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 229/461] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:26.448463 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e4e7d-fe04-4fae-adbc-703409f0eebd None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:26.454443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:26.462155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05bdd54-f0f2-4a2f-89f9-d9fb8aaf08c6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:26.481536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:26.501006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682fd96-c680-4809-ac2b-e2ca9c6928a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:26.502191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682fd96-c680-4809-ac2b-e2ca9c6928a0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:26.502693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682fd96-c680-4809-ac2b-e2ca9c6928a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:26.503152 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682fd96-c680-4809-ac2b-e2ca9c6928a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:26.515678 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682fd96-c680-4809-ac2b-e2ca9c6928a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:26.517585 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682fd96-c680-4809-ac2b-e2ca9c6928a0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:26.537876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-3682fd96-c680-4809-ac2b-e2ca9c6928a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:26.537876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:26.537876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:26.537876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:26.537876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:26.537876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:26.537876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:26.537876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:26.537876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:26.537876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:26.537876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:26.537876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:26.537876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:26.537876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:26.537876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:26.538791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:26.538791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:26.538791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:26.538791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:26.538791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:26.538791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:26.538791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:26.538791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:26.538791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:26.538791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:26.538791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:26.538791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:26.538791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:26.538791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:26.538791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:26.538791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:26.538791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:26.539656 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:26.539656 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:26.539656 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:26.539656 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:26.542052 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 233/462] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:26.543638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77973fa4-a86f-4d15-a889-578a8d624dae None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:26.544137 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77973fa4-a86f-4d15-a889-578a8d624dae None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:26.544620 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77973fa4-a86f-4d15-a889-578a8d624dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:26.563321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-77973fa4-a86f-4d15-a889-578a8d624dae None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:26.564878 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-77973fa4-a86f-4d15-a889-578a8d624dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:26.583879 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e4e7d-fe04-4fae-adbc-703409f0eebd None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:26.629960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f84708-601f-4967-b21c-3ba9b65509db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:26.630733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f84708-601f-4967-b21c-3ba9b65509db None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:26.631015 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f84708-601f-4967-b21c-3ba9b65509db None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:26.631289 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f84708-601f-4967-b21c-3ba9b65509db None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:26.632042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f84708-601f-4967-b21c-3ba9b65509db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:26.632359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f84708-601f-4967-b21c-3ba9b65509db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:26.633914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f84708-601f-4967-b21c-3ba9b65509db None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:26.648026 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 234/463] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:26.649385 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77973fa4-a86f-4d15-a889-578a8d624dae None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:26.667127 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 230/464] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:26.673230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f84708-601f-4967-b21c-3ba9b65509db None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:26.772333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:26.777738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:26.781085 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77973fa4-a86f-4d15-a889-578a8d624dae None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:26.820335 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc93bc-f4fc-4843-895f-814b722afdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:26.821036 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc93bc-f4fc-4843-895f-814b722afdad None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:26.821352 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc93bc-f4fc-4843-895f-814b722afdad None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:26.821627 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc93bc-f4fc-4843-895f-814b722afdad None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:26.822332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc93bc-f4fc-4843-895f-814b722afdad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:26.822638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc93bc-f4fc-4843-895f-814b722afdad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:26.824103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc93bc-f4fc-4843-895f-814b722afdad None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:26.826681 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f84708-601f-4967-b21c-3ba9b65509db None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:26.838631 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 235/465] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:26.839594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc93bc-f4fc-4843-895f-814b722afdad None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:26.879264 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928142b1-87c1-4e1c-ae16-f369f6a51b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:26.880467 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928142b1-87c1-4e1c-ae16-f369f6a51b9e None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:26.880972 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928142b1-87c1-4e1c-ae16-f369f6a51b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:26.881437 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928142b1-87c1-4e1c-ae16-f369f6a51b9e None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:26.882739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928142b1-87c1-4e1c-ae16-f369f6a51b9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:26.884748 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928142b1-87c1-4e1c-ae16-f369f6a51b9e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:26.920313 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 231/466] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 16:20:26 2022] POST /identity/v3/users => generated 246 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:20:26.927124 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b65f50-6ca9-4580-968e-10a877733b0e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:26.927443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b65f50-6ca9-4580-968e-10a877733b0e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:26.927847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b65f50-6ca9-4580-968e-10a877733b0e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:26.935908 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 232/467] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:26 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:26.937060 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b65f50-6ca9-4580-968e-10a877733b0e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:26.997740 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc93bc-f4fc-4843-895f-814b722afdad None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:27.070973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f136886d-d9d2-41ec-b567-b6ca18302475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:27.072059 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136886d-d9d2-41ec-b567-b6ca18302475 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:27.072601 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136886d-d9d2-41ec-b567-b6ca18302475 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:27.073086 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f136886d-d9d2-41ec-b567-b6ca18302475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:27.098901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136886d-d9d2-41ec-b567-b6ca18302475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:27.102513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f136886d-d9d2-41ec-b567-b6ca18302475 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:27.130557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f136886d-d9d2-41ec-b567-b6ca18302475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:27.130557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:27.130557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:27.130557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:27.130557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:27.130557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:27.130557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:27.130557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:27.130557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:27.130557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:27.130557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:27.130557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:27.130557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:27.130557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:27.130557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:27.132471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:27.132471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:27.132471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:27.132471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:27.132471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:27.132471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:27.132471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:27.132471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:27.132471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:27.132471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:27.132471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:27.132471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:27.132471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:27.132471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:27.132471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:27.132471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:27.132471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:27.133462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:27.133462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:27.133462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:27.133462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:27.135362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 236/468] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:27.137443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb655154-7055-410e-894a-4c7c97812d2e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:27.137914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb655154-7055-410e-894a-4c7c97812d2e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:27.138348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb655154-7055-410e-894a-4c7c97812d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:27.145796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b65f50-6ca9-4580-968e-10a877733b0e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:27.162106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-fb655154-7055-410e-894a-4c7c97812d2e None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:27.163694 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fb655154-7055-410e-894a-4c7c97812d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:27.175350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:27.183895 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:27.208808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a6b36-95a8-43d5-abb6-c525ac1f6e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:27.209578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a6b36-95a8-43d5-abb6-c525ac1f6e2d None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:27.209868 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a6b36-95a8-43d5-abb6-c525ac1f6e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:27.210150 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a6b36-95a8-43d5-abb6-c525ac1f6e2d None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:27.210891 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a6b36-95a8-43d5-abb6-c525ac1f6e2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:27.212492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a6b36-95a8-43d5-abb6-c525ac1f6e2d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:27.246082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 233/469] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 16:20:26 2022] POST /identity/v3/users => generated 248 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:20:27.247520 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a6b36-95a8-43d5-abb6-c525ac1f6e2d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:27.280209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 237/470] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:27.313650 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb655154-7055-410e-894a-4c7c97812d2e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:27.442288 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a6b36-95a8-43d5-abb6-c525ac1f6e2d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:27.472106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb655154-7055-410e-894a-4c7c97812d2e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:27.488090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a68d71-3c04-479e-a3ff-796e1c7f9217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:27.489329 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a68d71-3c04-479e-a3ff-796e1c7f9217 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:27.489778 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a68d71-3c04-479e-a3ff-796e1c7f9217 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:27.490204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a68d71-3c04-479e-a3ff-796e1c7f9217 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:27.491240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a68d71-3c04-479e-a3ff-796e1c7f9217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:27.491753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a68d71-3c04-479e-a3ff-796e1c7f9217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:27.493412 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a68d71-3c04-479e-a3ff-796e1c7f9217 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:27.507458 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 234/471] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:27.514660 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a68d71-3c04-479e-a3ff-796e1c7f9217 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:27.515209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bea02d-bbac-4ac7-8308-1146b05050f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:27.516058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bea02d-bbac-4ac7-8308-1146b05050f8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:27.516358 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bea02d-bbac-4ac7-8308-1146b05050f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:27.516612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bea02d-bbac-4ac7-8308-1146b05050f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:27.528340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bea02d-bbac-4ac7-8308-1146b05050f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:27.529830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bea02d-bbac-4ac7-8308-1146b05050f8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:27.531904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:27.551591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f5bea02d-bbac-4ac7-8308-1146b05050f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:27.551591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:27.551591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:27.551591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:27.551591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:27.551591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:27.551591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:27.551591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:27.551591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:27.551591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:27.551591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:27.551591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:27.551591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:27.551591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:27.551591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:27.552752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:27.552752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:27.552752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:27.552752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:27.552752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:27.552752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:27.552752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:27.552752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:27.552752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:27.552752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:27.552752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:27.552752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:27.552752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:27.552752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:27.552752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:27.552752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:27.552752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:27.553633 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:27.553633 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:27.553633 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:27.553633 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:27.553633 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 238/472] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:27.559137 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bea02d-bbac-4ac7-8308-1146b05050f8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:27.562114 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:27.649174 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a68d71-3c04-479e-a3ff-796e1c7f9217 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:27.682109 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bea02d-bbac-4ac7-8308-1146b05050f8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:27.689812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279be87-6e9d-490f-b2b8-9147821d415d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:27.690790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279be87-6e9d-490f-b2b8-9147821d415d None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:27.691081 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279be87-6e9d-490f-b2b8-9147821d415d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:27.691399 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279be87-6e9d-490f-b2b8-9147821d415d None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:27.692226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279be87-6e9d-490f-b2b8-9147821d415d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:27.693962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279be87-6e9d-490f-b2b8-9147821d415d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:27.720714 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 235/473] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 16:20:27 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:20:27.720906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50302d-83be-4ef2-adc7-050e36a12b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:27.721496 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50302d-83be-4ef2-adc7-050e36a12b66 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:27.721777 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50302d-83be-4ef2-adc7-050e36a12b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:27.722047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50302d-83be-4ef2-adc7-050e36a12b66 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:27.722281 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a86ec-b756-4d98-a4ed-14a5cd1f727a None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:27.722868 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50302d-83be-4ef2-adc7-050e36a12b66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:27.723109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a86ec-b756-4d98-a4ed-14a5cd1f727a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:27.723212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50302d-83be-4ef2-adc7-050e36a12b66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:27.723449 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a86ec-b756-4d98-a4ed-14a5cd1f727a None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:27.724661 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50302d-83be-4ef2-adc7-050e36a12b66 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:27.725499 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 236/474] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:27.731623 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64111935-8572-400a-ad52-b3508a7e48b9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:27.731930 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64111935-8572-400a-ad52-b3508a7e48b9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:27.732280 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64111935-8572-400a-ad52-b3508a7e48b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:27.739315 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 239/475] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:27.745129 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50302d-83be-4ef2-adc7-050e36a12b66 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:27.754257 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-64111935-8572-400a-ad52-b3508a7e48b9 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:27.755876 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-64111935-8572-400a-ad52-b3508a7e48b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:27.844563 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 237/476] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:20:27.869048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64111935-8572-400a-ad52-b3508a7e48b9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:27.883402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:27.901098 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:27.964694 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50302d-83be-4ef2-adc7-050e36a12b66 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:27.986936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64111935-8572-400a-ad52-b3508a7e48b9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:28.003137 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711849d-7258-493d-9fe1-0210cc23a0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:28.004620 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711849d-7258-493d-9fe1-0210cc23a0b5 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:28.005073 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711849d-7258-493d-9fe1-0210cc23a0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:28.005603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711849d-7258-493d-9fe1-0210cc23a0b5 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:28.006570 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711849d-7258-493d-9fe1-0210cc23a0b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:28.008244 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711849d-7258-493d-9fe1-0210cc23a0b5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:28.026018 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8290dab-9765-44dd-b518-541102599c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:28.026792 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8290dab-9765-44dd-b518-541102599c34 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:28.027088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8290dab-9765-44dd-b518-541102599c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:28.027566 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8290dab-9765-44dd-b518-541102599c34 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:28.028712 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8290dab-9765-44dd-b518-541102599c34 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:28.030238 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8290dab-9765-44dd-b518-541102599c34 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:28.034235 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 240/477] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 16:20:27 2022] POST /identity/v3/users => generated 249 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:20:28.043503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.sql.core [None req-a8290dab-9765-44dd-b518-541102599c34 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 16:20:28.043503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 16:20:28.043503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [parameters: {'id': '28ab6be312044787a065f8fc1e6ebfa8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 16:20:28.043503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80264) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 16:20:28.062737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a8290dab-9765-44dd-b518-541102599c34 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 16:20:28.062737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:28.062737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 16:20:28.062737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 16:20:28.062737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 16:20:28.062737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 16:20:28.062737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 16:20:28.062737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application result = self._query(query) May 27 16:20:28.062737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 16:20:28.062737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application conn.query(q) May 27 16:20:28.062737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 16:20:28.062737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 16:20:28.062737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 16:20:28.062737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application result.read() May 27 16:20:28.062737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 16:20:28.063718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 16:20:28.063718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 16:20:28.063718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 16:20:28.063718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 16:20:28.063718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 16:20:28.063718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 16:20:28.063718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 16:20:28.063718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 16:20:28.063718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:28.063718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 16:20:28.063718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:28.063718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:28.063718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 16:20:28.063718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 16:20:28.063718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 27 16:20:28.063718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return ref.to_dict() May 27 16:20:28.063718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 16:20:28.063718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application next(self.gen) May 27 16:20:28.065012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 16:20:28.065012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application yield resource May 27 16:20:28.065012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 16:20:28.065012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application next(self.gen) May 27 16:20:28.065012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 16:20:28.065012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.session.rollback() May 27 16:20:28.065012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 16:20:28.065012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.force_reraise() May 27 16:20:28.065012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 16:20:28.065012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise self.value May 27 16:20:28.065012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 16:20:28.065012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 16:20:28.065012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 16:20:28.065012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application session.commit() May 27 16:20:28.065012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 16:20:28.065012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 16:20:28.065012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 16:20:28.066210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._prepare_impl() May 27 16:20:28.066210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 16:20:28.066210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.session.flush() May 27 16:20:28.066210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 16:20:28.066210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._flush(objects) May 27 16:20:28.066210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 16:20:28.066210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 16:20:28.066210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 16:20:28.066210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application compat.raise_( May 27 16:20:28.066210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 16:20:28.066210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception May 27 16:20:28.066210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 16:20:28.066210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application flush_context.execute() May 27 16:20:28.066210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 16:20:28.066210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rec.execute(self) May 27 16:20:28.066210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 16:20:28.066210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 16:20:28.067534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 16:20:28.067534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 16:20:28.067534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 16:20:28.067534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 16:20:28.067534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 16:20:28.067534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 16:20:28.067534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 16:20:28.067534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 16:20:28.067534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 16:20:28.067534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 16:20:28.067534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 16:20:28.067534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 16:20:28.067534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 16:20:28.067534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 16:20:28.067534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 16:20:28.067534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception May 27 16:20:28.068604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 16:20:28.068604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 16:20:28.068604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 16:20:28.068604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 16:20:28.068604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 16:20:28.068604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application result = self._query(query) May 27 16:20:28.068604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 16:20:28.068604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application conn.query(q) May 27 16:20:28.068604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 16:20:28.068604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 16:20:28.068604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 16:20:28.068604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application result.read() May 27 16:20:28.068604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 16:20:28.068604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 16:20:28.068604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 16:20:28.068604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 16:20:28.072253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 16:20:28.072253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 16:20:28.072253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 16:20:28.072253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 16:20:28.072253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 16:20:28.072253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 16:20:28.072253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [parameters: {'id': '28ab6be312044787a065f8fc1e6ebfa8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 16:20:28.072253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 16:20:28.072253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:28.072253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:20:28.072253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:28.072253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:28.072253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:28.072253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:28.072253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:28.072253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:28.073409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:28.073409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:28.073409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:28.073409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:28.073409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:28.073409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:28.073409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 27 16:20:28.073409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 27 16:20:28.073409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:28.073409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:28.073409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 27 16:20:28.073409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 27 16:20:28.073409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 16:20:28.073409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 16:20:28.073409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 16:20:28.073409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:28.074451 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 238/478] 10.222.0.41 () {60 vars in 1131 bytes} [Fri May 27 16:20:27 2022] POST /identity/v3/roles => generated 144 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:28.075779 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711849d-7258-493d-9fe1-0210cc23a0b5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:28.200531 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711849d-7258-493d-9fe1-0210cc23a0b5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:28.214445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:28.242232 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d36671-53fa-4d84-99b3-bdfbdebe6179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:28.243000 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d36671-53fa-4d84-99b3-bdfbdebe6179 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:28.243283 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d36671-53fa-4d84-99b3-bdfbdebe6179 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:28.243559 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d36671-53fa-4d84-99b3-bdfbdebe6179 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:28.257232 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d36671-53fa-4d84-99b3-bdfbdebe6179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:28.267511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-76d36671-53fa-4d84-99b3-bdfbdebe6179 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:20:28.267511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:28.267511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:28.267511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:28.267511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:28.267511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:28.267511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:28.267511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:28.267511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:28.267511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:28.267511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:28.267511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:28.267511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:28.267511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:28.267511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:28.267511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:28.268545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:28.268545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:28.268545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:28.268545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:28.268545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:28.268545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:28.268545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:28.268545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:28.268545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:28.268545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:28.268545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:28.268545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:28.268545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:28.268545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:28.268545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:28.268545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:28.269372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:28.269372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:28.269372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:28.269372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:28.269372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:28.269372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:28.269372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:28.269372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:28.269372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:28.269372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:28.269372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 16:20:28.269372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:28.269372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 241/479] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:20:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:28.278803 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8290dab-9765-44dd-b518-541102599c34 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:28.408829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:28.426653 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8290dab-9765-44dd-b518-541102599c34 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:28.463564 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa90d9-a03c-41d7-92e6-8851cf8a7491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:28.464279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa90d9-a03c-41d7-92e6-8851cf8a7491 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:28.464559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa90d9-a03c-41d7-92e6-8851cf8a7491 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:28.464830 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa90d9-a03c-41d7-92e6-8851cf8a7491 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:28.465655 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa90d9-a03c-41d7-92e6-8851cf8a7491 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:28.465956 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa90d9-a03c-41d7-92e6-8851cf8a7491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:28.467436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa90d9-a03c-41d7-92e6-8851cf8a7491 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:28.477356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 239/480] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:29.876408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd7e0b-fd9b-4ab9-9eb2-cbbfea1c1fd9 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:29.876961 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd7e0b-fd9b-4ab9-9eb2-cbbfea1c1fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:29.877403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd7e0b-fd9b-4ab9-9eb2-cbbfea1c1fd9 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:29.880635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 242/481] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:29.887281 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49c1b8-c757-4778-b625-7c0e852aec35 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:29.887805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49c1b8-c757-4778-b625-7c0e852aec35 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:29.888308 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49c1b8-c757-4778-b625-7c0e852aec35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:29.925724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ef49c1b8-c757-4778-b625-7c0e852aec35 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:29.928135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ef49c1b8-c757-4778-b625-7c0e852aec35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:30.030797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 240/482] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:30.079542 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd7e0b-fd9b-4ab9-9eb2-cbbfea1c1fd9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:30.146807 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0afe0c-0592-4d58-b0cf-980d098a9258 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:30.147119 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0afe0c-0592-4d58-b0cf-980d098a9258 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:30.147337 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0afe0c-0592-4d58-b0cf-980d098a9258 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:30.148765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 241/483] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:20:30.154557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa69da3-608b-44d6-a5b6-8b78d805197e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:30.154886 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa69da3-608b-44d6-a5b6-8b78d805197e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:30.155106 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa69da3-608b-44d6-a5b6-8b78d805197e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:30.181538 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-efa69da3-608b-44d6-a5b6-8b78d805197e None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:30.182749 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-efa69da3-608b-44d6-a5b6-8b78d805197e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:30.278415 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd7e0b-fd9b-4ab9-9eb2-cbbfea1c1fd9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:30.333521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 242/484] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:30.352433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44354af3-585b-438e-a675-249109b5ec89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:30.353270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44354af3-585b-438e-a675-249109b5ec89 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:30.353559 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44354af3-585b-438e-a675-249109b5ec89 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:30.353837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44354af3-585b-438e-a675-249109b5ec89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:30.374832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44354af3-585b-438e-a675-249109b5ec89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:30.380166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa69da3-608b-44d6-a5b6-8b78d805197e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:30.383353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-44354af3-585b-438e-a675-249109b5ec89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:30.383353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:30.383353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:30.383353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:30.383353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:30.383353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:30.383353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:30.383353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:30.383353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:30.383353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:30.383353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:30.383353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:30.383353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:30.383353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:30.383353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:30.383353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:30.384361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:30.384361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:30.384361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:30.384361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:30.384361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:30.384361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:30.384361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:30.384361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:30.384361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:30.384361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:30.384361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:30.384361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:30.384361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:30.384361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:30.384361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:30.384361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:30.385168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:30.385168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:30.385168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:30.385168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:30.385168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:30.385168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:30.385168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:30.385168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:30.385168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:30.385168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:30.385168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:30.385168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:30.387536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 243/485] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:20:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:30.395580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44354af3-585b-438e-a675-249109b5ec89 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:30.409957 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:30.476419 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:30.550402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44354af3-585b-438e-a675-249109b5ec89 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:30.627688 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9484d-f251-4a0e-ad22-81b0a06f9c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:30.628943 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9484d-f251-4a0e-ad22-81b0a06f9c5d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:30.630875 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9484d-f251-4a0e-ad22-81b0a06f9c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:30.631444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9484d-f251-4a0e-ad22-81b0a06f9c5d None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:30.633408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9484d-f251-4a0e-ad22-81b0a06f9c5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:30.635443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9484d-f251-4a0e-ad22-81b0a06f9c5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:30.641597 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa69da3-608b-44d6-a5b6-8b78d805197e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:30.641803 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9484d-f251-4a0e-ad22-81b0a06f9c5d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:30.655478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 244/486] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:20:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:30.661895 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9484d-f251-4a0e-ad22-81b0a06f9c5d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:30.682916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cdfb9-9681-4d3c-8c8c-4c35df90c7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:30.684185 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cdfb9-9681-4d3c-8c8c-4c35df90c7ed None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:30.684667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cdfb9-9681-4d3c-8c8c-4c35df90c7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:30.685131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cdfb9-9681-4d3c-8c8c-4c35df90c7ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:30.698146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cdfb9-9681-4d3c-8c8c-4c35df90c7ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:30.707245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-f44cdfb9-9681-4d3c-8c8c-4c35df90c7ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:30.707245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:30.707245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:30.707245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:30.707245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:30.707245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:30.707245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:30.707245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:30.707245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:30.707245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:30.707245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:30.707245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:30.707245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:30.707245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:30.707245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:30.707245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:30.708247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:30.708247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:30.708247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:30.708247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:30.708247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:30.708247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:30.708247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:30.708247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:30.708247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:30.708247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:30.708247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:30.708247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:30.708247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:30.708247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:30.708247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:30.708247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:30.709073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:30.709073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:30.709073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:30.709073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:30.709073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:30.709073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:30.709073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:30.709073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:30.709073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:30.709073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:30.709073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:30.709073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:30.712076 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 243/487] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:20:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:30.718801 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cdfb9-9681-4d3c-8c8c-4c35df90c7ed None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:30.841070 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:30.874116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:30.881530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cdfb9-9681-4d3c-8c8c-4c35df90c7ed None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:30.887586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9484d-f251-4a0e-ad22-81b0a06f9c5d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:30.931212 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55335792-2d64-46c4-83b9-ba14097a24f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:30.932299 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55335792-2d64-46c4-83b9-ba14097a24f5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:30.932816 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55335792-2d64-46c4-83b9-ba14097a24f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:30.933309 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55335792-2d64-46c4-83b9-ba14097a24f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:30.933494 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6d61f-f56a-4e64-853c-2c9195259d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:30.934585 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d61f-f56a-4e64-853c-2c9195259d12 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:30.934759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55335792-2d64-46c4-83b9-ba14097a24f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:30.935302 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d61f-f56a-4e64-853c-2c9195259d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:30.935413 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55335792-2d64-46c4-83b9-ba14097a24f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:30.935812 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d61f-f56a-4e64-853c-2c9195259d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:30.938001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55335792-2d64-46c4-83b9-ba14097a24f5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:30.949423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6d61f-f56a-4e64-853c-2c9195259d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:30.951232 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6d61f-f56a-4e64-853c-2c9195259d12 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:30.953180 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 244/488] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:20:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:30.954597 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42845dec-74a0-477e-958e-8b75a65f81c4 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:30.955285 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42845dec-74a0-477e-958e-8b75a65f81c4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:30.955592 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42845dec-74a0-477e-958e-8b75a65f81c4 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:30.958111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 245/489] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:30.959744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd92eb2-5ae0-4e1d-b181-35af69399ccb None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:30.962050 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd92eb2-5ae0-4e1d-b181-35af69399ccb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:30.962050 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd92eb2-5ae0-4e1d-b181-35af69399ccb None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:30.962050 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 246/490] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:30.963950 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd92eb2-5ae0-4e1d-b181-35af69399ccb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:30.980046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-9dc6d61f-f56a-4e64-853c-2c9195259d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:30.980046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:30.980046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:30.980046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:30.980046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:30.980046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:30.980046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:30.980046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:30.980046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:30.980046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:30.980046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:30.980046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:30.980046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:30.980046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:30.980046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:30.981013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:30.981013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:30.981013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:30.981013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:30.981013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:30.981013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:30.981013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:30.981013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:30.981013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:30.981013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:30.981013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:30.981013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:30.981013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:30.981013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:30.981013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:30.981013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:30.981013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:30.987206 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:30.987206 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:30.987206 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:30.987206 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:30.987206 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 245/491] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:30.987206 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0da0a-8bd8-4264-9067-ee8c42bf8fba None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:30.987206 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0da0a-8bd8-4264-9067-ee8c42bf8fba None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:30.987206 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0da0a-8bd8-4264-9067-ee8c42bf8fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:31.007633 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f2b0da0a-8bd8-4264-9067-ee8c42bf8fba None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:31.008897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f2b0da0a-8bd8-4264-9067-ee8c42bf8fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:31.091859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd92eb2-5ae0-4e1d-b181-35af69399ccb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:31.105738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 246/492] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:31.107974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075952bd-1ef4-4a78-bef5-adfaf3ebbdb4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:31.108431 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075952bd-1ef4-4a78-bef5-adfaf3ebbdb4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:31.108836 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075952bd-1ef4-4a78-bef5-adfaf3ebbdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:31.133109 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-075952bd-1ef4-4a78-bef5-adfaf3ebbdb4 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:31.134523 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-075952bd-1ef4-4a78-bef5-adfaf3ebbdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:31.144240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:31.154056 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a023ed1-db49-4fd5-b985-30a1a5730ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:31.154874 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a023ed1-db49-4fd5-b985-30a1a5730ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:31.155156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a023ed1-db49-4fd5-b985-30a1a5730ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:31.155427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a023ed1-db49-4fd5-b985-30a1a5730ab9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:31.166739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a023ed1-db49-4fd5-b985-30a1a5730ab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:31.168292 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a023ed1-db49-4fd5-b985-30a1a5730ab9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:31.188392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1a023ed1-db49-4fd5-b985-30a1a5730ab9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:31.188392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:31.188392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:31.188392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:31.188392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:31.188392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:31.188392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:31.188392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:31.188392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:31.188392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:31.188392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:31.188392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:31.188392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:31.188392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:31.188392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:31.189301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:31.189301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:31.189301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:31.189301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:31.189301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:31.189301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:31.189301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:31.189301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:31.189301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:31.189301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:31.189301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:31.189301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:31.189301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:31.189301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:31.189301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:31.189301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:31.189301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:31.190152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:31.190152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:31.190152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:31.190152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:31.190152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 247/493] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:31.190425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a023ed1-db49-4fd5-b985-30a1a5730ab9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:31.224040 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 247/494] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:31.224040 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075952bd-1ef4-4a78-bef5-adfaf3ebbdb4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:31.227619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:31.332977 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a023ed1-db49-4fd5-b985-30a1a5730ab9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:31.368969 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f37b7-9056-45aa-9427-7fc53889c8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:31.370708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f37b7-9056-45aa-9427-7fc53889c8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:31.370708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f37b7-9056-45aa-9427-7fc53889c8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:31.370708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f37b7-9056-45aa-9427-7fc53889c8e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:31.370708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f37b7-9056-45aa-9427-7fc53889c8e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:31.371010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f37b7-9056-45aa-9427-7fc53889c8e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:31.373570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f37b7-9056-45aa-9427-7fc53889c8e6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:31.388470 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 248/495] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:31.389342 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f37b7-9056-45aa-9427-7fc53889c8e6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:31.399490 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075952bd-1ef4-4a78-bef5-adfaf3ebbdb4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:31.443349 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f81d2-0942-45c2-9186-46d8cf970f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:31.444106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f81d2-0942-45c2-9186-46d8cf970f4f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:31.444390 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f81d2-0942-45c2-9186-46d8cf970f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:31.444663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f81d2-0942-45c2-9186-46d8cf970f4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:31.445723 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:31.456055 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444f81d2-0942-45c2-9186-46d8cf970f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:31.464630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-444f81d2-0942-45c2-9186-46d8cf970f4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:31.464630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:31.464630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:31.464630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:31.464630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:31.464630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:31.464630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:31.464630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:31.464630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:31.464630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:31.464630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:31.464630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:31.464630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:31.464630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:31.464630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:31.464630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:31.465605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:31.465605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:31.465605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:31.465605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:31.465605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:31.465605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:31.465605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:31.465605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:31.465605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:31.465605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:31.465605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:31.465605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:31.465605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:31.465605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:31.465605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:31.465605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:31.466423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:31.466423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:31.466423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:31.466423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:31.466423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:31.466423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:31.466423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:31.466423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:31.466423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:31.466423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:31.466423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:31.466423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:31.466423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 248/496] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:20:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:31.467108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f81d2-0942-45c2-9186-46d8cf970f4f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:31.518282 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f37b7-9056-45aa-9427-7fc53889c8e6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:31.557246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:31.564870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3347d9-f963-40c6-b4b5-df5eb680cff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:31.565550 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3347d9-f963-40c6-b4b5-df5eb680cff0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:31.565994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3347d9-f963-40c6-b4b5-df5eb680cff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:31.566330 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3347d9-f963-40c6-b4b5-df5eb680cff0 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:31.568650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3347d9-f963-40c6-b4b5-df5eb680cff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:31.568961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3347d9-f963-40c6-b4b5-df5eb680cff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:31.570461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3347d9-f963-40c6-b4b5-df5eb680cff0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:31.587135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 249/497] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:31.588032 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3347d9-f963-40c6-b4b5-df5eb680cff0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:31.607993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f81d2-0942-45c2-9186-46d8cf970f4f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:31.649815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d6039-e818-47eb-8961-9b5491d18961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:31.650618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d6039-e818-47eb-8961-9b5491d18961 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:31.650897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d6039-e818-47eb-8961-9b5491d18961 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:31.651177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d6039-e818-47eb-8961-9b5491d18961 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:31.664314 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d6039-e818-47eb-8961-9b5491d18961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:31.672215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-527d6039-e818-47eb-8961-9b5491d18961 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:31.672215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:31.672215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:31.672215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:31.672215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:31.672215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:31.672215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:31.672215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:31.672215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:31.672215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:31.672215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:31.672215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:31.672215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:31.672215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:31.672215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:31.672215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:31.673569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:31.673569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:31.673569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:31.673569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:31.673569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:31.673569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:31.673569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:31.673569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:31.673569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:31.673569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:31.673569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:31.673569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:31.673569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:31.673569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:31.673569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:31.673569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:31.674374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:31.674374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:31.674374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:31.674374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:31.674374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:31.674374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:31.674374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:31.674374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:31.674374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:31.674374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:31.674374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:31.674374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:31.674374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 249/498] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:20:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:31.674374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d6039-e818-47eb-8961-9b5491d18961 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:31.724201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3347d9-f963-40c6-b4b5-df5eb680cff0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:31.725765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:31.760462 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a719c3-0178-4c4f-8828-9d3f64eac0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:31.761865 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a719c3-0178-4c4f-8828-9d3f64eac0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:31.762234 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a719c3-0178-4c4f-8828-9d3f64eac0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:31.762715 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a719c3-0178-4c4f-8828-9d3f64eac0b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:31.771591 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a719c3-0178-4c4f-8828-9d3f64eac0b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:31.773132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a719c3-0178-4c4f-8828-9d3f64eac0b7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:31.791042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b4a719c3-0178-4c4f-8828-9d3f64eac0b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 16:20:31.791042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:31.791042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:31.791042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:31.791042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:31.791042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:31.791042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:31.791042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:31.791042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:31.791042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:31.791042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:31.791042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:31.791042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:20:31.791042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:20:31.791042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:20:31.791042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:20:31.792420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:31.792420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:31.792420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:20:31.792420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:31.792420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:20:31.792420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:31.792420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:31.792420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:31.792420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:31.792420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:31.792420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:31.792420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:31.792420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:31.792420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:31.792420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:31.792420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:31.792420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:31.792420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:31.793650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:31.793650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:31.793650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:20:31.793650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:20:31.793650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:20:31.793650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:20:31.793650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:20:31.793650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:20:31.793650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 16:20:31.793650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:31.794283 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d6039-e818-47eb-8961-9b5491d18961 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:31.797006 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 250/499] 10.222.0.41 () {56 vars in 1093 bytes} [Fri May 27 16:20:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:31.797823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a719c3-0178-4c4f-8828-9d3f64eac0b7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:31.821837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:31.834114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f86f10-a792-4e00-8e54-1d940c92a13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:31.834792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f86f10-a792-4e00-8e54-1d940c92a13e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:31.835064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f86f10-a792-4e00-8e54-1d940c92a13e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:31.835337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f86f10-a792-4e00-8e54-1d940c92a13e None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:31.836116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f86f10-a792-4e00-8e54-1d940c92a13e None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:31.836416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f86f10-a792-4e00-8e54-1d940c92a13e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:31.837837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f86f10-a792-4e00-8e54-1d940c92a13e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:31.846644 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 250/500] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:20:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:31.847620 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f86f10-a792-4e00-8e54-1d940c92a13e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:31.921725 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a719c3-0178-4c4f-8828-9d3f64eac0b7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:31.961317 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702e523-02b9-4b87-86e0-a6eeee07fec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:31.962495 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e523-02b9-4b87-86e0-a6eeee07fec6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:31.962974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e523-02b9-4b87-86e0-a6eeee07fec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:31.963470 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e523-02b9-4b87-86e0-a6eeee07fec6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:31.971887 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f86f10-a792-4e00-8e54-1d940c92a13e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:31.975602 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702e523-02b9-4b87-86e0-a6eeee07fec6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:31.977070 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702e523-02b9-4b87-86e0-a6eeee07fec6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:31.992924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e702e523-02b9-4b87-86e0-a6eeee07fec6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 16:20:31.992924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:31.992924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:31.992924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:31.992924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:31.992924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:31.992924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:31.992924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:31.992924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:31.992924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:31.992924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:31.992924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:31.992924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:20:31.992924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:20:31.992924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:20:31.992924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:20:31.993960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:31.993960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:31.993960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:20:31.993960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:31.993960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:20:31.993960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:31.993960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:31.993960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:31.993960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:31.993960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:31.993960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:31.993960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:31.993960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:31.993960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:31.993960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:31.993960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:31.993960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:31.993960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:31.994864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:31.994864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:31.994864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:20:31.994864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:20:31.994864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:20:31.994864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:20:31.994864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:20:31.994864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:20:31.994864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 16:20:31.994864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:31.996381 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 251/501] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:31.997841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634079fe-de8f-4f2d-93e6-77cfa6934994 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:31.998117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634079fe-de8f-4f2d-93e6-77cfa6934994 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:31.998388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634079fe-de8f-4f2d-93e6-77cfa6934994 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:31.999757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 252/502] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:32.000514 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634079fe-de8f-4f2d-93e6-77cfa6934994 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:32.014407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66634a-cf47-496c-bf37-208dda48d342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:32.015080 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66634a-cf47-496c-bf37-208dda48d342 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:32.015369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66634a-cf47-496c-bf37-208dda48d342 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:32.015673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66634a-cf47-496c-bf37-208dda48d342 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:32.016474 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66634a-cf47-496c-bf37-208dda48d342 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:32.016785 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66634a-cf47-496c-bf37-208dda48d342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:32.018208 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66634a-cf47-496c-bf37-208dda48d342 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:32.027094 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 251/503] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:20:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:32.027951 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66634a-cf47-496c-bf37-208dda48d342 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:32.032617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:32.090512 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:32.129406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634079fe-de8f-4f2d-93e6-77cfa6934994 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:32.154702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66634a-cf47-496c-bf37-208dda48d342 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:32.171395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57998bfe-9ce2-47e6-a3e4-809f38f962e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:32.172099 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57998bfe-9ce2-47e6-a3e4-809f38f962e5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:32.172384 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57998bfe-9ce2-47e6-a3e4-809f38f962e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:32.172652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57998bfe-9ce2-47e6-a3e4-809f38f962e5 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:32.173492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57998bfe-9ce2-47e6-a3e4-809f38f962e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:32.173804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57998bfe-9ce2-47e6-a3e4-809f38f962e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:32.175347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57998bfe-9ce2-47e6-a3e4-809f38f962e5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:32.204358 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857444ca-9b54-4e03-a331-22e67271d7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:32.205519 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857444ca-9b54-4e03-a331-22e67271d7ec None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:32.205802 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857444ca-9b54-4e03-a331-22e67271d7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:32.206077 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857444ca-9b54-4e03-a331-22e67271d7ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:32.218364 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857444ca-9b54-4e03-a331-22e67271d7ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:32.219887 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857444ca-9b54-4e03-a331-22e67271d7ec None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:32.224073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 253/504] 10.222.0.41 () {56 vars in 1133 bytes} [Fri May 27 16:20:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:32.224073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57998bfe-9ce2-47e6-a3e4-809f38f962e5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:32.242925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-857444ca-9b54-4e03-a331-22e67271d7ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:32.242925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:32.242925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:32.242925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:32.242925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:32.242925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:32.242925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:32.242925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:32.242925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:32.242925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:32.242925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:32.242925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:32.242925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:32.242925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:32.242925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:32.244549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:32.244549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:32.244549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:32.244549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:32.244549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:32.244549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:32.244549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:32.244549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:32.244549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:32.244549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:32.244549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:32.244549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:32.244549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:32.244549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:32.244549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:32.244549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:32.244549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:32.246209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:32.246209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:32.246209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:32.246209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:32.248911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 252/505] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:32.250172 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d7930-6777-473e-aea8-e6f08c1472ae None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:32.250464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d7930-6777-473e-aea8-e6f08c1472ae None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:32.250752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d7930-6777-473e-aea8-e6f08c1472ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:32.268343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-dc0d7930-6777-473e-aea8-e6f08c1472ae None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:32.269713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-dc0d7930-6777-473e-aea8-e6f08c1472ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:32.323534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:32.344367 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57998bfe-9ce2-47e6-a3e4-809f38f962e5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:32.352369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 253/506] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:32.353304 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d7930-6777-473e-aea8-e6f08c1472ae None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:32.393152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad88c7d-e47b-4703-a942-dec1bf242735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:32.393821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad88c7d-e47b-4703-a942-dec1bf242735 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:32.394096 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad88c7d-e47b-4703-a942-dec1bf242735 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:32.394598 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad88c7d-e47b-4703-a942-dec1bf242735 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:32.395496 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad88c7d-e47b-4703-a942-dec1bf242735 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:32.395801 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad88c7d-e47b-4703-a942-dec1bf242735 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:32.397327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad88c7d-e47b-4703-a942-dec1bf242735 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:32.405750 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:32.422855 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 254/507] 10.222.0.41 () {56 vars in 1137 bytes} [Fri May 27 16:20:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:32.424505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad88c7d-e47b-4703-a942-dec1bf242735 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:32.491063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d7930-6777-473e-aea8-e6f08c1472ae None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:32.533764 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39148e97-2c1c-4c75-a4ea-63f1309e331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:32.534844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39148e97-2c1c-4c75-a4ea-63f1309e331a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:32.535269 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39148e97-2c1c-4c75-a4ea-63f1309e331a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:32.535677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39148e97-2c1c-4c75-a4ea-63f1309e331a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:32.548025 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39148e97-2c1c-4c75-a4ea-63f1309e331a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:32.549519 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39148e97-2c1c-4c75-a4ea-63f1309e331a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:32.558674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad88c7d-e47b-4703-a942-dec1bf242735 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:32.568249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-39148e97-2c1c-4c75-a4ea-63f1309e331a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:32.568249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:32.568249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:32.568249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:32.568249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:32.568249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:32.568249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:32.568249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:32.568249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:32.568249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:32.568249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:32.568249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:32.568249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:32.568249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:32.568249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:32.569216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:32.569216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:32.569216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:32.569216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:32.569216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:32.569216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:32.569216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:32.569216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:32.569216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:32.569216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:32.569216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:32.569216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:32.569216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:32.569216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:32.569216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:32.569216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:32.569216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:32.571602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:32.571602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:32.571602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:32.571602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:32.571602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 254/508] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:32.571602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39148e97-2c1c-4c75-a4ea-63f1309e331a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:32.597683 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917174f-af97-412c-b2d8-44e9b24f5d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:32.598329 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917174f-af97-412c-b2d8-44e9b24f5d4b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:32.598624 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917174f-af97-412c-b2d8-44e9b24f5d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:32.598903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c917174f-af97-412c-b2d8-44e9b24f5d4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:32.610489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:32.673150 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:32.673745 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917174f-af97-412c-b2d8-44e9b24f5d4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:32.675248 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c917174f-af97-412c-b2d8-44e9b24f5d4b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:32.692649 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39148e97-2c1c-4c75-a4ea-63f1309e331a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:32.729602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5b964-bbbf-4d06-a663-b725fbc89e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:32.730280 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5b964-bbbf-4d06-a663-b725fbc89e77 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:32.730558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5b964-bbbf-4d06-a663-b725fbc89e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:32.730835 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5b964-bbbf-4d06-a663-b725fbc89e77 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:32.731566 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5b964-bbbf-4d06-a663-b725fbc89e77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:32.731872 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5b964-bbbf-4d06-a663-b725fbc89e77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:32.733332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5b964-bbbf-4d06-a663-b725fbc89e77 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:32.746496 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 255/509] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:32.747376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5b964-bbbf-4d06-a663-b725fbc89e77 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:32.778735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 255/510] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:32.779591 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917174f-af97-412c-b2d8-44e9b24f5d4b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:32.829238 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:32.865261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5b964-bbbf-4d06-a663-b725fbc89e77 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:32.901192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c917174f-af97-412c-b2d8-44e9b24f5d4b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:32.909542 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dd0bc-632f-4115-8e97-658683c2eb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:32.910674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dd0bc-632f-4115-8e97-658683c2eb6f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:32.910955 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dd0bc-632f-4115-8e97-658683c2eb6f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:32.911230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dd0bc-632f-4115-8e97-658683c2eb6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:32.924792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2dd0bc-632f-4115-8e97-658683c2eb6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:32.926841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2dd0bc-632f-4115-8e97-658683c2eb6f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:32.929529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:32.941657 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59288f-b3e2-4062-b217-27e2a2c5b823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:32.942396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59288f-b3e2-4062-b217-27e2a2c5b823 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:32.942676 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59288f-b3e2-4062-b217-27e2a2c5b823 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:32.942950 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59288f-b3e2-4062-b217-27e2a2c5b823 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:32.949234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-3c2dd0bc-632f-4115-8e97-658683c2eb6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:32.949234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:32.949234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:32.949234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:32.949234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:32.949234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:32.949234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:32.949234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:32.949234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:32.949234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:32.949234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:32.949234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:32.949234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:32.949234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:32.949234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:32.950370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:32.950370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:32.950370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:32.950370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:32.950370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:32.950370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:32.950370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:32.950370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:32.950370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:32.950370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:32.950370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:32.950370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:32.950370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:32.950370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:32.950370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:32.950370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:32.950370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:32.951330 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:32.951330 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:32.951330 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:32.951330 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:32.951330 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 256/511] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:32.952124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dd0bc-632f-4115-8e97-658683c2eb6f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:33.014851 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59288f-b3e2-4062-b217-27e2a2c5b823 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:33.016413 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59288f-b3e2-4062-b217-27e2a2c5b823 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:33.065121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dd0bc-632f-4115-8e97-658683c2eb6f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:33.068396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:33.101909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b1ded-096d-449e-af32-ebe58d76e506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:33.102511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b1ded-096d-449e-af32-ebe58d76e506 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:33.102791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b1ded-096d-449e-af32-ebe58d76e506 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:33.103063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b1ded-096d-449e-af32-ebe58d76e506 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:33.103783 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b1ded-096d-449e-af32-ebe58d76e506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:33.104114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b1ded-096d-449e-af32-ebe58d76e506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:33.105512 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b1ded-096d-449e-af32-ebe58d76e506 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:33.120349 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 257/512] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:33.121215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b1ded-096d-449e-af32-ebe58d76e506 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:33.136577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 256/513] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:33.137501 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59288f-b3e2-4062-b217-27e2a2c5b823 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:33.182713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:33.232973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b1ded-096d-449e-af32-ebe58d76e506 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:33.247457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59288f-b3e2-4062-b217-27e2a2c5b823 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:33.277492 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a717c-b5da-474d-9c1d-440f4c839a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:33.278291 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a717c-b5da-474d-9c1d-440f4c839a00 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:33.278569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a717c-b5da-474d-9c1d-440f4c839a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:33.278836 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a717c-b5da-474d-9c1d-440f4c839a00 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:33.292735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540ad33-4e91-4f3d-997a-b4b03f6ebb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:33.293787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540ad33-4e91-4f3d-997a-b4b03f6ebb12 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:33.294059 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540ad33-4e91-4f3d-997a-b4b03f6ebb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:33.294330 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540ad33-4e91-4f3d-997a-b4b03f6ebb12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:33.294845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a717c-b5da-474d-9c1d-440f4c839a00 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:33.296372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a717c-b5da-474d-9c1d-440f4c839a00 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:33.302820 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:33.307827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540ad33-4e91-4f3d-997a-b4b03f6ebb12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:33.309727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540ad33-4e91-4f3d-997a-b4b03f6ebb12 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:33.314738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-4b8a717c-b5da-474d-9c1d-440f4c839a00 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 16:20:33.314738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:33.314738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:33.314738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:33.314738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:33.314738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:33.314738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:33.314738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:33.314738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:33.314738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:33.314738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:33.314738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:33.314738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:20:33.314738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:20:33.314738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:20:33.314738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:20:33.315908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:33.315908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:33.315908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:20:33.315908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:33.315908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:20:33.315908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:33.315908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:33.315908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:33.315908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:33.315908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:33.315908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:33.315908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:33.315908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:33.315908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:33.315908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:33.315908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:33.315908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:33.315908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:33.317603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:33.317603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:33.317603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:20:33.317603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:20:33.317603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:20:33.317603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:20:33.317603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:20:33.317603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:20:33.317603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 16:20:33.317603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:33.317603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 258/514] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:33.317603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a717c-b5da-474d-9c1d-440f4c839a00 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:33.334829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-3540ad33-4e91-4f3d-997a-b4b03f6ebb12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:33.334829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:33.334829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:33.334829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:33.334829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:33.334829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:33.334829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:33.334829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:33.334829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:33.334829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:33.334829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:33.334829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:33.334829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:33.334829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:33.334829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:33.335910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:33.335910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:33.335910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:33.335910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:33.335910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:33.335910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:33.335910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:33.335910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:33.335910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:33.335910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:33.335910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:33.335910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:33.335910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:33.335910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:33.335910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:33.335910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:33.335910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:33.336929 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:33.336929 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:33.336929 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:33.336929 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:33.337399 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 257/515] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:33.340820 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540ad33-4e91-4f3d-997a-b4b03f6ebb12 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:33.442312 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a717c-b5da-474d-9c1d-440f4c839a00 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:33.458883 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:33.465688 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540ad33-4e91-4f3d-997a-b4b03f6ebb12 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:33.489421 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0e85a-00a4-4284-b06c-076eb377cb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:33.490450 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0e85a-00a4-4284-b06c-076eb377cb54 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:33.490883 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0e85a-00a4-4284-b06c-076eb377cb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:33.491327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0e85a-00a4-4284-b06c-076eb377cb54 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:33.492578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0e85a-00a4-4284-b06c-076eb377cb54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:33.493071 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0e85a-00a4-4284-b06c-076eb377cb54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:33.495388 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0e85a-00a4-4284-b06c-076eb377cb54 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:33.514955 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 259/516] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:33.515940 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0e85a-00a4-4284-b06c-076eb377cb54 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:33.518811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d3cbf-3b2b-496a-bc97-33a501a59351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:33.519803 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d3cbf-3b2b-496a-bc97-33a501a59351 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:33.521177 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d3cbf-3b2b-496a-bc97-33a501a59351 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:33.521177 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d3cbf-3b2b-496a-bc97-33a501a59351 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:33.531499 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d3cbf-3b2b-496a-bc97-33a501a59351 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:33.533031 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d3cbf-3b2b-496a-bc97-33a501a59351 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:33.548480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-632d3cbf-3b2b-496a-bc97-33a501a59351 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 16:20:33.548480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:33.548480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:33.548480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:33.548480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:33.548480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:33.548480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:33.548480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:33.548480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:33.548480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:33.548480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:33.548480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:33.548480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:20:33.548480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:20:33.548480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:20:33.548480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:20:33.549493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:33.549493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:33.549493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:20:33.549493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:33.549493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:20:33.549493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:33.549493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:33.549493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:33.549493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:33.549493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:33.549493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:33.549493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:33.549493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:33.549493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:33.549493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:33.549493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:33.549493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:33.549493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:33.550389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:33.550389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:33.550389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:20:33.550389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:20:33.550389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:20:33.550389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:20:33.550389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:20:33.550389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:20:33.550389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 16:20:33.550389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:33.550389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 258/517] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:20:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:33.550987 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d3cbf-3b2b-496a-bc97-33a501a59351 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:33.603286 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:33.630126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0e85a-00a4-4284-b06c-076eb377cb54 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:33.655980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d3cbf-3b2b-496a-bc97-33a501a59351 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:33.664099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b32f5-e421-44a5-b9f8-ada8c2c00ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:33.664935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b32f5-e421-44a5-b9f8-ada8c2c00ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:33.665221 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b32f5-e421-44a5-b9f8-ada8c2c00ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:33.665497 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b32f5-e421-44a5-b9f8-ada8c2c00ef9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:33.675624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b32f5-e421-44a5-b9f8-ada8c2c00ef9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:33.677118 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b32f5-e421-44a5-b9f8-ada8c2c00ef9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:33.689369 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d51da-a24b-465e-8c3f-2b5c994925e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:33.690044 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d51da-a24b-465e-8c3f-2b5c994925e5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:33.690404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d51da-a24b-465e-8c3f-2b5c994925e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:33.690688 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d51da-a24b-465e-8c3f-2b5c994925e5 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:33.691651 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d51da-a24b-465e-8c3f-2b5c994925e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:33.691963 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d51da-a24b-465e-8c3f-2b5c994925e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:33.693527 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d51da-a24b-465e-8c3f-2b5c994925e5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:33.694733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-c22b32f5-e421-44a5-b9f8-ada8c2c00ef9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:33.694733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:33.694733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:33.694733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:33.694733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:33.694733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:33.694733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:33.694733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:33.694733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:33.694733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:33.694733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:33.694733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:33.694733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:33.694733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:33.694733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:33.695578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:33.695578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:33.695578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:33.695578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:33.695578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:33.695578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:33.695578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:33.695578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:33.695578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:33.695578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:33.695578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:33.695578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:33.695578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:33.695578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:33.695578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:33.695578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:33.695578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:33.696773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:33.696773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:33.696773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:33.696773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:33.696773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 260/518] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:33.697286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b32f5-e421-44a5-b9f8-ada8c2c00ef9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:33.712320 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 259/519] 10.222.0.41 () {56 vars in 1137 bytes} [Fri May 27 16:20:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:33.713130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d51da-a24b-465e-8c3f-2b5c994925e5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:33.729187 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:33.803205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b32f5-e421-44a5-b9f8-ada8c2c00ef9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:33.816389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d51da-a24b-465e-8c3f-2b5c994925e5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:33.826942 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:33.839647 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca0111-dd28-4785-8894-7e7e435971b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:33.840350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca0111-dd28-4785-8894-7e7e435971b6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:33.840636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca0111-dd28-4785-8894-7e7e435971b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:33.840919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca0111-dd28-4785-8894-7e7e435971b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:33.841641 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca0111-dd28-4785-8894-7e7e435971b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:33.841944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca0111-dd28-4785-8894-7e7e435971b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:33.843337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca0111-dd28-4785-8894-7e7e435971b6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:33.853741 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebdb4c-f626-406f-856b-7116e15a08c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:33.854414 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebdb4c-f626-406f-856b-7116e15a08c6 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:33.854697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebdb4c-f626-406f-856b-7116e15a08c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:33.854977 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebdb4c-f626-406f-856b-7116e15a08c6 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:33.855557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 261/520] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:33.855707 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebdb4c-f626-406f-856b-7116e15a08c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:33.856585 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca0111-dd28-4785-8894-7e7e435971b6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:33.857268 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebdb4c-f626-406f-856b-7116e15a08c6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:33.879148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 260/521] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 16:20:33 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:20:33.880146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebdb4c-f626-406f-856b-7116e15a08c6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:33.960966 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:33.980089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca0111-dd28-4785-8894-7e7e435971b6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:34.014350 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebdb4c-f626-406f-856b-7116e15a08c6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:34.018738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81983f1f-c11e-4a24-91fe-ae50c853906e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:34.019615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81983f1f-c11e-4a24-91fe-ae50c853906e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:34.019992 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81983f1f-c11e-4a24-91fe-ae50c853906e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:34.020309 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81983f1f-c11e-4a24-91fe-ae50c853906e None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:34.021170 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81983f1f-c11e-4a24-91fe-ae50c853906e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:34.021481 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81983f1f-c11e-4a24-91fe-ae50c853906e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:34.023015 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81983f1f-c11e-4a24-91fe-ae50c853906e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:34.052244 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d8809-df15-4470-9696-8d311fbb0549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:34.052965 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d8809-df15-4470-9696-8d311fbb0549 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:34.053212 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d8809-df15-4470-9696-8d311fbb0549 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:34.053489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d8809-df15-4470-9696-8d311fbb0549 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:34.054231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d8809-df15-4470-9696-8d311fbb0549 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:34.054540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d8809-df15-4470-9696-8d311fbb0549 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:34.055970 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d8809-df15-4470-9696-8d311fbb0549 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:34.068054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 262/522] 10.222.0.41 () {56 vars in 1139 bytes} [Fri May 27 16:20:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:34.068054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81983f1f-c11e-4a24-91fe-ae50c853906e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:34.075021 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 261/523] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:34.075813 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d8809-df15-4470-9696-8d311fbb0549 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:34.101330 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:34.183937 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81983f1f-c11e-4a24-91fe-ae50c853906e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:34.190272 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d8809-df15-4470-9696-8d311fbb0549 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:34.218879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec62ae-62a8-411e-804c-8430f60d6d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:34.219450 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec62ae-62a8-411e-804c-8430f60d6d8a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:34.219728 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec62ae-62a8-411e-804c-8430f60d6d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:34.219998 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec62ae-62a8-411e-804c-8430f60d6d8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:34.226468 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99dd0e-9a9a-4a99-9c9b-028abb5d7594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:34.227287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99dd0e-9a9a-4a99-9c9b-028abb5d7594 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:34.227568 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99dd0e-9a9a-4a99-9c9b-028abb5d7594 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:34.227847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99dd0e-9a9a-4a99-9c9b-028abb5d7594 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:34.234999 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:34.235294 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99dd0e-9a9a-4a99-9c9b-028abb5d7594 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:34.237004 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99dd0e-9a9a-4a99-9c9b-028abb5d7594 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:34.253121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2b99dd0e-9a9a-4a99-9c9b-028abb5d7594 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:34.253121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:34.253121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:34.253121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:34.253121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:34.253121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:34.253121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:34.253121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:34.253121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:34.253121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:34.253121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:34.253121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:34.253121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:20:34.253121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:20:34.253121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:20:34.254877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:20:34.254877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:34.254877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:34.254877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:34.254877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:34.254877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:34.254877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:34.254877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:34.254877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:34.254877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:34.254877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:34.254877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:34.254877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:34.254877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:34.254877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:34.254877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:34.254877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:34.255754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:20:34.255754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:20:34.255754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:20:34.255754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:20:34.255754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:20:34.255754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:20:34.255754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:34.255754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:34.255754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 262/524] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:34.255754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99dd0e-9a9a-4a99-9c9b-028abb5d7594 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:34.308913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec62ae-62a8-411e-804c-8430f60d6d8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:34.310403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec62ae-62a8-411e-804c-8430f60d6d8a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:34.362344 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:34.377142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99dd0e-9a9a-4a99-9c9b-028abb5d7594 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:34.420047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba280273-af32-419f-8665-793fdd17df5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:34.422977 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba280273-af32-419f-8665-793fdd17df5b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:34.422977 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba280273-af32-419f-8665-793fdd17df5b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:34.422977 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba280273-af32-419f-8665-793fdd17df5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:34.441104 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 263/525] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:34.442122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec62ae-62a8-411e-804c-8430f60d6d8a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:34.496378 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:34.507557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba280273-af32-419f-8665-793fdd17df5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:34.509096 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba280273-af32-419f-8665-793fdd17df5b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:34.584605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec62ae-62a8-411e-804c-8430f60d6d8a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:34.602567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:34.628221 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 263/526] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:34.629533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba280273-af32-419f-8665-793fdd17df5b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:34.662659 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f35d24-1402-43f8-a287-291597241a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:34.663981 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f35d24-1402-43f8-a287-291597241a67 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:34.664351 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f35d24-1402-43f8-a287-291597241a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:34.664736 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f35d24-1402-43f8-a287-291597241a67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:34.679459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f35d24-1402-43f8-a287-291597241a67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:34.681106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f35d24-1402-43f8-a287-291597241a67 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:34.696555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-a8f35d24-1402-43f8-a287-291597241a67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:34.696555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:34.696555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:34.696555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:34.696555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:34.696555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:34.696555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:34.696555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:34.696555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:34.696555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:34.696555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:34.696555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:34.696555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:20:34.696555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:20:34.696555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:20:34.697624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:20:34.697624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:34.697624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:34.697624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:34.697624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:34.697624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:34.697624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:34.697624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:34.697624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:34.697624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:34.697624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:34.697624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:34.697624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:34.697624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:34.697624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:34.697624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:34.697624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:34.698482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:20:34.698482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:20:34.698482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:20:34.698482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:20:34.698482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:20:34.698482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:20:34.698482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:34.698482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:34.698482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 264/527] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:34.698945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f35d24-1402-43f8-a287-291597241a67 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:34.757731 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba280273-af32-419f-8665-793fdd17df5b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:34.798025 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d229b-aa3d-47cf-8dd7-7d7bbc515071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:34.798580 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d229b-aa3d-47cf-8dd7-7d7bbc515071 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:34.798864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d229b-aa3d-47cf-8dd7-7d7bbc515071 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:34.799134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d229b-aa3d-47cf-8dd7-7d7bbc515071 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:34.799929 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d229b-aa3d-47cf-8dd7-7d7bbc515071 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:34.800266 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d229b-aa3d-47cf-8dd7-7d7bbc515071 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:34.801951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d229b-aa3d-47cf-8dd7-7d7bbc515071 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:34.820587 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 264/528] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:20:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:34.821452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d229b-aa3d-47cf-8dd7-7d7bbc515071 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:34.828728 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f35d24-1402-43f8-a287-291597241a67 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:34.832000 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:34.869525 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868cabb-12d1-44e1-955e-27fab5004847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:34.870336 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868cabb-12d1-44e1-955e-27fab5004847 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:34.870629 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868cabb-12d1-44e1-955e-27fab5004847 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:34.870909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868cabb-12d1-44e1-955e-27fab5004847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:34.872751 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:34.883849 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868cabb-12d1-44e1-955e-27fab5004847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:34.885392 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868cabb-12d1-44e1-955e-27fab5004847 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:34.904747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-b868cabb-12d1-44e1-955e-27fab5004847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:34.904747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:34.904747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:34.904747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:34.904747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:34.904747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:34.904747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:34.904747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:34.904747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:34.904747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:34.904747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:34.904747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:34.904747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:34.904747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:34.904747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:34.905824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:34.905824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:34.905824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:34.905824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:34.905824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:34.905824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:34.905824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:34.905824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:34.905824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:34.905824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:34.905824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:34.905824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:34.905824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:34.905824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:34.905824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:34.905824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:34.905824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:34.906701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:34.906701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:34.906701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:34.906701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:34.906701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 265/529] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:34.906984 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868cabb-12d1-44e1-955e-27fab5004847 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:34.944855 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d229b-aa3d-47cf-8dd7-7d7bbc515071 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:34.987491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c4234-0359-442f-92d6-a010bcab79d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:34.988636 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c4234-0359-442f-92d6-a010bcab79d9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:34.988929 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c4234-0359-442f-92d6-a010bcab79d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:34.989207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c4234-0359-442f-92d6-a010bcab79d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:35.000752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c4234-0359-442f-92d6-a010bcab79d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:35.002269 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c4234-0359-442f-92d6-a010bcab79d9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:35.022047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-030c4234-0359-442f-92d6-a010bcab79d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:35.022047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:35.022047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:35.022047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:35.022047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:35.022047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:35.022047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:35.022047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:35.022047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:35.022047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:35.022047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:35.022047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:35.022047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:35.022047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:35.022047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:35.022952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:35.022952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:35.022952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:35.022952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:35.022952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:35.022952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:35.022952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:35.022952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:35.022952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:35.022952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:35.022952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:35.022952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:35.022952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:35.022952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:35.022952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:35.022952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:35.022952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:35.023843 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:35.023843 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:35.023843 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:35.023843 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:35.023843 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 265/530] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:35.024159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c4234-0359-442f-92d6-a010bcab79d9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:35.041772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868cabb-12d1-44e1-955e-27fab5004847 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:35.080522 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedfd72-d8ea-4f19-bf08-fd88c1b3571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:35.081288 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedfd72-d8ea-4f19-bf08-fd88c1b3571a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:35.081614 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedfd72-d8ea-4f19-bf08-fd88c1b3571a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:35.082428 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedfd72-d8ea-4f19-bf08-fd88c1b3571a None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:35.083843 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedfd72-d8ea-4f19-bf08-fd88c1b3571a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:35.084209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedfd72-d8ea-4f19-bf08-fd88c1b3571a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:35.085731 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedfd72-d8ea-4f19-bf08-fd88c1b3571a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:35.110975 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 266/531] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:20:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:35.111885 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedfd72-d8ea-4f19-bf08-fd88c1b3571a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:35.135181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:35.144531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:35.153522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c4234-0359-442f-92d6-a010bcab79d9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:35.199944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f9314-0b9a-40e1-9ffb-a41b202f679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:35.200996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f9314-0b9a-40e1-9ffb-a41b202f679a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:35.201340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f9314-0b9a-40e1-9ffb-a41b202f679a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:35.201667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f9314-0b9a-40e1-9ffb-a41b202f679a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:35.202618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f9314-0b9a-40e1-9ffb-a41b202f679a None admin] RBAC: Adding query filter params (role.id=acbb2252c9f54cf8b789aa80f0a1fe85, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=3caa3dbc7bd24ebba28296a1eba9cefe) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:35.202995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f9314-0b9a-40e1-9ffb-a41b202f679a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:35.204608 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f9314-0b9a-40e1-9ffb-a41b202f679a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:35.211311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 266/532] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:20:35 2022] GET /identity/v3/role_assignments?user.id=3caa3dbc7bd24ebba28296a1eba9cefe&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=acbb2252c9f54cf8b789aa80f0a1fe85 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:35.212461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f9314-0b9a-40e1-9ffb-a41b202f679a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:35.252914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedfd72-d8ea-4f19-bf08-fd88c1b3571a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:35.301202 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b03249-94bc-4a98-8c64-53d2c09fb638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:35.302285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b03249-94bc-4a98-8c64-53d2c09fb638 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:35.302984 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b03249-94bc-4a98-8c64-53d2c09fb638 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:35.303463 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b03249-94bc-4a98-8c64-53d2c09fb638 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:35.304467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b03249-94bc-4a98-8c64-53d2c09fb638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:35.304986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b03249-94bc-4a98-8c64-53d2c09fb638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:35.306662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b03249-94bc-4a98-8c64-53d2c09fb638 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:35.327636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 267/533] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:35.329516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b03249-94bc-4a98-8c64-53d2c09fb638 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:35.373491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f9314-0b9a-40e1-9ffb-a41b202f679a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:35.411740 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a36573-43e9-42fb-a231-e62937b88e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:35.412522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a36573-43e9-42fb-a231-e62937b88e4e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:35.412805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a36573-43e9-42fb-a231-e62937b88e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:35.413081 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a36573-43e9-42fb-a231-e62937b88e4e None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:35.414418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a36573-43e9-42fb-a231-e62937b88e4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:35.414418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a36573-43e9-42fb-a231-e62937b88e4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:35.415799 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a36573-43e9-42fb-a231-e62937b88e4e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:35.430363 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 267/534] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:35.437020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a36573-43e9-42fb-a231-e62937b88e4e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:35.464704 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:35.477233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:35.505121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b03249-94bc-4a98-8c64-53d2c09fb638 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:35.542836 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d876a5-e99b-44d5-8a66-4b2a1f0f2fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:35.543964 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d876a5-e99b-44d5-8a66-4b2a1f0f2fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:35.544528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d876a5-e99b-44d5-8a66-4b2a1f0f2fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:35.545014 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d876a5-e99b-44d5-8a66-4b2a1f0f2fe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:35.546050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d876a5-e99b-44d5-8a66-4b2a1f0f2fe8 None admin] RBAC: Adding query filter params (role.id=acbb2252c9f54cf8b789aa80f0a1fe85, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=4561bdacf98d47a6beffbcc400120bcd) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:35.546684 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d876a5-e99b-44d5-8a66-4b2a1f0f2fe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:35.548681 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d876a5-e99b-44d5-8a66-4b2a1f0f2fe8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:35.550152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a36573-43e9-42fb-a231-e62937b88e4e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:35.555965 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 268/535] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:20:35 2022] GET /identity/v3/role_assignments?user.id=4561bdacf98d47a6beffbcc400120bcd&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=acbb2252c9f54cf8b789aa80f0a1fe85 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:35.557147 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d876a5-e99b-44d5-8a66-4b2a1f0f2fe8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:35.681789 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879378a-0ae7-43e0-b6c1-02e17cab2d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:35.682805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879378a-0ae7-43e0-b6c1-02e17cab2d4d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:35.683132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879378a-0ae7-43e0-b6c1-02e17cab2d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:35.683412 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879378a-0ae7-43e0-b6c1-02e17cab2d4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:35.687700 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d876a5-e99b-44d5-8a66-4b2a1f0f2fe8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:35.705380 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879378a-0ae7-43e0-b6c1-02e17cab2d4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:35.707008 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879378a-0ae7-43e0-b6c1-02e17cab2d4d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:35.732909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70b99b-697b-4e2d-921b-a6360f4e9d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:35.734146 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70b99b-697b-4e2d-921b-a6360f4e9d9a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:35.734661 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70b99b-697b-4e2d-921b-a6360f4e9d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:35.735148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70b99b-697b-4e2d-921b-a6360f4e9d9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:35.736796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8879378a-0ae7-43e0-b6c1-02e17cab2d4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:35.736796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:35.736796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:35.736796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:35.736796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:35.736796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:35.736796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:35.736796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:35.736796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:35.736796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:35.736796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:35.736796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:35.736796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:20:35.736796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:20:35.736796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:20:35.737767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:20:35.737767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:35.737767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:35.737767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:35.737767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:35.737767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:35.737767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:35.737767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:35.737767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:35.737767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:35.737767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:35.737767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:35.737767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:35.737767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:35.737767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:35.737767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:35.737767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:35.738685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:20:35.738685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:20:35.738685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:20:35.738685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:20:35.738685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:20:35.738685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:20:35.738685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:35.738685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:35.749392 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70b99b-697b-4e2d-921b-a6360f4e9d9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:35.752580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70b99b-697b-4e2d-921b-a6360f4e9d9a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:35.752847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 268/536] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:35.760957 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879378a-0ae7-43e0-b6c1-02e17cab2d4d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:35.770534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-2a70b99b-697b-4e2d-921b-a6360f4e9d9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:35.770534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:35.770534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:35.770534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:35.770534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:35.770534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:35.770534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:35.770534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:35.770534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:35.770534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:35.770534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:35.770534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:35.770534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:20:35.770534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:20:35.770534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:20:35.771462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:20:35.771462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:35.771462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:35.771462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:35.771462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:35.771462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:35.771462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:35.771462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:35.771462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:35.771462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:35.771462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:35.771462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:35.771462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:35.771462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:35.771462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:35.771462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:35.771462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:35.772397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:20:35.772397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:20:35.772397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:20:35.772397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:20:35.772397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:20:35.772397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:20:35.772397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:35.772397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:35.780041 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:35.780500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 269/537] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:35.784171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70b99b-697b-4e2d-921b-a6360f4e9d9a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:36.008606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70b99b-697b-4e2d-921b-a6360f4e9d9a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:36.029969 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:36.073351 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879378a-0ae7-43e0-b6c1-02e17cab2d4d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:36.094974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9648e82-1d34-4e47-b23c-a26555669b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:36.096426 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9648e82-1d34-4e47-b23c-a26555669b1c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:36.097300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9648e82-1d34-4e47-b23c-a26555669b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:36.099580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9648e82-1d34-4e47-b23c-a26555669b1c None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:36.100691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9648e82-1d34-4e47-b23c-a26555669b1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:36.101222 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9648e82-1d34-4e47-b23c-a26555669b1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:36.105923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9648e82-1d34-4e47-b23c-a26555669b1c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:36.145837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 270/538] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:20:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:36.152575 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9648e82-1d34-4e47-b23c-a26555669b1c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:36.168286 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee27d2-c4c3-447c-81c8-ab030b10070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:36.168997 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee27d2-c4c3-447c-81c8-ab030b10070e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:36.169326 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee27d2-c4c3-447c-81c8-ab030b10070e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:36.169564 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee27d2-c4c3-447c-81c8-ab030b10070e None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:36.170296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee27d2-c4c3-447c-81c8-ab030b10070e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:36.170603 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee27d2-c4c3-447c-81c8-ab030b10070e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:36.172126 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee27d2-c4c3-447c-81c8-ab030b10070e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:36.223015 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 269/539] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:20:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:36.229635 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee27d2-c4c3-447c-81c8-ab030b10070e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:36.336371 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:36.410178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9648e82-1d34-4e47-b23c-a26555669b1c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:36.447602 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee27d2-c4c3-447c-81c8-ab030b10070e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:36.457180 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e85444-1028-4b8d-a049-76cca5469209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:36.457180 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e85444-1028-4b8d-a049-76cca5469209 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:36.457180 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e85444-1028-4b8d-a049-76cca5469209 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:36.457683 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e85444-1028-4b8d-a049-76cca5469209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:36.461952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e85444-1028-4b8d-a049-76cca5469209 None admin] RBAC: Adding query filter params (role.id=acbb2252c9f54cf8b789aa80f0a1fe85, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=6f3fe9e871b34a8faed94550e27fefd3) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:36.461952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e85444-1028-4b8d-a049-76cca5469209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:36.461952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e85444-1028-4b8d-a049-76cca5469209 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:36.475669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 271/540] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:20:36 2022] GET /identity/v3/role_assignments?user.id=6f3fe9e871b34a8faed94550e27fefd3&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=acbb2252c9f54cf8b789aa80f0a1fe85 => generated 259 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:36.478650 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150117aa-c27b-4b85-8073-e747208ce29e None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:36.478977 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150117aa-c27b-4b85-8073-e747208ce29e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:36.479211 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150117aa-c27b-4b85-8073-e747208ce29e None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:36.481001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 272/541] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:20:36.498674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0186-aadd-40cb-b80e-caadd62cf227 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:36.499031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0186-aadd-40cb-b80e-caadd62cf227 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:36.499315 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0186-aadd-40cb-b80e-caadd62cf227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:36.524182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9bda0186-aadd-40cb-b80e-caadd62cf227 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:36.525917 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9bda0186-aadd-40cb-b80e-caadd62cf227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:36.544348 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a5b5a-f83c-4738-9ee9-bd7664b5a724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:36.544961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a5b5a-f83c-4738-9ee9-bd7664b5a724 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:36.545248 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a5b5a-f83c-4738-9ee9-bd7664b5a724 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:36.545526 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a5b5a-f83c-4738-9ee9-bd7664b5a724 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:36.546410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a5b5a-f83c-4738-9ee9-bd7664b5a724 None admin] RBAC: Adding query filter params (role.id=acbb2252c9f54cf8b789aa80f0a1fe85, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=b72987d279bf4767bad23918fc33302b) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:36.546761 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a5b5a-f83c-4738-9ee9-bd7664b5a724 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:36.548662 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a5b5a-f83c-4738-9ee9-bd7664b5a724 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:36.567032 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 270/542] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:20:36 2022] GET /identity/v3/role_assignments?user.id=b72987d279bf4767bad23918fc33302b&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=acbb2252c9f54cf8b789aa80f0a1fe85 => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:36.625193 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 273/543] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:36.662131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a5b5a-f83c-4738-9ee9-bd7664b5a724 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:36.672551 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:36.855766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a5b5a-f83c-4738-9ee9-bd7664b5a724 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:36.899602 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512114c-c0f0-45fc-a914-c529488e75f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:36.900501 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512114c-c0f0-45fc-a914-c529488e75f8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:36.900784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512114c-c0f0-45fc-a914-c529488e75f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:36.901055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512114c-c0f0-45fc-a914-c529488e75f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:36.913236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512114c-c0f0-45fc-a914-c529488e75f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:36.921245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1512114c-c0f0-45fc-a914-c529488e75f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:36.921245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:36.921245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:36.921245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:36.921245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:36.921245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:36.921245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:36.921245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:36.921245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:36.921245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:36.921245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:36.921245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:36.921245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:36.921245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:36.921245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:36.921245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:36.922204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:36.922204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:36.922204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:36.922204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:36.922204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:36.922204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:36.922204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:36.922204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:36.922204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:36.922204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:36.922204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:36.922204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:36.922204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:36.922204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:36.922204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:36.922204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:36.923016 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:36.923016 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:36.923016 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:36.923016 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:36.923016 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:36.923016 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:36.923016 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:36.923016 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:36.923016 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:36.923016 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:36.923016 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:36.923016 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:36.927556 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 271/544] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:20:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:36.929055 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda0186-aadd-40cb-b80e-caadd62cf227 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:36.999365 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:37.072129 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda0186-aadd-40cb-b80e-caadd62cf227 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:37.126153 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081c8ed-bf25-4499-a55f-adcb10d44497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:37.126770 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081c8ed-bf25-4499-a55f-adcb10d44497 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:37.127036 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081c8ed-bf25-4499-a55f-adcb10d44497 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:37.127313 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081c8ed-bf25-4499-a55f-adcb10d44497 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:37.128157 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081c8ed-bf25-4499-a55f-adcb10d44497 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:37.128598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081c8ed-bf25-4499-a55f-adcb10d44497 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:37.130063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081c8ed-bf25-4499-a55f-adcb10d44497 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:37.144912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 274/545] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:20:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:37.150487 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512114c-c0f0-45fc-a914-c529488e75f8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:37.273584 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:37.336172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512114c-c0f0-45fc-a914-c529488e75f8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:37.395897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080ff67-ced8-44ec-9aa3-49422e7fc225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:37.396723 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080ff67-ced8-44ec-9aa3-49422e7fc225 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:37.397017 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080ff67-ced8-44ec-9aa3-49422e7fc225 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:37.397302 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080ff67-ced8-44ec-9aa3-49422e7fc225 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:37.417545 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080ff67-ced8-44ec-9aa3-49422e7fc225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:37.419090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080ff67-ced8-44ec-9aa3-49422e7fc225 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:37.444162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-3080ff67-ced8-44ec-9aa3-49422e7fc225 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:37.444162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:37.444162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:37.444162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:37.444162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:37.444162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:37.444162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:37.444162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:37.444162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:37.444162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:37.444162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:37.444162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:37.444162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:37.444162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:37.444162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:37.445996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:37.445996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:37.445996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:37.445996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:37.445996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:37.445996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:37.445996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:37.445996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:37.445996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:37.445996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:37.445996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:37.445996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:37.445996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:37.445996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:37.445996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:37.445996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:37.445996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:37.447852 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:37.447852 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:37.447852 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:37.447852 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:37.452057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 272/546] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:37.458623 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081c8ed-bf25-4499-a55f-adcb10d44497 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:37.594787 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081c8ed-bf25-4499-a55f-adcb10d44497 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:37.615038 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:37.644537 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bc91a-25e3-4f60-8a06-abd24c3920d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:37.645428 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bc91a-25e3-4f60-8a06-abd24c3920d6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:37.645807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bc91a-25e3-4f60-8a06-abd24c3920d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:37.646163 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bc91a-25e3-4f60-8a06-abd24c3920d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:37.646854 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bc91a-25e3-4f60-8a06-abd24c3920d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:37.647155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bc91a-25e3-4f60-8a06-abd24c3920d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:37.648612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bc91a-25e3-4f60-8a06-abd24c3920d6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:37.667211 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 275/547] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:37.668906 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080ff67-ced8-44ec-9aa3-49422e7fc225 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:37.818363 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080ff67-ced8-44ec-9aa3-49422e7fc225 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:37.837846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:37.867816 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea8ef2-ce68-4dac-a84c-07624b5b2ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:37.868690 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea8ef2-ce68-4dac-a84c-07624b5b2ebb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:37.870287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea8ef2-ce68-4dac-a84c-07624b5b2ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:37.870287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea8ef2-ce68-4dac-a84c-07624b5b2ebb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:37.880050 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea8ef2-ce68-4dac-a84c-07624b5b2ebb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:37.882827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea8ef2-ce68-4dac-a84c-07624b5b2ebb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:37.919746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-0dea8ef2-ce68-4dac-a84c-07624b5b2ebb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 16:20:37.919746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:37.919746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:37.919746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:37.919746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:37.919746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:37.919746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:37.919746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:37.919746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:37.919746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:37.919746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:37.919746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:37.919746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:20:37.919746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:20:37.919746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:20:37.919746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:20:37.923984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:37.923984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:37.923984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:20:37.923984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:37.923984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:20:37.923984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:37.923984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:37.923984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:37.923984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:37.923984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:37.923984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:37.923984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:37.923984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:37.923984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:37.923984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:37.923984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:37.923984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:37.923984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:37.929358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:37.929358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:37.929358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:20:37.929358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:20:37.929358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:20:37.929358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:20:37.929358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:20:37.929358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:20:37.929358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 16:20:37.929358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:37.929358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 273/548] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:20:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:37.936357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bc91a-25e3-4f60-8a06-abd24c3920d6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:38.047918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fecb52-fe01-4f2a-80e8-f4be6e17fbb4 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:38.048294 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fecb52-fe01-4f2a-80e8-f4be6e17fbb4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:38.048727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fecb52-fe01-4f2a-80e8-f4be6e17fbb4 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:38.056158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 274/549] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:38.062059 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07e29a-30c4-4d69-968b-f561098e24dc None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:38.062377 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07e29a-30c4-4d69-968b-f561098e24dc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:38.062608 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07e29a-30c4-4d69-968b-f561098e24dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:38.119815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-cd07e29a-30c4-4d69-968b-f561098e24dc None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:38.122334 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cd07e29a-30c4-4d69-968b-f561098e24dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:38.202309 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bc91a-25e3-4f60-8a06-abd24c3920d6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:38.306634 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 275/550] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:20:38.324809 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1deec5-320a-449b-bafa-a4394e856c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:38.325513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1deec5-320a-449b-bafa-a4394e856c50 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:38.325793 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1deec5-320a-449b-bafa-a4394e856c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:38.326067 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1deec5-320a-449b-bafa-a4394e856c50 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:38.326916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1deec5-320a-449b-bafa-a4394e856c50 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:38.327221 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1deec5-320a-449b-bafa-a4394e856c50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:38.328743 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1deec5-320a-449b-bafa-a4394e856c50 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:38.356128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 276/551] 10.222.0.41 () {56 vars in 1135 bytes} [Fri May 27 16:20:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:38.361891 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07e29a-30c4-4d69-968b-f561098e24dc None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:38.364634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1deec5-320a-449b-bafa-a4394e856c50 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:38.438680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:38.548920 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07e29a-30c4-4d69-968b-f561098e24dc None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:38.560414 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:38.573156 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1deec5-320a-449b-bafa-a4394e856c50 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:38.621444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf63e0f-e4a1-4d85-90da-6d47d463134b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:38.622514 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf63e0f-e4a1-4d85-90da-6d47d463134b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:38.623001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf63e0f-e4a1-4d85-90da-6d47d463134b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:38.623553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf63e0f-e4a1-4d85-90da-6d47d463134b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:38.643921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3229e9-cbe8-4973-88df-d8408d92c17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:38.645272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3229e9-cbe8-4973-88df-d8408d92c17d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:38.645832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3229e9-cbe8-4973-88df-d8408d92c17d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:38.646306 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3229e9-cbe8-4973-88df-d8408d92c17d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:38.669415 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3229e9-cbe8-4973-88df-d8408d92c17d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:38.679237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-6f3229e9-cbe8-4973-88df-d8408d92c17d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:38.679237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:38.679237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:38.679237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:38.679237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:38.679237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:38.679237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:38.679237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:38.679237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:38.679237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:38.679237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:38.679237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:38.679237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:38.679237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:38.679237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:38.679237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:38.680376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:38.680376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:38.680376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:38.680376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:38.680376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:38.680376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:38.680376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:38.680376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:38.680376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:38.680376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:38.680376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:38.680376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:38.680376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:38.680376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:38.680376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:38.680376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:38.681260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:38.681260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:38.681260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:38.681260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:38.681260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:38.681260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:38.681260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:38.681260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:38.681260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:38.681260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:38.681260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:38.681260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:38.690406 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 277/552] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:20:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:38.695864 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3229e9-cbe8-4973-88df-d8408d92c17d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:38.747248 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf63e0f-e4a1-4d85-90da-6d47d463134b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:38.748849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf63e0f-e4a1-4d85-90da-6d47d463134b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:38.879872 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 276/553] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:38.885933 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf63e0f-e4a1-4d85-90da-6d47d463134b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:38.908981 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:38.917302 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3229e9-cbe8-4973-88df-d8408d92c17d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:38.931718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:38.962358 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b22117-cbee-4345-a856-4e08ebc63795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:38.963806 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b22117-cbee-4345-a856-4e08ebc63795 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:38.964123 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b22117-cbee-4345-a856-4e08ebc63795 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:38.964406 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b22117-cbee-4345-a856-4e08ebc63795 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:38.965171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b22117-cbee-4345-a856-4e08ebc63795 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:38.965475 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b22117-cbee-4345-a856-4e08ebc63795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:38.967598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b22117-cbee-4345-a856-4e08ebc63795 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:38.983928 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 278/554] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:20:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:38.988171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b22117-cbee-4345-a856-4e08ebc63795 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:39.046427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf63e0f-e4a1-4d85-90da-6d47d463134b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:39.107513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea69170d-8ec9-474a-937b-89d96664a27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:39.108861 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69170d-8ec9-474a-937b-89d96664a27f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:39.109442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69170d-8ec9-474a-937b-89d96664a27f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:39.109919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea69170d-8ec9-474a-937b-89d96664a27f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:39.131299 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69170d-8ec9-474a-937b-89d96664a27f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:39.134963 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea69170d-8ec9-474a-937b-89d96664a27f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:39.145967 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b22117-cbee-4345-a856-4e08ebc63795 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:39.175352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ea69170d-8ec9-474a-937b-89d96664a27f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:39.175352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:39.175352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:39.175352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:39.175352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:39.175352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:39.175352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:39.175352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:39.175352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:39.175352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:39.175352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:39.175352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:39.175352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:39.175352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:39.175352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:39.177430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:39.177430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:39.177430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:39.177430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:39.177430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:39.177430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:39.177430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:39.177430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:39.177430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:39.177430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:39.177430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:39.177430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:39.177430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:39.177430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:39.177430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:39.177430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:39.177430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:39.179147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:39.179147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:39.179147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:39.179147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:39.182797 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01663c-b846-4384-adfd-18d479875c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:39.190662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01663c-b846-4384-adfd-18d479875c8f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:39.190662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01663c-b846-4384-adfd-18d479875c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:39.190662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01663c-b846-4384-adfd-18d479875c8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:39.192027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 277/555] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:39.195065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359bf65-8712-4cfc-8043-5d971406bc2b None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:39.195963 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359bf65-8712-4cfc-8043-5d971406bc2b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:39.196664 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01663c-b846-4384-adfd-18d479875c8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:39.197082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359bf65-8712-4cfc-8043-5d971406bc2b None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:39.198151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01663c-b846-4384-adfd-18d479875c8f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:39.200539 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 278/556] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:39.202332 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359bf65-8712-4cfc-8043-5d971406bc2b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:39.218514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ef01663c-b846-4384-adfd-18d479875c8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:39.218514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:39.218514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:39.218514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:39.218514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:39.218514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:39.218514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:39.218514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:39.218514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:39.218514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:39.218514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:39.218514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:39.218514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:39.218514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:39.218514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:39.220997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:39.220997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:39.220997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:39.220997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:39.220997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:39.220997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:39.220997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:39.220997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:39.220997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:39.220997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:39.220997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:39.220997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:39.220997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:39.220997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:39.220997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:39.220997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:39.220997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:39.228278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:39.228278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:39.228278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:39.228278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:39.228278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 279/557] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:39.228278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7f5d3-d2c7-404e-80b2-6d03de8160c5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:39.228278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7f5d3-d2c7-404e-80b2-6d03de8160c5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:39.228278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7f5d3-d2c7-404e-80b2-6d03de8160c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:39.252996 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-42d7f5d3-d2c7-404e-80b2-6d03de8160c5 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:39.255078 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-42d7f5d3-d2c7-404e-80b2-6d03de8160c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:39.257995 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:39.333507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:39.356066 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 280/558] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:39.356066 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7f5d3-d2c7-404e-80b2-6d03de8160c5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:39.412351 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359bf65-8712-4cfc-8043-5d971406bc2b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:39.455908 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cffe5-32ca-4fb7-9f61-ce88df17f915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:39.456658 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cffe5-32ca-4fb7-9f61-ce88df17f915 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:39.456945 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cffe5-32ca-4fb7-9f61-ce88df17f915 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:39.457222 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cffe5-32ca-4fb7-9f61-ce88df17f915 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:39.458074 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cffe5-32ca-4fb7-9f61-ce88df17f915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:39.458386 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cffe5-32ca-4fb7-9f61-ce88df17f915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:39.459828 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cffe5-32ca-4fb7-9f61-ce88df17f915 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:39.472218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 279/559] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:39.473365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cffe5-32ca-4fb7-9f61-ce88df17f915 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:39.476772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7f5d3-d2c7-404e-80b2-6d03de8160c5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:39.513979 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58272a-55ca-4bda-96cb-8e19fa2d3d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:39.514656 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58272a-55ca-4bda-96cb-8e19fa2d3d6c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:39.514936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58272a-55ca-4bda-96cb-8e19fa2d3d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:39.515218 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58272a-55ca-4bda-96cb-8e19fa2d3d6c None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:39.515947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58272a-55ca-4bda-96cb-8e19fa2d3d6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:39.516275 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58272a-55ca-4bda-96cb-8e19fa2d3d6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:39.517677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58272a-55ca-4bda-96cb-8e19fa2d3d6c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:39.525393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:39.530757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 281/560] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:39.532170 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120e508-9dd5-487a-a53e-db63dcd83bf8 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:39.532692 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120e508-9dd5-487a-a53e-db63dcd83bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:39.532975 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120e508-9dd5-487a-a53e-db63dcd83bf8 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:39.534278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 282/561] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:39.535618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9e99e-2bc0-4e4e-b73d-f076c568dc7c None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:39.535909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9e99e-2bc0-4e4e-b73d-f076c568dc7c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:39.536218 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9e99e-2bc0-4e4e-b73d-f076c568dc7c None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:39.537908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 283/562] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:39.538768 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9e99e-2bc0-4e4e-b73d-f076c568dc7c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:39.593181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cffe5-32ca-4fb7-9f61-ce88df17f915 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:39.612988 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:39.635178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3d252-5b8f-4ccf-b7e9-ddac981512cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:39.635997 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3d252-5b8f-4ccf-b7e9-ddac981512cd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:39.636735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3d252-5b8f-4ccf-b7e9-ddac981512cd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:39.637022 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3d252-5b8f-4ccf-b7e9-ddac981512cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:39.649326 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3d252-5b8f-4ccf-b7e9-ddac981512cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:39.656379 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9e99e-2bc0-4e4e-b73d-f076c568dc7c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:39.657010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c0e3d252-5b8f-4ccf-b7e9-ddac981512cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:39.657010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:39.657010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:39.657010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:39.657010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:39.657010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:39.657010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:39.657010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:39.657010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:39.657010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:39.657010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:39.657010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:39.657010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:39.657010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:39.657010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:39.657010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:39.658054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:39.658054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:39.658054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:39.658054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:39.658054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:39.658054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:39.658054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:39.658054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:39.658054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:39.658054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:39.658054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:39.658054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:39.658054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:39.658054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:39.658054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:39.658054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:39.658921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:39.658921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:39.658921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:39.658921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:39.658921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:39.658921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:39.658921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:39.658921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:39.658921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:39.658921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:39.658921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:39.658921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:39.658921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 280/563] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:20:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:39.659762 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3d252-5b8f-4ccf-b7e9-ddac981512cd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:39.697199 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9fcad-9f7a-442d-8bd6-bdadca9dbbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:39.697923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9fcad-9f7a-442d-8bd6-bdadca9dbbeb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:39.698203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9fcad-9f7a-442d-8bd6-bdadca9dbbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:39.698821 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9fcad-9f7a-442d-8bd6-bdadca9dbbeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:39.707050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9fcad-9f7a-442d-8bd6-bdadca9dbbeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:39.709084 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9fcad-9f7a-442d-8bd6-bdadca9dbbeb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:39.726403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f2f9fcad-9f7a-442d-8bd6-bdadca9dbbeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:39.726403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:39.726403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:39.726403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:39.726403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:39.726403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:39.726403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:39.726403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:39.726403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:39.726403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:39.726403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:39.726403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:39.726403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:20:39.726403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:20:39.726403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:20:39.727963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:20:39.727963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:39.727963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:39.727963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:39.727963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:39.727963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:39.727963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:39.727963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:39.727963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:39.727963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:39.727963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:39.727963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:39.727963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:39.727963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:39.727963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:39.727963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:39.727963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:39.729205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:20:39.729205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:20:39.729205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:20:39.729205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:20:39.729205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:20:39.729205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:20:39.729205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:39.729205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:39.729205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 284/564] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:39.729205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24837011-23fa-4529-a151-5d41c93d1aa2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:39.729987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24837011-23fa-4529-a151-5d41c93d1aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:39.729987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24837011-23fa-4529-a151-5d41c93d1aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:39.747764 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-24837011-23fa-4529-a151-5d41c93d1aa2 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:39.749009 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-24837011-23fa-4529-a151-5d41c93d1aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:39.784715 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3d252-5b8f-4ccf-b7e9-ddac981512cd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:39.807671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:39.820166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bcb23-a09e-4ece-8006-5957600ae618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:39.820951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bcb23-a09e-4ece-8006-5957600ae618 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:39.821226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bcb23-a09e-4ece-8006-5957600ae618 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:39.821500 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bcb23-a09e-4ece-8006-5957600ae618 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:39.822728 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 285/565] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:39.830585 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6e943-5b81-4f15-8407-2f13b71cdadf None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:39.830585 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6e943-5b81-4f15-8407-2f13b71cdadf None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:39.830585 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6e943-5b81-4f15-8407-2f13b71cdadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:39.830927 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3bcb23-a09e-4ece-8006-5957600ae618 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:39.831593 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3bcb23-a09e-4ece-8006-5957600ae618 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:39.846562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-4a3bcb23-a09e-4ece-8006-5957600ae618 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 16:20:39.846562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:39.846562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:39.846562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:39.846562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:39.846562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:39.846562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:39.846562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:39.846562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:39.846562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:39.846562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:39.846562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:39.846562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:20:39.846562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:20:39.846562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:20:39.846562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:20:39.848427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:39.848427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:39.848427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:20:39.848427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:39.848427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:20:39.848427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:39.848427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:39.848427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:39.848427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:39.848427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:39.848427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:39.848427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:39.848427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:39.848427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:39.848427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:39.848427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:39.848427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:39.848427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:39.849936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:39.849936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:39.849936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:20:39.849936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:20:39.849936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:20:39.849936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:20:39.849936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:20:39.849936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:20:39.849936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 16:20:39.849936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:39.849936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 281/566] 10.222.0.41 () {56 vars in 1093 bytes} [Fri May 27 16:20:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:39.849936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bcb23-a09e-4ece-8006-5957600ae618 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:39.854652 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-dae6e943-5b81-4f15-8407-2f13b71cdadf None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:39.855877 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-dae6e943-5b81-4f15-8407-2f13b71cdadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:39.905960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:39.935803 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 286/567] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:39.936781 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6e943-5b81-4f15-8407-2f13b71cdadf None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:39.972873 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bcb23-a09e-4ece-8006-5957600ae618 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:40.013319 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525252b1-aa33-49b3-bb5e-af67f1a8799a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:40.014000 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525252b1-aa33-49b3-bb5e-af67f1a8799a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:40.014282 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525252b1-aa33-49b3-bb5e-af67f1a8799a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:40.014556 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525252b1-aa33-49b3-bb5e-af67f1a8799a None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:40.015301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525252b1-aa33-49b3-bb5e-af67f1a8799a None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:40.015611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525252b1-aa33-49b3-bb5e-af67f1a8799a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:40.017057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525252b1-aa33-49b3-bb5e-af67f1a8799a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:40.026504 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 282/568] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:20:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:40.027213 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525252b1-aa33-49b3-bb5e-af67f1a8799a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:40.062645 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6e943-5b81-4f15-8407-2f13b71cdadf None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:40.084440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:40.105805 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730693b-539c-4f75-b727-fc5011694b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:40.106491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730693b-539c-4f75-b727-fc5011694b8d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:40.106776 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730693b-539c-4f75-b727-fc5011694b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:40.107048 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a730693b-539c-4f75-b727-fc5011694b8d None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:40.107849 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730693b-539c-4f75-b727-fc5011694b8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:40.108195 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730693b-539c-4f75-b727-fc5011694b8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:40.109716 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a730693b-539c-4f75-b727-fc5011694b8d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:40.123370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 287/569] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:20:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:40.124256 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730693b-539c-4f75-b727-fc5011694b8d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:40.139138 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:40.142678 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525252b1-aa33-49b3-bb5e-af67f1a8799a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:40.182859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70566f-eb62-4509-997c-8a05075b2590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:40.183672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70566f-eb62-4509-997c-8a05075b2590 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:40.183952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70566f-eb62-4509-997c-8a05075b2590 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:40.184252 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70566f-eb62-4509-997c-8a05075b2590 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:40.195947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70566f-eb62-4509-997c-8a05075b2590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:40.203793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1f70566f-eb62-4509-997c-8a05075b2590 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:40.203793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:40.203793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:40.203793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:40.203793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:40.203793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:40.203793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:40.203793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:40.203793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:40.203793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:40.203793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:40.203793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:40.203793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:40.203793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:40.203793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:40.203793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:40.205295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:40.205295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:40.205295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:40.205295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:40.205295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:40.205295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:40.205295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:40.205295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:40.205295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:40.205295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:40.205295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:40.205295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:40.205295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:40.205295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:40.205295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:40.205295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:40.206152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:40.206152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:40.206152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:40.206152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:40.206152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:40.206152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:40.206152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:40.206152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:40.206152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:40.206152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:40.206152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:40.206152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:40.208187 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 283/570] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:20:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:40.209310 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70566f-eb62-4509-997c-8a05075b2590 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:40.242587 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a730693b-539c-4f75-b727-fc5011694b8d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:40.279549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3d0ec-1daf-4e9e-8b8a-f4961c5f6279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:40.280271 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3d0ec-1daf-4e9e-8b8a-f4961c5f6279 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:40.280556 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3d0ec-1daf-4e9e-8b8a-f4961c5f6279 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:40.280829 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3d0ec-1daf-4e9e-8b8a-f4961c5f6279 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:40.281695 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3d0ec-1daf-4e9e-8b8a-f4961c5f6279 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:40.282024 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3d0ec-1daf-4e9e-8b8a-f4961c5f6279 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:40.283507 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3d0ec-1daf-4e9e-8b8a-f4961c5f6279 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:40.307335 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 288/571] 10.222.0.41 () {56 vars in 1133 bytes} [Fri May 27 16:20:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:40.307944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3d0ec-1daf-4e9e-8b8a-f4961c5f6279 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:40.320309 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70566f-eb62-4509-997c-8a05075b2590 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:40.350524 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:40.356942 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91300ab-9b1e-407a-988f-629ad04ba92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:40.357754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91300ab-9b1e-407a-988f-629ad04ba92d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:40.358035 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91300ab-9b1e-407a-988f-629ad04ba92d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:40.358308 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91300ab-9b1e-407a-988f-629ad04ba92d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:40.370522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91300ab-9b1e-407a-988f-629ad04ba92d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:40.379236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c91300ab-9b1e-407a-988f-629ad04ba92d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:40.379236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:40.379236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:40.379236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:40.379236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:40.379236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:40.379236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:40.379236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:40.379236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:40.379236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:40.379236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:40.379236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:40.379236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:40.379236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:40.379236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:40.379236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:40.380727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:40.380727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:40.380727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:40.380727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:40.380727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:40.380727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:40.380727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:40.380727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:40.380727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:40.380727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:40.380727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:40.380727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:40.380727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:40.380727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:40.380727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:40.380727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:40.381980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:40.381980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:40.381980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:40.381980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:40.381980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:40.381980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:40.381980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:40.381980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:40.381980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:40.381980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:40.381980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:40.381980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:40.381980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 284/572] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:20:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:40.381980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91300ab-9b1e-407a-988f-629ad04ba92d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:40.408720 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:40.428788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3d0ec-1daf-4e9e-8b8a-f4961c5f6279 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:40.464223 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f17725-8ae0-445a-976d-becbf18dfb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:40.465027 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f17725-8ae0-445a-976d-becbf18dfb5e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:40.465420 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f17725-8ae0-445a-976d-becbf18dfb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:40.465628 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f17725-8ae0-445a-976d-becbf18dfb5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:40.477122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f17725-8ae0-445a-976d-becbf18dfb5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:40.478605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f17725-8ae0-445a-976d-becbf18dfb5e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:40.492379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91300ab-9b1e-407a-988f-629ad04ba92d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:40.497136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-c0f17725-8ae0-445a-976d-becbf18dfb5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:40.497136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:40.497136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:40.497136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:40.497136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:40.497136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:40.497136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:40.497136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:40.497136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:40.497136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:40.497136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:40.497136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:40.497136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:40.497136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:40.497136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:40.498161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:40.498161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:40.498161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:40.498161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:40.498161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:40.498161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:40.498161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:40.498161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:40.498161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:40.498161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:40.498161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:40.498161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:40.498161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:40.498161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:40.498161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:40.498161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:40.498161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:40.500055 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:40.500055 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:40.500055 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:40.500055 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:40.500055 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 289/573] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:40.500055 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f17725-8ae0-445a-976d-becbf18dfb5e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:40.530979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3b573-0746-45fa-a848-05550e5839b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:40.531649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3b573-0746-45fa-a848-05550e5839b8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:40.531935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3b573-0746-45fa-a848-05550e5839b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:40.532242 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3b573-0746-45fa-a848-05550e5839b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:40.533082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3b573-0746-45fa-a848-05550e5839b8 None admin] RBAC: Adding query filter params (role.id=acbb2252c9f54cf8b789aa80f0a1fe85, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=dbfcca96ad754692b3fb7f891013dafb) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:40.533418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3b573-0746-45fa-a848-05550e5839b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:40.534920 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3b573-0746-45fa-a848-05550e5839b8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:40.540885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 285/574] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:20:40 2022] GET /identity/v3/role_assignments?user.id=dbfcca96ad754692b3fb7f891013dafb&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=acbb2252c9f54cf8b789aa80f0a1fe85 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:40.542027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3b573-0746-45fa-a848-05550e5839b8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:40.621934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:40.639436 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f17725-8ae0-445a-976d-becbf18dfb5e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:40.640620 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:40.658430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3b573-0746-45fa-a848-05550e5839b8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:40.683088 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0e58d-ee56-4955-b2ae-fd07949e6f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:40.683732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0e58d-ee56-4955-b2ae-fd07949e6f4d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:40.684035 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0e58d-ee56-4955-b2ae-fd07949e6f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:40.684315 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0e58d-ee56-4955-b2ae-fd07949e6f4d None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:40.685081 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0e58d-ee56-4955-b2ae-fd07949e6f4d None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:40.685385 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0e58d-ee56-4955-b2ae-fd07949e6f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:40.686964 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0e58d-ee56-4955-b2ae-fd07949e6f4d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:40.697474 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 290/575] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:20:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:40.703204 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0e58d-ee56-4955-b2ae-fd07949e6f4d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:40.704396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2069c-71b3-4e97-82be-5c3756c49918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:40.705606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2069c-71b3-4e97-82be-5c3756c49918 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:40.705890 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2069c-71b3-4e97-82be-5c3756c49918 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:40.706167 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2069c-71b3-4e97-82be-5c3756c49918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:40.719578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2069c-71b3-4e97-82be-5c3756c49918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:40.721152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2069c-71b3-4e97-82be-5c3756c49918 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:40.740859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-efe2069c-71b3-4e97-82be-5c3756c49918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:40.740859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:40.740859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:40.740859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:40.740859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:40.740859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:40.740859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:40.740859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:40.740859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:40.740859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:40.740859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:40.740859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:40.740859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:40.740859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:40.740859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:40.742007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:40.742007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:40.742007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:40.742007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:40.742007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:40.742007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:40.742007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:40.742007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:40.742007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:40.742007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:40.742007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:40.742007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:40.742007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:40.742007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:40.742007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:40.742007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:40.742007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:40.742961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:40.742961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:40.742961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:40.742961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:40.742961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 286/576] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:40.742961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2069c-71b3-4e97-82be-5c3756c49918 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:40.818832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0e58d-ee56-4955-b2ae-fd07949e6f4d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:40.855828 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d3e19-2e0c-4b80-8125-ea9ca82f24cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:40.856705 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d3e19-2e0c-4b80-8125-ea9ca82f24cf None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:40.856993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d3e19-2e0c-4b80-8125-ea9ca82f24cf None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:40.857258 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d3e19-2e0c-4b80-8125-ea9ca82f24cf None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:40.858133 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d3e19-2e0c-4b80-8125-ea9ca82f24cf None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:40.858444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d3e19-2e0c-4b80-8125-ea9ca82f24cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:40.859950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d3e19-2e0c-4b80-8125-ea9ca82f24cf None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:40.877431 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 291/577] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:20:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:40.877431 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d3e19-2e0c-4b80-8125-ea9ca82f24cf None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:40.884632 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2069c-71b3-4e97-82be-5c3756c49918 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:40.890420 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:40.923502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c4acc-4ded-4cd0-887f-bf672460d8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:40.924201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c4acc-4ded-4cd0-887f-bf672460d8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:40.924481 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c4acc-4ded-4cd0-887f-bf672460d8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:40.924756 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c4acc-4ded-4cd0-887f-bf672460d8c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:40.925540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c4acc-4ded-4cd0-887f-bf672460d8c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:40.925873 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c4acc-4ded-4cd0-887f-bf672460d8c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:40.927289 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c4acc-4ded-4cd0-887f-bf672460d8c2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:40.929831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:40.946075 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 287/578] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:40.946075 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c4acc-4ded-4cd0-887f-bf672460d8c2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:40.996021 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d3e19-2e0c-4b80-8125-ea9ca82f24cf None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:41.032643 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ebb08-80f1-47ce-8f7c-f53f7f6b2aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:41.033454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ebb08-80f1-47ce-8f7c-f53f7f6b2aab None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:41.033737 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ebb08-80f1-47ce-8f7c-f53f7f6b2aab None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:41.034124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ebb08-80f1-47ce-8f7c-f53f7f6b2aab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:41.046886 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ebb08-80f1-47ce-8f7c-f53f7f6b2aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:41.048395 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ebb08-80f1-47ce-8f7c-f53f7f6b2aab None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:41.057832 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c4acc-4ded-4cd0-887f-bf672460d8c2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:41.067353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-012ebb08-80f1-47ce-8f7c-f53f7f6b2aab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:41.067353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:41.067353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:41.067353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:41.067353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:41.067353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:41.067353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:41.067353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:41.067353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:41.067353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:41.067353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:41.067353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:41.067353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:41.067353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:41.067353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:41.068393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:41.068393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:41.068393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:41.068393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:41.068393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:41.068393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:41.068393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:41.068393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:41.068393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:41.068393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:41.068393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:41.068393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:41.068393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:41.068393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:41.068393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:41.068393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:41.068393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:41.069386 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:41.069386 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:41.069386 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:41.069386 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:41.069386 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 292/579] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:41.070547 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ebb08-80f1-47ce-8f7c-f53f7f6b2aab None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:41.099873 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b112f-f88a-49ad-9a08-756e243a6937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:41.100733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b112f-f88a-49ad-9a08-756e243a6937 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:41.101116 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b112f-f88a-49ad-9a08-756e243a6937 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:41.101490 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b112f-f88a-49ad-9a08-756e243a6937 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:41.102367 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b112f-f88a-49ad-9a08-756e243a6937 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:41.102879 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b112f-f88a-49ad-9a08-756e243a6937 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:41.104492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b112f-f88a-49ad-9a08-756e243a6937 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:41.121403 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 288/580] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:41.122454 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b112f-f88a-49ad-9a08-756e243a6937 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:41.153102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:41.183198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:41.196387 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ebb08-80f1-47ce-8f7c-f53f7f6b2aab None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:41.231740 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b112f-f88a-49ad-9a08-756e243a6937 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:41.234301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bf105-d686-492d-871b-6c49598fd2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:41.235116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bf105-d686-492d-871b-6c49598fd2dd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:41.238702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bf105-d686-492d-871b-6c49598fd2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:41.238702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bf105-d686-492d-871b-6c49598fd2dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:41.251817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4bf105-d686-492d-871b-6c49598fd2dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:41.253332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4bf105-d686-492d-871b-6c49598fd2dd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:41.268375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662703e8-e205-4c1f-a646-e1077a1ad94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:41.269374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662703e8-e205-4c1f-a646-e1077a1ad94e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:41.269750 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662703e8-e205-4c1f-a646-e1077a1ad94e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:41.270295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662703e8-e205-4c1f-a646-e1077a1ad94e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:41.272236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-fb4bf105-d686-492d-871b-6c49598fd2dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:41.272236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:41.272236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:41.272236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:41.272236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:41.272236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:41.272236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:41.272236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:41.272236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:41.272236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:41.272236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:41.272236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:41.272236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:41.272236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:41.272236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:41.273360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:41.273360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:41.273360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:41.273360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:41.273360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:41.273360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:41.273360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:41.273360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:41.273360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:41.273360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:41.273360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:41.273360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:41.273360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:41.273360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:41.273360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:41.273360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:41.273360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:41.274736 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:41.274736 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:41.274736 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:41.274736 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:41.274736 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 293/581] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:41.278859 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bf105-d686-492d-871b-6c49598fd2dd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:41.281807 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662703e8-e205-4c1f-a646-e1077a1ad94e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:41.283420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662703e8-e205-4c1f-a646-e1077a1ad94e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:41.301718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-662703e8-e205-4c1f-a646-e1077a1ad94e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 16:20:41.301718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:41.301718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:41.301718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:41.301718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:41.301718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:41.301718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:41.301718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:41.301718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:41.301718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:41.301718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:41.301718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:41.301718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:20:41.301718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:20:41.301718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:20:41.301718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:20:41.302981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:41.302981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:41.302981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:20:41.302981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:41.302981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:20:41.302981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:41.302981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:41.302981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:41.302981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:41.302981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:41.302981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:41.302981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:41.302981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:41.302981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:41.302981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:41.302981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:41.302981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:41.302981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:41.304226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:41.304226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:41.304226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:20:41.304226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:20:41.304226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:20:41.304226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:20:41.304226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:20:41.304226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:20:41.304226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 16:20:41.304226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:41.309413 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 289/582] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:41.310226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662703e8-e205-4c1f-a646-e1077a1ad94e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:41.394225 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bf105-d686-492d-871b-6c49598fd2dd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:41.411815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:41.425827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662703e8-e205-4c1f-a646-e1077a1ad94e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:41.432954 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116885c7-fddb-43ae-9efe-5793ef88cbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:41.434114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116885c7-fddb-43ae-9efe-5793ef88cbeb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:41.434114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116885c7-fddb-43ae-9efe-5793ef88cbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:41.434430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116885c7-fddb-43ae-9efe-5793ef88cbeb None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:41.435231 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116885c7-fddb-43ae-9efe-5793ef88cbeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:41.435607 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116885c7-fddb-43ae-9efe-5793ef88cbeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:41.437151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116885c7-fddb-43ae-9efe-5793ef88cbeb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:41.445648 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:41.451249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 294/583] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:41.451832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116885c7-fddb-43ae-9efe-5793ef88cbeb None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:41.471416 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c8fe0-3da1-4d4d-aca3-d3fd48467801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:41.472421 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c8fe0-3da1-4d4d-aca3-d3fd48467801 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:41.472781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c8fe0-3da1-4d4d-aca3-d3fd48467801 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:41.473323 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c8fe0-3da1-4d4d-aca3-d3fd48467801 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:41.480776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c8fe0-3da1-4d4d-aca3-d3fd48467801 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:41.482263 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c8fe0-3da1-4d4d-aca3-d3fd48467801 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:41.497364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-9f7c8fe0-3da1-4d4d-aca3-d3fd48467801 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:41.497364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:41.497364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:41.497364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:41.497364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:41.497364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:41.497364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:41.497364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:41.497364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:41.497364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:41.497364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:41.497364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:41.497364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:20:41.497364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:20:41.497364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:20:41.498365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:20:41.498365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:41.498365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:41.498365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:41.498365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:41.498365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:41.498365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:41.498365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:41.498365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:41.498365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:41.498365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:41.498365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:41.498365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:41.498365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:41.498365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:41.498365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:41.498365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:41.499292 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:20:41.499292 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:20:41.499292 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:20:41.499292 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:20:41.499292 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:20:41.499292 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:20:41.499292 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:41.499292 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:41.503393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 290/584] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:41.504311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c8fe0-3da1-4d4d-aca3-d3fd48467801 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:41.565951 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116885c7-fddb-43ae-9efe-5793ef88cbeb None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:41.602835 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36b3cd-124c-47cb-9cd9-a9b5c3ef1547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:41.603648 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36b3cd-124c-47cb-9cd9-a9b5c3ef1547 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:41.604033 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36b3cd-124c-47cb-9cd9-a9b5c3ef1547 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:41.604382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36b3cd-124c-47cb-9cd9-a9b5c3ef1547 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:41.605104 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36b3cd-124c-47cb-9cd9-a9b5c3ef1547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:41.605404 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36b3cd-124c-47cb-9cd9-a9b5c3ef1547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:41.606845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac36b3cd-124c-47cb-9cd9-a9b5c3ef1547 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:41.612666 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c8fe0-3da1-4d4d-aca3-d3fd48467801 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:41.618632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 295/585] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:41.619472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36b3cd-124c-47cb-9cd9-a9b5c3ef1547 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:41.656471 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cc95b-597c-40e9-99b2-b15ff79beab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:41.657153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cc95b-597c-40e9-99b2-b15ff79beab3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:41.657435 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cc95b-597c-40e9-99b2-b15ff79beab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:41.657709 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cc95b-597c-40e9-99b2-b15ff79beab3 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:41.658702 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cc95b-597c-40e9-99b2-b15ff79beab3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:41.659179 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:41.660230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cc95b-597c-40e9-99b2-b15ff79beab3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:41.661921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cc95b-597c-40e9-99b2-b15ff79beab3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:41.690174 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 291/586] 10.222.0.41 () {56 vars in 1137 bytes} [Fri May 27 16:20:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:41.690174 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cc95b-597c-40e9-99b2-b15ff79beab3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:41.725628 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:41.746884 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac36b3cd-124c-47cb-9cd9-a9b5c3ef1547 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:41.786588 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1be39-ee1e-483e-b1ea-d0cbc13592a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:41.787386 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1be39-ee1e-483e-b1ea-d0cbc13592a3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:41.787663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1be39-ee1e-483e-b1ea-d0cbc13592a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:41.787941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1be39-ee1e-483e-b1ea-d0cbc13592a3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:41.797929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1be39-ee1e-483e-b1ea-d0cbc13592a3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:41.799369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1be39-ee1e-483e-b1ea-d0cbc13592a3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:41.815934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-30e1be39-ee1e-483e-b1ea-d0cbc13592a3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 16:20:41.815934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:41.815934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:41.815934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:41.815934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:41.815934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:41.815934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:41.815934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:41.815934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:41.815934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:41.815934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:41.815934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:41.815934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:20:41.815934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:20:41.815934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:20:41.815934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:20:41.817113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:41.817113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:41.817113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:20:41.817113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:41.817113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:20:41.817113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:41.817113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:41.817113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:41.817113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:41.817113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:41.817113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:41.817113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:41.817113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:41.817113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:41.817113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:41.817113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:41.817113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:41.817113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:41.818825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:41.818825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:41.818825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:20:41.818825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:20:41.818825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:20:41.818825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:20:41.818825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:20:41.818825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:20:41.818825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 16:20:41.818825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:41.818825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 296/587] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:20:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:41.818825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1be39-ee1e-483e-b1ea-d0cbc13592a3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:41.824296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cc95b-597c-40e9-99b2-b15ff79beab3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:41.860681 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15cd2e-a5e6-44b6-b17f-9ab2d06450fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:41.861343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15cd2e-a5e6-44b6-b17f-9ab2d06450fa None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:41.861622 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15cd2e-a5e6-44b6-b17f-9ab2d06450fa None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:41.861890 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15cd2e-a5e6-44b6-b17f-9ab2d06450fa None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:41.862721 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15cd2e-a5e6-44b6-b17f-9ab2d06450fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:41.863515 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15cd2e-a5e6-44b6-b17f-9ab2d06450fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:41.865156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15cd2e-a5e6-44b6-b17f-9ab2d06450fa None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:41.883531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 292/588] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:20:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:41.883531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15cd2e-a5e6-44b6-b17f-9ab2d06450fa None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:41.934997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:41.942574 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1be39-ee1e-483e-b1ea-d0cbc13592a3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:41.979391 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d5bac-25e7-42bf-8513-37ee4de75d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:41.981512 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d5bac-25e7-42bf-8513-37ee4de75d52 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:41.981512 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d5bac-25e7-42bf-8513-37ee4de75d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:41.981512 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d5bac-25e7-42bf-8513-37ee4de75d52 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:41.990111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d5bac-25e7-42bf-8513-37ee4de75d52 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:41.990732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:41.992151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d5bac-25e7-42bf-8513-37ee4de75d52 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:41.999852 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15cd2e-a5e6-44b6-b17f-9ab2d06450fa None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:42.008590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-399d5bac-25e7-42bf-8513-37ee4de75d52 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 16:20:42.008590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:42.008590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:42.008590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:42.008590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:42.008590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:42.008590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:42.008590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:42.008590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:42.008590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:42.008590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:42.008590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:42.008590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:20:42.008590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:20:42.008590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:20:42.008590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:20:42.010072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:42.010072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:42.010072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:20:42.010072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:42.010072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:20:42.010072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:42.010072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:42.010072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:42.010072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:42.010072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:42.010072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:42.010072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:42.010072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:42.010072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:42.010072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:42.010072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:42.010072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:42.010072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:42.011920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:42.011920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:42.011920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:20:42.011920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:20:42.011920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:20:42.011920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:20:42.011920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:20:42.011920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:20:42.011920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 16:20:42.011920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:42.014710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 297/589] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:42.015334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d5bac-25e7-42bf-8513-37ee4de75d52 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:42.038739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb57ec-f610-4abf-9dde-78a42b133882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:42.039675 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb57ec-f610-4abf-9dde-78a42b133882 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:42.040058 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb57ec-f610-4abf-9dde-78a42b133882 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:42.040408 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb57ec-f610-4abf-9dde-78a42b133882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:42.052154 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb57ec-f610-4abf-9dde-78a42b133882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:42.053739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb57ec-f610-4abf-9dde-78a42b133882 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:42.071565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-74fb57ec-f610-4abf-9dde-78a42b133882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:42.071565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:42.071565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:42.071565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:42.071565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:42.071565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:42.071565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:42.071565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:42.071565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:42.071565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:42.071565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:42.071565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:42.071565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:42.071565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:42.071565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:42.072784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:42.072784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:42.072784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:42.072784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:42.072784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:42.072784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:42.072784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:42.072784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:42.072784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:42.072784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:42.072784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:42.072784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:42.072784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:42.072784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:42.072784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:42.072784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:42.072784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:42.073812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:42.073812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:42.073812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:42.073812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:42.078588 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 293/590] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:42.078588 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb57ec-f610-4abf-9dde-78a42b133882 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:42.135772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d5bac-25e7-42bf-8513-37ee4de75d52 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:42.173448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fc16e-c135-412f-8d7f-29f8e39889cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:42.174126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fc16e-c135-412f-8d7f-29f8e39889cd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:42.174410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fc16e-c135-412f-8d7f-29f8e39889cd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:42.174686 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fc16e-c135-412f-8d7f-29f8e39889cd None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:42.175656 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fc16e-c135-412f-8d7f-29f8e39889cd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:42.175968 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fc16e-c135-412f-8d7f-29f8e39889cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:42.177492 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fc16e-c135-412f-8d7f-29f8e39889cd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:42.196538 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb57ec-f610-4abf-9dde-78a42b133882 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:42.201367 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 298/591] 10.222.0.41 () {56 vars in 1139 bytes} [Fri May 27 16:20:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:42.201367 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fc16e-c135-412f-8d7f-29f8e39889cd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:42.216168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:42.242293 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a538a8-7614-4c50-b626-6c9db636848a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:42.243219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a538a8-7614-4c50-b626-6c9db636848a None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:42.243498 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a538a8-7614-4c50-b626-6c9db636848a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:42.243772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a538a8-7614-4c50-b626-6c9db636848a None admin] PATH_INFO: `/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/3caa3dbc7bd24ebba28296a1eba9cefe/roles/acbb2252c9f54cf8b789aa80f0a1fe85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:42.259381 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a538a8-7614-4c50-b626-6c9db636848a None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5c551b621342e5a5a6e742d673d525, user_id=3caa3dbc7bd24ebba28296a1eba9cefe, role_id=acbb2252c9f54cf8b789aa80f0a1fe85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:42.260886 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a538a8-7614-4c50-b626-6c9db636848a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:42.263948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:42.288327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 294/592] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:20:42 2022] PUT /identity/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/3caa3dbc7bd24ebba28296a1eba9cefe/roles/acbb2252c9f54cf8b789aa80f0a1fe85 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:20:42.289398 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a538a8-7614-4c50-b626-6c9db636848a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:42.351885 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fc16e-c135-412f-8d7f-29f8e39889cd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:42.405168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f335d12-179c-4631-ac00-ee1dc0f44b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:42.406556 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f335d12-179c-4631-ac00-ee1dc0f44b08 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:42.406834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f335d12-179c-4631-ac00-ee1dc0f44b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:42.407134 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f335d12-179c-4631-ac00-ee1dc0f44b08 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:42.408697 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f335d12-179c-4631-ac00-ee1dc0f44b08 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:42.409061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f335d12-179c-4631-ac00-ee1dc0f44b08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:42.411305 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f335d12-179c-4631-ac00-ee1dc0f44b08 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:42.433450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a538a8-7614-4c50-b626-6c9db636848a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:42.444541 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 299/593] 10.222.0.41 () {56 vars in 1137 bytes} [Fri May 27 16:20:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:42.445569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f335d12-179c-4631-ac00-ee1dc0f44b08 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:42.481899 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca61806-49af-44ce-b32b-26dfa1f40c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:42.482661 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca61806-49af-44ce-b32b-26dfa1f40c66 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:42.483041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca61806-49af-44ce-b32b-26dfa1f40c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:42.483410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca61806-49af-44ce-b32b-26dfa1f40c66 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:42.484348 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca61806-49af-44ce-b32b-26dfa1f40c66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:42.484751 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca61806-49af-44ce-b32b-26dfa1f40c66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:42.486350 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca61806-49af-44ce-b32b-26dfa1f40c66 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:42.502977 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 295/594] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:42.504574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca61806-49af-44ce-b32b-26dfa1f40c66 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:42.545224 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:42.580755 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:42.586847 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f335d12-179c-4631-ac00-ee1dc0f44b08 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:42.630815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e30bb-5dc9-43d7-b67c-d339adf9009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:42.632232 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e30bb-5dc9-43d7-b67c-d339adf9009a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:42.632778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e30bb-5dc9-43d7-b67c-d339adf9009a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:42.633245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e30bb-5dc9-43d7-b67c-d339adf9009a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:42.639811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca61806-49af-44ce-b32b-26dfa1f40c66 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:42.650480 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e30bb-5dc9-43d7-b67c-d339adf9009a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:42.652111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e30bb-5dc9-43d7-b67c-d339adf9009a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:42.672896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-a61e30bb-5dc9-43d7-b67c-d339adf9009a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:42.672896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:42.672896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:42.672896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:42.672896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:42.672896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:42.672896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:42.672896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:42.672896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:42.672896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:42.672896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:42.672896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:42.672896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:42.672896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:42.672896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:42.673860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:42.673860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:42.673860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:42.673860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:42.673860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:42.673860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:42.673860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:42.673860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:42.673860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:42.673860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:42.673860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:42.673860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:42.673860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:42.673860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:42.673860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:42.673860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:42.673860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:42.674816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:42.674816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:42.674816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:42.674816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:42.674816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 300/595] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:42.675106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e30bb-5dc9-43d7-b67c-d339adf9009a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:42.693772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e808b-b9f6-40de-9408-5357816cfdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:42.694938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e808b-b9f6-40de-9408-5357816cfdff None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:42.695664 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e808b-b9f6-40de-9408-5357816cfdff None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:42.696259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e808b-b9f6-40de-9408-5357816cfdff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:42.712592 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e808b-b9f6-40de-9408-5357816cfdff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:42.714151 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e808b-b9f6-40de-9408-5357816cfdff None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:42.732848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ec6e808b-b9f6-40de-9408-5357816cfdff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:42.732848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:42.732848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:42.732848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:42.732848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:42.732848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:42.732848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:42.732848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:42.732848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:42.732848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:42.732848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:42.732848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:42.732848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:42.732848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:42.732848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:42.733806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:42.733806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:42.733806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:42.733806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:42.733806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:42.733806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:42.733806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:42.733806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:42.733806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:42.733806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:42.733806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:42.733806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:42.733806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:42.733806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:42.733806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:42.733806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:42.733806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:42.734714 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:42.734714 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:42.734714 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:42.734714 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:42.734714 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 296/596] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:42.735445 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e808b-b9f6-40de-9408-5357816cfdff None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:42.813357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e30bb-5dc9-43d7-b67c-d339adf9009a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:42.843487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:42.857548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132279ef-a8ea-4c67-8931-c8c6c6138869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:42.858850 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132279ef-a8ea-4c67-8931-c8c6c6138869 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:42.859332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132279ef-a8ea-4c67-8931-c8c6c6138869 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:42.859786 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132279ef-a8ea-4c67-8931-c8c6c6138869 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:42.863757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e808b-b9f6-40de-9408-5357816cfdff None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:42.871714 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132279ef-a8ea-4c67-8931-c8c6c6138869 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:42.874284 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132279ef-a8ea-4c67-8931-c8c6c6138869 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:42.879846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:42.897944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-132279ef-a8ea-4c67-8931-c8c6c6138869 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:42.897944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:42.897944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:42.897944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:42.897944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:42.897944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:42.897944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:42.897944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:42.897944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:42.897944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:42.897944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:42.897944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:42.897944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:20:42.897944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:20:42.897944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:20:42.898942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:20:42.898942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:42.898942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:42.898942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:42.898942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:42.898942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:42.898942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:42.898942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:42.898942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:42.898942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:42.898942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:42.898942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:42.898942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:42.898942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:42.898942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:42.898942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:42.898942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:42.899941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:20:42.899941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:20:42.899941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:20:42.899941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:20:42.899941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:20:42.899941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:20:42.899941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:42.899941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:42.899941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 301/597] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:42.901523 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132279ef-a8ea-4c67-8931-c8c6c6138869 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:42.921074 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea50730-3fea-44db-8ee5-1a7dfa677cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:42.922566 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea50730-3fea-44db-8ee5-1a7dfa677cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:42.922566 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea50730-3fea-44db-8ee5-1a7dfa677cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:42.922566 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea50730-3fea-44db-8ee5-1a7dfa677cc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:42.923093 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea50730-3fea-44db-8ee5-1a7dfa677cc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:42.923301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea50730-3fea-44db-8ee5-1a7dfa677cc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:42.924782 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea50730-3fea-44db-8ee5-1a7dfa677cc3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:42.938834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 297/598] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:42.940524 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcd0ab-59ea-4d23-a6f0-b4802825be60 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:42.941074 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcd0ab-59ea-4d23-a6f0-b4802825be60 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:42.941523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcd0ab-59ea-4d23-a6f0-b4802825be60 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:42.942993 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 298/599] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:42.948108 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcd0ab-59ea-4d23-a6f0-b4802825be60 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:43.024346 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132279ef-a8ea-4c67-8931-c8c6c6138869 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:43.060600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcd0ab-59ea-4d23-a6f0-b4802825be60 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:43.063612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1573885-b16b-4adb-bfa0-576b434528db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:43.064346 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1573885-b16b-4adb-bfa0-576b434528db None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:43.064619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1573885-b16b-4adb-bfa0-576b434528db None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:43.064880 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1573885-b16b-4adb-bfa0-576b434528db None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:43.065603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1573885-b16b-4adb-bfa0-576b434528db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:43.066103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1573885-b16b-4adb-bfa0-576b434528db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:43.067411 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1573885-b16b-4adb-bfa0-576b434528db None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:43.085328 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 302/600] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:43.085328 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1573885-b16b-4adb-bfa0-576b434528db None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:43.102115 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a873511-c9e3-4d25-99ce-4dce24ffed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:43.103000 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a873511-c9e3-4d25-99ce-4dce24ffed11 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:43.103215 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a873511-c9e3-4d25-99ce-4dce24ffed11 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:43.103726 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a873511-c9e3-4d25-99ce-4dce24ffed11 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:43.104257 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a873511-c9e3-4d25-99ce-4dce24ffed11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:43.104562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a873511-c9e3-4d25-99ce-4dce24ffed11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:43.106017 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a873511-c9e3-4d25-99ce-4dce24ffed11 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:43.118999 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 299/601] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:20:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:43.120416 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcf294-6526-480c-a732-fd84a33d05a3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:43.120938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcf294-6526-480c-a732-fd84a33d05a3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:43.120938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcf294-6526-480c-a732-fd84a33d05a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:43.137692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-41fcf294-6526-480c-a732-fd84a33d05a3 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:43.138914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-41fcf294-6526-480c-a732-fd84a33d05a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:43.144697 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:43.163717 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:43.220078 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 300/602] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:43.220078 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcf294-6526-480c-a732-fd84a33d05a3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:43.230829 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1573885-b16b-4adb-bfa0-576b434528db None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:43.276355 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350476e-bf03-4f49-b5a3-0bd7697352fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:43.277069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350476e-bf03-4f49-b5a3-0bd7697352fd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:43.277343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350476e-bf03-4f49-b5a3-0bd7697352fd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:43.277679 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350476e-bf03-4f49-b5a3-0bd7697352fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:43.289572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350476e-bf03-4f49-b5a3-0bd7697352fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:43.291778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350476e-bf03-4f49-b5a3-0bd7697352fd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:43.307855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-9350476e-bf03-4f49-b5a3-0bd7697352fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:43.307855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:43.307855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:43.307855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:43.307855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:43.307855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:43.307855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:43.307855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:43.307855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:43.307855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:43.307855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:43.307855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:43.307855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:20:43.307855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:20:43.307855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:20:43.308873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:20:43.308873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:43.308873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:43.308873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:43.308873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:43.308873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:43.308873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:43.308873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:43.308873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:43.308873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:43.308873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:43.308873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:43.308873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:43.308873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:43.308873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:43.308873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:43.308873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:43.309796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:20:43.309796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:20:43.309796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:20:43.309796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:20:43.309796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:20:43.309796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:20:43.309796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:43.309796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:43.309796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 303/603] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:43.310286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350476e-bf03-4f49-b5a3-0bd7697352fd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:43.355255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fcf294-6526-480c-a732-fd84a33d05a3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:43.391428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef55159-d6ab-4a76-b2a4-17e2777e8f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:43.392262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef55159-d6ab-4a76-b2a4-17e2777e8f15 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:43.392549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef55159-d6ab-4a76-b2a4-17e2777e8f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:43.392817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef55159-d6ab-4a76-b2a4-17e2777e8f15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:43.400442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef55159-d6ab-4a76-b2a4-17e2777e8f15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:43.401927 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef55159-d6ab-4a76-b2a4-17e2777e8f15 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:43.415804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-5ef55159-d6ab-4a76-b2a4-17e2777e8f15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:43.415804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:43.415804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:43.415804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:43.415804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:43.415804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:43.415804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:43.415804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:43.415804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:43.415804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:43.415804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:43.415804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:43.415804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:20:43.415804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:20:43.415804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:20:43.416815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:20:43.416815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:43.416815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:43.416815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:43.416815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:43.416815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:43.416815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:43.416815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:43.416815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:43.416815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:43.416815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:43.416815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:43.416815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:43.416815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:43.416815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:43.416815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:43.416815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:43.417757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:20:43.417757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:20:43.417757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:20:43.417757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:20:43.417757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:20:43.417757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:20:43.417757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:43.417757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:43.417757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 301/604] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:43.418254 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef55159-d6ab-4a76-b2a4-17e2777e8f15 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:43.433513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350476e-bf03-4f49-b5a3-0bd7697352fd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:43.436912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:43.440284 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:43.476611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cf264-f8b5-46d1-bb57-8217217f880e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:43.477494 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cf264-f8b5-46d1-bb57-8217217f880e None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:43.477810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cf264-f8b5-46d1-bb57-8217217f880e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:43.478057 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79cf264-f8b5-46d1-bb57-8217217f880e None admin] PATH_INFO: `/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/4561bdacf98d47a6beffbcc400120bcd/roles/acbb2252c9f54cf8b789aa80f0a1fe85` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:43.495250 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cf264-f8b5-46d1-bb57-8217217f880e None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5c551b621342e5a5a6e742d673d525, user_id=4561bdacf98d47a6beffbcc400120bcd, role_id=acbb2252c9f54cf8b789aa80f0a1fe85)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:43.496759 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79cf264-f8b5-46d1-bb57-8217217f880e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:43.514276 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 304/605] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:20:43 2022] PUT /identity/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/4561bdacf98d47a6beffbcc400120bcd/roles/acbb2252c9f54cf8b789aa80f0a1fe85 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:20:43.515221 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cf264-f8b5-46d1-bb57-8217217f880e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:43.564383 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef55159-d6ab-4a76-b2a4-17e2777e8f15 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:43.616464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d381035-1942-46c5-b52e-5e81afd3fbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:43.617362 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d381035-1942-46c5-b52e-5e81afd3fbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:43.617708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d381035-1942-46c5-b52e-5e81afd3fbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:43.617982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d381035-1942-46c5-b52e-5e81afd3fbe5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:43.635766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d381035-1942-46c5-b52e-5e81afd3fbe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:43.644669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79cf264-f8b5-46d1-bb57-8217217f880e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:43.646279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-9d381035-1942-46c5-b52e-5e81afd3fbe5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:43.646279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:43.646279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:43.646279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:43.646279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:43.646279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:43.646279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:43.646279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:43.646279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:43.646279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:43.646279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:43.646279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:43.646279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:43.646279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:43.646279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:43.646279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:43.647256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:43.647256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:43.647256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:43.647256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:43.647256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:43.647256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:43.647256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:43.647256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:43.647256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:43.647256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:43.647256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:43.647256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:43.647256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:43.647256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:43.647256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:43.647256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:43.648554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:43.648554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:43.648554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:43.648554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:43.648554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:43.648554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:43.648554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:43.648554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:43.648554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:43.648554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:43.648554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:43.648554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:43.648554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 302/606] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:20:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:43.648554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d381035-1942-46c5-b52e-5e81afd3fbe5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:43.689326 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e11ed-d1a9-465c-a921-183354001e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:43.690409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e11ed-d1a9-465c-a921-183354001e50 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:43.691028 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e11ed-d1a9-465c-a921-183354001e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:43.691556 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e11ed-d1a9-465c-a921-183354001e50 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:43.692637 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e11ed-d1a9-465c-a921-183354001e50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:43.693171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e11ed-d1a9-465c-a921-183354001e50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:43.694906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e11ed-d1a9-465c-a921-183354001e50 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:43.714684 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 305/607] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:20:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:43.716185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e11ed-d1a9-465c-a921-183354001e50 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:43.739277 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:43.766238 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:43.799702 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d381035-1942-46c5-b52e-5e81afd3fbe5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:43.842709 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ea573-0efe-43b9-b279-45a0d20a8af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:43.843386 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ea573-0efe-43b9-b279-45a0d20a8af8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:43.843670 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ea573-0efe-43b9-b279-45a0d20a8af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:43.843953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ea573-0efe-43b9-b279-45a0d20a8af8 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:43.845227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ea573-0efe-43b9-b279-45a0d20a8af8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:43.845538 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ea573-0efe-43b9-b279-45a0d20a8af8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:43.847058 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ea573-0efe-43b9-b279-45a0d20a8af8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:43.863003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e11ed-d1a9-465c-a921-183354001e50 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:43.864752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 303/608] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:20:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:43.865883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ea573-0efe-43b9-b279-45a0d20a8af8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:43.908642 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613e43e-2491-42b5-af2f-a7994fe774e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:43.909787 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613e43e-2491-42b5-af2f-a7994fe774e4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:43.910353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613e43e-2491-42b5-af2f-a7994fe774e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:43.911047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613e43e-2491-42b5-af2f-a7994fe774e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:43.915574 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613e43e-2491-42b5-af2f-a7994fe774e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:43.915894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613e43e-2491-42b5-af2f-a7994fe774e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:43.917377 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613e43e-2491-42b5-af2f-a7994fe774e4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:43.933487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 306/609] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:20:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:43.934692 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613e43e-2491-42b5-af2f-a7994fe774e4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:44.010527 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ea573-0efe-43b9-b279-45a0d20a8af8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:44.048565 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:44.051104 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa525d02-70ef-48f9-b47d-2d5e2b344ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:44.052334 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa525d02-70ef-48f9-b47d-2d5e2b344ed5 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:44.052841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa525d02-70ef-48f9-b47d-2d5e2b344ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:44.053316 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa525d02-70ef-48f9-b47d-2d5e2b344ed5 None admin] PATH_INFO: `/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/6f3fe9e871b34a8faed94550e27fefd3/roles/acbb2252c9f54cf8b789aa80f0a1fe85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:44.062423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:44.071625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa525d02-70ef-48f9-b47d-2d5e2b344ed5 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5c551b621342e5a5a6e742d673d525, user_id=6f3fe9e871b34a8faed94550e27fefd3, role_id=acbb2252c9f54cf8b789aa80f0a1fe85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:44.074284 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa525d02-70ef-48f9-b47d-2d5e2b344ed5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:44.075707 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613e43e-2491-42b5-af2f-a7994fe774e4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:44.095988 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 304/610] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:20:43 2022] PUT /identity/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/6f3fe9e871b34a8faed94550e27fefd3/roles/acbb2252c9f54cf8b789aa80f0a1fe85 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:20:44.097728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa525d02-70ef-48f9-b47d-2d5e2b344ed5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:44.135140 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e12895-6f6f-4bd4-a1ac-dce7c5d848f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:44.136994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e12895-6f6f-4bd4-a1ac-dce7c5d848f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:44.137623 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e12895-6f6f-4bd4-a1ac-dce7c5d848f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:44.138253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e12895-6f6f-4bd4-a1ac-dce7c5d848f0 None admin] PATH_INFO: `/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/b72987d279bf4767bad23918fc33302b/roles/acbb2252c9f54cf8b789aa80f0a1fe85` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:44.177069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e12895-6f6f-4bd4-a1ac-dce7c5d848f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5c551b621342e5a5a6e742d673d525, user_id=b72987d279bf4767bad23918fc33302b, role_id=acbb2252c9f54cf8b789aa80f0a1fe85)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:44.178765 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e12895-6f6f-4bd4-a1ac-dce7c5d848f0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:44.214774 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 307/611] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:20:43 2022] PUT /identity/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/b72987d279bf4767bad23918fc33302b/roles/acbb2252c9f54cf8b789aa80f0a1fe85 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:20:44.235823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa525d02-70ef-48f9-b47d-2d5e2b344ed5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:44.280439 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b05a8-0353-4248-92f0-23b2f5c8d7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:44.281746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b05a8-0353-4248-92f0-23b2f5c8d7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:44.282282 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b05a8-0353-4248-92f0-23b2f5c8d7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:44.282809 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b05a8-0353-4248-92f0-23b2f5c8d7b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:44.301148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b05a8-0353-4248-92f0-23b2f5c8d7b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:44.302705 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b05a8-0353-4248-92f0-23b2f5c8d7b8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:44.323776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-723b05a8-0353-4248-92f0-23b2f5c8d7b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:44.323776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:44.323776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:44.323776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:44.323776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:44.323776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:44.323776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:44.323776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:44.323776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:44.323776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:44.323776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:44.323776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:44.323776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:44.323776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:44.323776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:44.324848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:44.324848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:44.324848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:44.324848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:44.324848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:44.324848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:44.324848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:44.324848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:44.324848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:44.324848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:44.324848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:44.324848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:44.324848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:44.324848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:44.324848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:44.324848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:44.324848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:44.325785 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:44.325785 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:44.325785 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:44.325785 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:44.325785 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 305/612] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:44.332993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e12895-6f6f-4bd4-a1ac-dce7c5d848f0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:44.471198 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e12895-6f6f-4bd4-a1ac-dce7c5d848f0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:44.507910 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:44.521239 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b918a-77db-4876-baa4-c78924e62378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:44.521939 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b918a-77db-4876-baa4-c78924e62378 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:44.522225 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b918a-77db-4876-baa4-c78924e62378 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:44.522508 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b918a-77db-4876-baa4-c78924e62378 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:44.523254 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b918a-77db-4876-baa4-c78924e62378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:44.523565 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b918a-77db-4876-baa4-c78924e62378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:44.525056 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b918a-77db-4876-baa4-c78924e62378 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:44.540722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 308/613] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:44.546971 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b05a8-0353-4248-92f0-23b2f5c8d7b8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:44.626857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:44.709594 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b05a8-0353-4248-92f0-23b2f5c8d7b8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:44.734997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a430853-24d1-4159-b951-26d9a8b1f5e3 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:44.735344 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a430853-24d1-4159-b951-26d9a8b1f5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:44.735733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a430853-24d1-4159-b951-26d9a8b1f5e3 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:44.738963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 309/614] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:44.743540 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1cfc9-23d8-46c3-a40a-af27c5ec71df None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:44.743938 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1cfc9-23d8-46c3-a40a-af27c5ec71df None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:44.744330 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1cfc9-23d8-46c3-a40a-af27c5ec71df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:44.762110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a4c1cfc9-23d8-46c3-a40a-af27c5ec71df None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:44.763517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a4c1cfc9-23d8-46c3-a40a-af27c5ec71df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:44.768463 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f9401-0add-49f5-af52-280e708db5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:44.769324 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f9401-0add-49f5-af52-280e708db5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:44.769605 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f9401-0add-49f5-af52-280e708db5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:44.769892 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f9401-0add-49f5-af52-280e708db5d4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:44.785605 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f9401-0add-49f5-af52-280e708db5d4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:44.787106 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f9401-0add-49f5-af52-280e708db5d4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:44.817118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-393f9401-0add-49f5-af52-280e708db5d4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 16:20:44.817118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:44.817118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:44.817118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:44.817118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:44.817118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:44.817118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:44.817118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:44.817118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:44.817118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:44.817118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:44.817118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:44.817118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:20:44.817118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:20:44.817118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:20:44.817118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:20:44.818147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:44.818147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:44.818147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:20:44.818147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:44.818147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:20:44.818147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:44.818147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:44.818147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:44.818147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:44.818147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:44.818147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:44.818147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:44.818147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:44.818147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:44.818147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:44.818147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:44.818147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:44.818147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:44.819125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:44.819125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:44.819125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:20:44.819125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:20:44.819125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:20:44.819125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:20:44.819125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:20:44.819125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:20:44.819125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 16:20:44.819125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:44.819125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 306/615] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:20:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:44.828118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f9401-0add-49f5-af52-280e708db5d4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:44.898871 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 310/616] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:44.965631 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1cfc9-23d8-46c3-a40a-af27c5ec71df None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:44.981005 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f9401-0add-49f5-af52-280e708db5d4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:44.984367 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:45.058324 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b888d1-93c1-4e83-8f1d-df9b939083c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:45.058928 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b888d1-93c1-4e83-8f1d-df9b939083c7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:45.059210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b888d1-93c1-4e83-8f1d-df9b939083c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:45.059487 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b888d1-93c1-4e83-8f1d-df9b939083c7 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:45.060439 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b888d1-93c1-4e83-8f1d-df9b939083c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:45.060825 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b888d1-93c1-4e83-8f1d-df9b939083c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:45.062320 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b888d1-93c1-4e83-8f1d-df9b939083c7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:45.104075 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 307/617] 10.222.0.41 () {56 vars in 1135 bytes} [Fri May 27 16:20:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:45.114482 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b888d1-93c1-4e83-8f1d-df9b939083c7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:45.162892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1cfc9-23d8-46c3-a40a-af27c5ec71df None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:45.185133 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:45.211734 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dde2c4-5b73-4769-8efc-578570b17f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:45.215228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dde2c4-5b73-4769-8efc-578570b17f74 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:45.216892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dde2c4-5b73-4769-8efc-578570b17f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:45.218434 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dde2c4-5b73-4769-8efc-578570b17f74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:45.251408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dde2c4-5b73-4769-8efc-578570b17f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:45.265186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-c4dde2c4-5b73-4769-8efc-578570b17f74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:45.265186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:45.265186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:45.265186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:45.265186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:45.265186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:45.265186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:45.265186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:45.265186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:45.265186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:45.265186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:45.265186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:45.265186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:45.265186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:45.265186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:45.265186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:45.266212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:45.266212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:45.266212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:45.266212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:45.266212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:45.266212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:45.266212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:45.266212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:45.266212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:45.266212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:45.266212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:45.266212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:45.266212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:45.266212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:45.266212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:45.266212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:45.267106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:45.267106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:45.267106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:45.267106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:45.267106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:45.267106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:45.267106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:45.267106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:45.267106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:45.267106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:45.267106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:45.267106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:45.279875 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 311/618] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:20:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:45.282825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dde2c4-5b73-4769-8efc-578570b17f74 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:45.340356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b888d1-93c1-4e83-8f1d-df9b939083c7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:45.379614 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924214e-49dd-499e-ae1d-592f2530065f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:45.380860 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924214e-49dd-499e-ae1d-592f2530065f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:45.381364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924214e-49dd-499e-ae1d-592f2530065f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:45.381834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924214e-49dd-499e-ae1d-592f2530065f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:45.406549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924214e-49dd-499e-ae1d-592f2530065f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:45.412097 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924214e-49dd-499e-ae1d-592f2530065f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:45.451295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c924214e-49dd-499e-ae1d-592f2530065f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:45.451295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:45.451295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:45.451295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:45.451295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:45.451295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:45.451295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:45.451295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:45.451295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:45.451295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:45.451295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:45.451295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:45.451295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:45.451295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:45.451295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:45.452356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:45.452356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:45.452356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:45.452356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:45.452356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:45.452356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:45.452356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:45.452356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:45.452356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:45.452356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:45.452356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:45.452356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:45.452356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:45.452356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:45.452356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:45.452356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:45.452356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:45.453290 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:45.453290 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:45.453290 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:45.453290 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:45.463442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 308/619] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:45.485735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924214e-49dd-499e-ae1d-592f2530065f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:45.504442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:45.550023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dde2c4-5b73-4769-8efc-578570b17f74 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:45.601057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924214e-49dd-499e-ae1d-592f2530065f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:45.617351 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda895a5-32cd-4937-887c-7ff0185b27c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:45.618034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda895a5-32cd-4937-887c-7ff0185b27c6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:45.618316 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda895a5-32cd-4937-887c-7ff0185b27c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:45.618664 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda895a5-32cd-4937-887c-7ff0185b27c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:45.619341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda895a5-32cd-4937-887c-7ff0185b27c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:45.619642 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda895a5-32cd-4937-887c-7ff0185b27c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:45.621056 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda895a5-32cd-4937-887c-7ff0185b27c6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:45.638697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b57f0-e9e8-4226-8e72-ec9cecce5fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:45.639028 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 312/620] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:20:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:45.639958 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b57f0-e9e8-4226-8e72-ec9cecce5fff None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:45.640473 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b57f0-e9e8-4226-8e72-ec9cecce5fff None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:45.640981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b57f0-e9e8-4226-8e72-ec9cecce5fff None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:45.641909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b57f0-e9e8-4226-8e72-ec9cecce5fff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:45.642410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b57f0-e9e8-4226-8e72-ec9cecce5fff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:45.644164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b57f0-e9e8-4226-8e72-ec9cecce5fff None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:45.644622 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda895a5-32cd-4937-887c-7ff0185b27c6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:45.658073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 309/621] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:45.663913 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b57f0-e9e8-4226-8e72-ec9cecce5fff None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:45.719980 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:45.739497 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:45.773001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b57f0-e9e8-4226-8e72-ec9cecce5fff None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:45.808979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09880caa-22b9-4ece-9ea7-c21cd7f0b645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:45.810314 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09880caa-22b9-4ece-9ea7-c21cd7f0b645 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:45.810805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09880caa-22b9-4ece-9ea7-c21cd7f0b645 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:45.811273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09880caa-22b9-4ece-9ea7-c21cd7f0b645 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:45.819385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09880caa-22b9-4ece-9ea7-c21cd7f0b645 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:45.821298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09880caa-22b9-4ece-9ea7-c21cd7f0b645 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:45.839040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-09880caa-22b9-4ece-9ea7-c21cd7f0b645 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:45.839040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:45.839040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:45.839040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:45.839040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:45.839040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:45.839040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:45.839040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:45.839040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:45.839040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:45.839040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:45.839040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:45.839040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:20:45.839040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:20:45.839040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:20:45.840063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:20:45.840063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:45.840063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:45.840063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:45.840063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:45.840063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:45.840063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:45.840063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:45.840063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:45.840063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:45.840063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:45.840063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:45.840063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:45.840063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:45.840063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:45.840063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:45.840063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:45.840992 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:20:45.840992 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:20:45.840992 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:20:45.840992 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:20:45.840992 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:20:45.840992 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:20:45.840992 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:45.840992 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:45.843690 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 310/622] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:45.857736 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09880caa-22b9-4ece-9ea7-c21cd7f0b645 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:45.872489 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda895a5-32cd-4937-887c-7ff0185b27c6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:45.957321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ce69e-38e1-46cf-ad9a-eef164fd07c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:45.958614 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ce69e-38e1-46cf-ad9a-eef164fd07c8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:45.959114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ce69e-38e1-46cf-ad9a-eef164fd07c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:45.959613 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ce69e-38e1-46cf-ad9a-eef164fd07c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:45.980749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ce69e-38e1-46cf-ad9a-eef164fd07c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:45.982935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ce69e-38e1-46cf-ad9a-eef164fd07c8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:46.015598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-2a8ce69e-38e1-46cf-ad9a-eef164fd07c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:46.015598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:46.015598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:46.015598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:46.015598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:46.015598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:46.015598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:46.015598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:46.015598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:46.015598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:46.015598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:46.015598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:46.015598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:46.015598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:46.015598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:46.016632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:46.016632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:46.016632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:46.016632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:46.016632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:46.016632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:46.016632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:46.016632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:46.016632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:46.016632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:46.016632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:46.016632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:46.016632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:46.016632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:46.016632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:46.016632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:46.016632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:46.017572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:46.017572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:46.017572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:46.017572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:46.021079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 313/623] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:46.025969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ce69e-38e1-46cf-ad9a-eef164fd07c8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:46.077529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09880caa-22b9-4ece-9ea7-c21cd7f0b645 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:46.138455 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:46.146563 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818618c-6ffd-4eaa-9c7f-dad4396a657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:46.147583 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818618c-6ffd-4eaa-9c7f-dad4396a657e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:46.148123 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818618c-6ffd-4eaa-9c7f-dad4396a657e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:46.148654 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818618c-6ffd-4eaa-9c7f-dad4396a657e None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:46.149658 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818618c-6ffd-4eaa-9c7f-dad4396a657e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:46.150206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818618c-6ffd-4eaa-9c7f-dad4396a657e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:46.152071 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818618c-6ffd-4eaa-9c7f-dad4396a657e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:46.170578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 311/624] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:20:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:46.172464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bcb91-5422-422b-8e07-cd596bdfedac None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:46.172970 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bcb91-5422-422b-8e07-cd596bdfedac None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:46.173574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bcb91-5422-422b-8e07-cd596bdfedac None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:46.175812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 312/625] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:46.177140 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:46.177871 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bcb91-5422-422b-8e07-cd596bdfedac None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:46.195364 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ce69e-38e1-46cf-ad9a-eef164fd07c8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:46.239632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3d90f-8b2b-4e20-a0ba-85761be29665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:46.240371 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3d90f-8b2b-4e20-a0ba-85761be29665 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:46.240660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3d90f-8b2b-4e20-a0ba-85761be29665 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:46.240936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3d90f-8b2b-4e20-a0ba-85761be29665 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:46.241692 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3d90f-8b2b-4e20-a0ba-85761be29665 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:46.241997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3d90f-8b2b-4e20-a0ba-85761be29665 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:46.243815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3d90f-8b2b-4e20-a0ba-85761be29665 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:46.262995 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 314/626] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:46.264884 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fe4cd-8bcd-429f-8164-e92a19cdae2c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:46.265394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fe4cd-8bcd-429f-8164-e92a19cdae2c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:46.265896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fe4cd-8bcd-429f-8164-e92a19cdae2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:46.284818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7f6fe4cd-8bcd-429f-8164-e92a19cdae2c None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:46.286780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7f6fe4cd-8bcd-429f-8164-e92a19cdae2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:46.319664 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bcb91-5422-422b-8e07-cd596bdfedac None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:46.364977 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bb69a-8a83-4864-bcf3-d64401c2e6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:46.365900 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bb69a-8a83-4864-bcf3-d64401c2e6a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:46.366186 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bb69a-8a83-4864-bcf3-d64401c2e6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:46.366482 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bb69a-8a83-4864-bcf3-d64401c2e6a6 None admin] PATH_INFO: `/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/dbfcca96ad754692b3fb7f891013dafb/roles/acbb2252c9f54cf8b789aa80f0a1fe85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:46.369791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 315/627] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:46.371031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fe4cd-8bcd-429f-8164-e92a19cdae2c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:46.401384 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148bb69a-8a83-4864-bcf3-d64401c2e6a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5c551b621342e5a5a6e742d673d525, user_id=dbfcca96ad754692b3fb7f891013dafb, role_id=acbb2252c9f54cf8b789aa80f0a1fe85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:46.403296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148bb69a-8a83-4864-bcf3-d64401c2e6a6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:46.436043 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 313/628] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:20:46 2022] PUT /identity/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/dbfcca96ad754692b3fb7f891013dafb/roles/acbb2252c9f54cf8b789aa80f0a1fe85 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:20:46.436043 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bb69a-8a83-4864-bcf3-d64401c2e6a6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:46.495200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:46.570436 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:46.577159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bb69a-8a83-4864-bcf3-d64401c2e6a6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:46.626474 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fe4cd-8bcd-429f-8164-e92a19cdae2c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:46.632981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f029a9-4bb0-4ecc-b0d4-9faf2babe775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:46.634467 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f029a9-4bb0-4ecc-b0d4-9faf2babe775 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:46.634958 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f029a9-4bb0-4ecc-b0d4-9faf2babe775 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:46.635385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f029a9-4bb0-4ecc-b0d4-9faf2babe775 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:46.657612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f029a9-4bb0-4ecc-b0d4-9faf2babe775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:46.666697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-42f029a9-4bb0-4ecc-b0d4-9faf2babe775 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:46.666697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:46.666697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:46.666697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:46.666697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:46.666697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:46.666697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:46.666697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:46.666697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:46.666697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:46.666697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:46.666697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:46.666697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:46.666697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:46.666697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:46.666697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:46.667827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:46.667827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:46.667827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:46.667827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:46.667827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:46.667827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:46.667827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:46.667827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:46.667827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:46.667827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:46.667827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:46.667827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:46.667827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:46.667827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:46.667827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:46.667827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:46.668916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:46.668916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:46.668916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:46.668916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:46.668916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:46.668916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:46.668916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:46.668916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:46.668916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:46.668916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:46.668916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:46.668916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:46.668916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 314/629] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:20:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:46.682510 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f029a9-4bb0-4ecc-b0d4-9faf2babe775 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:46.725659 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fa208-12b3-4711-8eaa-a6945957de4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:46.726559 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fa208-12b3-4711-8eaa-a6945957de4c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:46.726845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fa208-12b3-4711-8eaa-a6945957de4c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:46.727125 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fa208-12b3-4711-8eaa-a6945957de4c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:46.742089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fa208-12b3-4711-8eaa-a6945957de4c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:46.744614 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fa208-12b3-4711-8eaa-a6945957de4c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:46.764630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-d79fa208-12b3-4711-8eaa-a6945957de4c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 16:20:46.764630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:46.764630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:46.764630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:46.764630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:46.764630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:46.764630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:46.764630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:46.764630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:46.764630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:46.764630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:46.764630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:46.764630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:20:46.764630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:20:46.764630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:20:46.764630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:20:46.766175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:46.766175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:46.766175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:20:46.766175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:46.766175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:20:46.766175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:46.766175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:46.766175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:46.766175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:46.766175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:46.766175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:46.766175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:46.766175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:46.766175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:46.766175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:46.766175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:46.766175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:46.766175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:46.769114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:46.769114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:46.769114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:20:46.769114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:20:46.769114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:20:46.769114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:20:46.769114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:20:46.769114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:20:46.769114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 16:20:46.769114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:46.769114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 316/630] 10.222.0.41 () {56 vars in 1093 bytes} [Fri May 27 16:20:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:46.773081 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fa208-12b3-4711-8eaa-a6945957de4c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:46.856129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:46.860763 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f029a9-4bb0-4ecc-b0d4-9faf2babe775 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:46.901219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45519a31-89ff-49e7-b53e-e2a200666e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:46.901907 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45519a31-89ff-49e7-b53e-e2a200666e8a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:46.902190 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45519a31-89ff-49e7-b53e-e2a200666e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:46.902469 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45519a31-89ff-49e7-b53e-e2a200666e8a None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:46.903241 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45519a31-89ff-49e7-b53e-e2a200666e8a None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:46.903551 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45519a31-89ff-49e7-b53e-e2a200666e8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:46.905107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45519a31-89ff-49e7-b53e-e2a200666e8a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:46.915426 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 315/631] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:20:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:46.916975 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e32ba7-8033-4791-9fd6-b264b530107f None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:46.917270 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e32ba7-8033-4791-9fd6-b264b530107f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:46.917548 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e32ba7-8033-4791-9fd6-b264b530107f None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:46.919253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 316/632] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:46.922088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e32ba7-8033-4791-9fd6-b264b530107f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:46.939936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fa208-12b3-4711-8eaa-a6945957de4c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:46.982668 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec223710-6dc6-4137-9189-b61ff89f462a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:46.983535 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec223710-6dc6-4137-9189-b61ff89f462a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:46.983818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec223710-6dc6-4137-9189-b61ff89f462a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:46.984126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec223710-6dc6-4137-9189-b61ff89f462a None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:46.984975 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec223710-6dc6-4137-9189-b61ff89f462a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:46.985284 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec223710-6dc6-4137-9189-b61ff89f462a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:46.987186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec223710-6dc6-4137-9189-b61ff89f462a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:46.999629 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:47.012231 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 317/633] 10.222.0.41 () {56 vars in 1133 bytes} [Fri May 27 16:20:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:47.016048 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1e109-2b65-4a2e-b9a9-869303687aad None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:47.017299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1e109-2b65-4a2e-b9a9-869303687aad None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:47.017993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1e109-2b65-4a2e-b9a9-869303687aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:47.036515 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e32ba7-8033-4791-9fd6-b264b530107f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:47.046987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2ae1e109-2b65-4a2e-b9a9-869303687aad None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:47.049144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2ae1e109-2b65-4a2e-b9a9-869303687aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:47.076587 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7f448-9f25-461d-9794-3bdb9ebf19e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:47.077397 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7f448-9f25-461d-9794-3bdb9ebf19e0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:47.077674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7f448-9f25-461d-9794-3bdb9ebf19e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:47.077943 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7f448-9f25-461d-9794-3bdb9ebf19e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:47.089809 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7f448-9f25-461d-9794-3bdb9ebf19e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:47.091311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7f448-9f25-461d-9794-3bdb9ebf19e0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:47.110798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d3f7f448-9f25-461d-9794-3bdb9ebf19e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:47.110798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:47.110798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:47.110798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:47.110798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:47.110798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:47.110798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:47.110798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:47.110798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:47.110798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:47.110798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:47.110798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:47.110798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:47.110798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:47.110798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:47.112260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:47.112260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:47.112260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:47.112260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:47.112260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:47.112260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:47.112260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:47.112260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:47.112260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:47.112260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:47.112260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:47.112260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:47.112260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:47.112260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:47.112260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:47.112260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:47.112260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:47.113614 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:47.113614 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:47.113614 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:47.113614 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:47.116667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 317/634] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:47.120453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b510d-2d0e-41f7-b514-fee80d10b1f4 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:47.121246 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b510d-2d0e-41f7-b514-fee80d10b1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:47.121805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b510d-2d0e-41f7-b514-fee80d10b1f4 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:47.124669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 318/635] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:47.126237 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b510d-2d0e-41f7-b514-fee80d10b1f4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:47.133835 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 318/636] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:47.134826 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1e109-2b65-4a2e-b9a9-869303687aad None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:47.150150 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:47.265066 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b510d-2d0e-41f7-b514-fee80d10b1f4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:47.272354 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1e109-2b65-4a2e-b9a9-869303687aad None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:47.314699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:47.318894 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3db5d1-d7c0-4bf9-96b6-2ec08d72512b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:47.319579 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3db5d1-d7c0-4bf9-96b6-2ec08d72512b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:47.319846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3db5d1-d7c0-4bf9-96b6-2ec08d72512b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:47.320151 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3db5d1-d7c0-4bf9-96b6-2ec08d72512b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:47.324885 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950b792-78bd-4885-9d2c-050b9edef813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:47.325568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950b792-78bd-4885-9d2c-050b9edef813 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:47.325855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950b792-78bd-4885-9d2c-050b9edef813 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:47.326126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950b792-78bd-4885-9d2c-050b9edef813 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:47.326855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950b792-78bd-4885-9d2c-050b9edef813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:47.327159 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950b792-78bd-4885-9d2c-050b9edef813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:47.328587 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950b792-78bd-4885-9d2c-050b9edef813 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:47.347406 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 319/637] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:47.347406 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa87b42-8f8b-4b8e-88d4-c48a354cbbeb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:47.347406 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa87b42-8f8b-4b8e-88d4-c48a354cbbeb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:47.347406 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa87b42-8f8b-4b8e-88d4-c48a354cbbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:47.366063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ffa87b42-8f8b-4b8e-88d4-c48a354cbbeb None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:47.366591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ffa87b42-8f8b-4b8e-88d4-c48a354cbbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:47.403513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3db5d1-d7c0-4bf9-96b6-2ec08d72512b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:47.405049 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3db5d1-d7c0-4bf9-96b6-2ec08d72512b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:47.422438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:47.451776 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 320/638] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:47.452460 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa87b42-8f8b-4b8e-88d4-c48a354cbbeb None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:47.535754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 319/639] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:47.536567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3db5d1-d7c0-4bf9-96b6-2ec08d72512b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:47.577383 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa87b42-8f8b-4b8e-88d4-c48a354cbbeb None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:47.598106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:47.619475 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae9d8d-e325-4ea7-902a-f0ee9d7d354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:47.620231 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae9d8d-e325-4ea7-902a-f0ee9d7d354f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:47.620514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae9d8d-e325-4ea7-902a-f0ee9d7d354f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:47.620786 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae9d8d-e325-4ea7-902a-f0ee9d7d354f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:47.631547 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae9d8d-e325-4ea7-902a-f0ee9d7d354f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:47.639220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-a1ae9d8d-e325-4ea7-902a-f0ee9d7d354f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:47.639220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:47.639220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:47.639220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:47.639220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:47.639220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:47.639220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:47.639220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:47.639220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:47.639220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:47.639220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:47.639220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:47.639220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:47.639220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:47.639220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:47.639220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:47.640528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:47.640528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:47.640528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:47.640528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:47.640528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:47.640528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:47.640528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:47.640528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:47.640528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:47.640528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:47.640528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:47.640528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:47.640528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:47.640528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:47.640528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:47.640528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:47.641487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:47.641487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:47.641487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:47.641487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:47.641487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:47.641487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:47.641487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:47.641487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:47.641487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:47.641487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:47.641487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:47.641487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:47.641487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 321/640] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:20:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:47.641487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae9d8d-e325-4ea7-902a-f0ee9d7d354f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:47.678228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3db5d1-d7c0-4bf9-96b6-2ec08d72512b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:47.695308 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:47.719461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb8611-b714-4428-9be7-50de636bc2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:47.720293 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb8611-b714-4428-9be7-50de636bc2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:47.720601 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb8611-b714-4428-9be7-50de636bc2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:47.720864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb8611-b714-4428-9be7-50de636bc2b6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:47.728857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb8611-b714-4428-9be7-50de636bc2b6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:47.730340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb8611-b714-4428-9be7-50de636bc2b6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:47.746765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-cacb8611-b714-4428-9be7-50de636bc2b6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 16:20:47.746765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:47.746765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:47.746765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:47.746765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:47.746765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:47.746765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:47.746765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:47.746765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:47.746765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:47.746765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:47.746765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:47.746765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:20:47.746765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:20:47.746765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:20:47.746765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:20:47.747881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:47.747881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:47.747881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:20:47.747881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:47.747881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:20:47.747881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:47.747881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:47.747881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:47.747881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:47.747881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:47.747881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:47.747881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:47.747881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:47.747881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:47.747881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:47.747881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:47.747881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:47.747881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:47.749027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:47.749027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:47.749027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:20:47.749027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:20:47.749027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:20:47.749027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:20:47.749027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:20:47.749027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:20:47.749027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 16:20:47.749027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:47.749027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 320/641] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:47.749027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb8611-b714-4428-9be7-50de636bc2b6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:47.765665 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae9d8d-e325-4ea7-902a-f0ee9d7d354f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:47.806993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545d863-3e9a-4729-8446-61c5d2cc11a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:47.808236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545d863-3e9a-4729-8446-61c5d2cc11a6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:47.808525 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545d863-3e9a-4729-8446-61c5d2cc11a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:47.809122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545d863-3e9a-4729-8446-61c5d2cc11a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:47.821796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545d863-3e9a-4729-8446-61c5d2cc11a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:47.830079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-9545d863-3e9a-4729-8446-61c5d2cc11a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:47.830079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:47.830079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:47.830079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:47.830079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:47.830079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:47.830079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:47.830079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:47.830079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:47.830079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:47.830079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:47.830079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:47.830079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:47.830079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:47.830079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:47.830079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:47.831581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:47.831581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:47.831581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:47.831581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:47.831581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:47.831581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:47.831581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:47.831581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:47.831581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:47.831581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:47.831581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:47.831581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:47.831581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:47.831581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:47.831581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:47.831581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:47.832500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:47.832500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:47.832500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:47.832500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:47.832500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:47.832500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:47.832500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:47.832500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:47.832500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:47.832500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:47.832500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:47.832500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:47.832500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 322/642] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:20:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:47.833198 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545d863-3e9a-4729-8446-61c5d2cc11a6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:47.886767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:47.890520 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb8611-b714-4428-9be7-50de636bc2b6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:47.928667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80a6ad-1011-4cd3-8f2b-9ec074630243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:47.929767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80a6ad-1011-4cd3-8f2b-9ec074630243 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:47.930357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80a6ad-1011-4cd3-8f2b-9ec074630243 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:47.930833 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80a6ad-1011-4cd3-8f2b-9ec074630243 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:47.943083 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80a6ad-1011-4cd3-8f2b-9ec074630243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:47.944618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80a6ad-1011-4cd3-8f2b-9ec074630243 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:47.958802 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545d863-3e9a-4729-8446-61c5d2cc11a6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:47.963831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-fd80a6ad-1011-4cd3-8f2b-9ec074630243 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:47.963831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:47.963831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:47.963831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:47.963831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:47.963831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:47.963831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:47.963831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:47.963831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:47.963831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:47.963831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:47.963831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:47.963831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:47.963831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:47.963831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:47.964931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:47.964931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:47.964931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:47.964931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:47.964931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:47.964931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:47.964931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:47.964931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:47.964931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:47.964931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:47.964931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:47.964931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:47.964931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:47.964931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:47.964931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:47.964931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:47.964931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:47.970759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:47.970759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:47.970759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:47.970759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:47.970759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 321/643] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:47.970759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80a6ad-1011-4cd3-8f2b-9ec074630243 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:48.009632 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:48.014158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece62ae7-dfe1-4b23-8c08-8116dd7bcdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:48.015152 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece62ae7-dfe1-4b23-8c08-8116dd7bcdd6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:48.015659 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece62ae7-dfe1-4b23-8c08-8116dd7bcdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:48.016151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece62ae7-dfe1-4b23-8c08-8116dd7bcdd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:48.017307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece62ae7-dfe1-4b23-8c08-8116dd7bcdd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:48.017810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece62ae7-dfe1-4b23-8c08-8116dd7bcdd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:48.020287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece62ae7-dfe1-4b23-8c08-8116dd7bcdd6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:48.036977 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 323/644] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:20:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:48.037883 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece62ae7-dfe1-4b23-8c08-8116dd7bcdd6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:48.129887 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80a6ad-1011-4cd3-8f2b-9ec074630243 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:48.170331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70b069-ab32-4408-9e48-6c1e87bac269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:48.171022 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70b069-ab32-4408-9e48-6c1e87bac269 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:48.171302 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70b069-ab32-4408-9e48-6c1e87bac269 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:48.171574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70b069-ab32-4408-9e48-6c1e87bac269 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:48.172556 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70b069-ab32-4408-9e48-6c1e87bac269 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:48.172760 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70b069-ab32-4408-9e48-6c1e87bac269 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:48.174086 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:48.174300 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70b069-ab32-4408-9e48-6c1e87bac269 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:48.177489 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece62ae7-dfe1-4b23-8c08-8116dd7bcdd6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:48.193936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 322/645] 10.222.0.41 () {56 vars in 1137 bytes} [Fri May 27 16:20:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:48.195003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70b069-ab32-4408-9e48-6c1e87bac269 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:48.230594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5c271-a92c-4a4f-b296-5517e6356644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:48.231273 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5c271-a92c-4a4f-b296-5517e6356644 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:48.231562 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5c271-a92c-4a4f-b296-5517e6356644 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:48.231826 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5c271-a92c-4a4f-b296-5517e6356644 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:48.232652 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5c271-a92c-4a4f-b296-5517e6356644 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:48.232956 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5c271-a92c-4a4f-b296-5517e6356644 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:48.234338 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5c271-a92c-4a4f-b296-5517e6356644 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:48.248114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 324/646] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:20:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:48.248114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5c271-a92c-4a4f-b296-5517e6356644 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:48.328225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:48.352724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70b069-ab32-4408-9e48-6c1e87bac269 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:48.381320 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5c271-a92c-4a4f-b296-5517e6356644 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:48.404942 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890c695-ecec-4f96-a555-713fe4f7819e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:48.405711 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890c695-ecec-4f96-a555-713fe4f7819e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:48.406053 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890c695-ecec-4f96-a555-713fe4f7819e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:48.406390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890c695-ecec-4f96-a555-713fe4f7819e None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:48.407185 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890c695-ecec-4f96-a555-713fe4f7819e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:48.407575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890c695-ecec-4f96-a555-713fe4f7819e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:48.409090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890c695-ecec-4f96-a555-713fe4f7819e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:48.421379 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2809e-eefb-4196-939e-70cfb251bda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:48.422213 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2809e-eefb-4196-939e-70cfb251bda7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:48.422470 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2809e-eefb-4196-939e-70cfb251bda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:48.422737 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2809e-eefb-4196-939e-70cfb251bda7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:48.424220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 323/647] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:48.430010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890c695-ecec-4f96-a555-713fe4f7819e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:48.435590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2809e-eefb-4196-939e-70cfb251bda7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:48.437103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2809e-eefb-4196-939e-70cfb251bda7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:48.455443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-b1e2809e-eefb-4196-939e-70cfb251bda7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:48.455443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:48.455443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:48.455443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:48.455443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:48.455443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:48.455443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:48.455443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:48.455443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:48.455443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:48.455443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:48.455443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:48.455443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:48.455443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:48.455443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:48.456757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:48.456757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:48.456757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:48.456757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:48.456757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:48.456757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:48.456757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:48.456757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:48.456757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:48.456757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:48.456757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:48.456757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:48.456757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:48.456757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:48.456757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:48.456757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:48.456757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:48.457683 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:48.457683 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:48.457683 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:48.457683 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:48.461609 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 325/648] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:48.462483 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2809e-eefb-4196-939e-70cfb251bda7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:48.484036 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:48.553504 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890c695-ecec-4f96-a555-713fe4f7819e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:48.587469 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2809e-eefb-4196-939e-70cfb251bda7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:48.591441 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6780f83-56e0-44de-8e1c-a01873811f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:48.592135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6780f83-56e0-44de-8e1c-a01873811f46 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:48.592420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6780f83-56e0-44de-8e1c-a01873811f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:48.592695 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6780f83-56e0-44de-8e1c-a01873811f46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:48.610266 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:48.627381 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86302af-0cce-48e4-a70e-eabdcc066fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:48.629217 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86302af-0cce-48e4-a70e-eabdcc066fcb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:48.629429 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86302af-0cce-48e4-a70e-eabdcc066fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:48.629588 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86302af-0cce-48e4-a70e-eabdcc066fcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:48.644197 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86302af-0cce-48e4-a70e-eabdcc066fcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:48.645807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86302af-0cce-48e4-a70e-eabdcc066fcb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:48.666457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-a86302af-0cce-48e4-a70e-eabdcc066fcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:48.666457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:48.666457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:48.666457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:48.666457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:48.666457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:48.666457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:48.666457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:48.666457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:48.666457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:48.666457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:48.666457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:48.666457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:48.666457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:48.666457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:48.668117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:48.668117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:48.668117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:48.668117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:48.668117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:48.668117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:48.668117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:48.668117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:48.668117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:48.668117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:48.668117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:48.668117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:48.668117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:48.668117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:48.668117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:48.668117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:48.668117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:48.669894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:48.669894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:48.669894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:48.669894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:48.669894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 326/649] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:48.673169 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86302af-0cce-48e4-a70e-eabdcc066fcb None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:48.686647 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6780f83-56e0-44de-8e1c-a01873811f46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:48.688266 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6780f83-56e0-44de-8e1c-a01873811f46 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:48.767795 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:48.809085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 324/650] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:48.813661 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6780f83-56e0-44de-8e1c-a01873811f46 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:48.817839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86302af-0cce-48e4-a70e-eabdcc066fcb None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:48.858521 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1c115-6222-45eb-ac71-0d6a5a2243e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:48.859329 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1c115-6222-45eb-ac71-0d6a5a2243e2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:48.859614 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1c115-6222-45eb-ac71-0d6a5a2243e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:48.859889 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1c115-6222-45eb-ac71-0d6a5a2243e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:48.864483 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:48.869090 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1c115-6222-45eb-ac71-0d6a5a2243e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:48.870578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1c115-6222-45eb-ac71-0d6a5a2243e2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:48.886289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-80b1c115-6222-45eb-ac71-0d6a5a2243e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:48.886289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:48.886289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:48.886289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:48.886289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:48.886289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:48.886289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:48.886289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:48.886289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:48.886289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:48.886289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:48.886289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:48.886289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:20:48.886289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:20:48.886289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:20:48.887307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:20:48.887307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:48.887307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:48.887307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:48.887307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:48.887307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:48.887307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:48.887307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:48.887307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:48.887307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:48.887307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:48.887307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:48.887307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:48.887307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:48.887307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:48.887307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:48.887307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:48.893311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:20:48.893311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:20:48.893311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:20:48.893311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:20:48.893311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:20:48.893311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:20:48.893311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:48.893311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:48.893311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 327/651] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:48.893311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1c115-6222-45eb-ac71-0d6a5a2243e2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:48.920700 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6780f83-56e0-44de-8e1c-a01873811f46 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:48.959290 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969920a6-49ee-4fda-877e-7b412cc1b102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:48.959973 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969920a6-49ee-4fda-877e-7b412cc1b102 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:48.960293 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969920a6-49ee-4fda-877e-7b412cc1b102 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:48.960563 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969920a6-49ee-4fda-877e-7b412cc1b102 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:48.961305 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969920a6-49ee-4fda-877e-7b412cc1b102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:48.961611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969920a6-49ee-4fda-877e-7b412cc1b102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:48.963064 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969920a6-49ee-4fda-877e-7b412cc1b102 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:48.977041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 325/652] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:48.977905 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969920a6-49ee-4fda-877e-7b412cc1b102 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:49.007461 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1c115-6222-45eb-ac71-0d6a5a2243e2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:49.043149 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:49.054088 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0152f28-cad7-4874-a226-3b618be5a0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:49.054757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0152f28-cad7-4874-a226-3b618be5a0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:49.055016 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0152f28-cad7-4874-a226-3b618be5a0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:49.055309 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0152f28-cad7-4874-a226-3b618be5a0a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:49.056040 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0152f28-cad7-4874-a226-3b618be5a0a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:49.056354 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0152f28-cad7-4874-a226-3b618be5a0a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:49.057751 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0152f28-cad7-4874-a226-3b618be5a0a8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:49.070345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 328/653] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:49.071700 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2d5c8-af16-40f5-b9e8-77a1a2d8caf9 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:49.071987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2d5c8-af16-40f5-b9e8-77a1a2d8caf9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:49.072265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2d5c8-af16-40f5-b9e8-77a1a2d8caf9 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:49.073796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 329/654] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:49.074801 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2d5c8-af16-40f5-b9e8-77a1a2d8caf9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:49.091388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969920a6-49ee-4fda-877e-7b412cc1b102 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:49.093791 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:49.127922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329b238-a26f-4e96-a284-f0eb78f5787d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:49.129269 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329b238-a26f-4e96-a284-f0eb78f5787d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:49.129571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329b238-a26f-4e96-a284-f0eb78f5787d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:49.129839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329b238-a26f-4e96-a284-f0eb78f5787d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:49.140865 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329b238-a26f-4e96-a284-f0eb78f5787d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:49.142345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329b238-a26f-4e96-a284-f0eb78f5787d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:49.161453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-6329b238-a26f-4e96-a284-f0eb78f5787d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:49.161453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:49.161453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:49.161453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:49.161453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:49.161453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:49.161453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:49.161453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:49.161453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:49.161453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:49.161453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:49.161453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:49.161453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:49.161453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:49.161453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:49.162442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:49.162442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:49.162442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:49.162442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:49.162442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:49.162442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:49.162442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:49.162442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:49.162442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:49.162442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:49.162442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:49.162442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:49.162442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:49.162442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:49.162442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:49.162442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:49.162442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:49.163533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:49.163533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:49.163533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:49.163533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:49.163533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 326/655] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:49.164283 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329b238-a26f-4e96-a284-f0eb78f5787d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:49.187690 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2d5c8-af16-40f5-b9e8-77a1a2d8caf9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:49.224091 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9858f94-78be-41ff-ba4c-35629b57f8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:49.224761 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9858f94-78be-41ff-ba4c-35629b57f8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:49.225045 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9858f94-78be-41ff-ba4c-35629b57f8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:49.225320 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9858f94-78be-41ff-ba4c-35629b57f8a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:49.226112 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9858f94-78be-41ff-ba4c-35629b57f8a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:49.226444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9858f94-78be-41ff-ba4c-35629b57f8a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:49.227903 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9858f94-78be-41ff-ba4c-35629b57f8a1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:49.242668 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 330/656] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:20:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:49.243533 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9858f94-78be-41ff-ba4c-35629b57f8a1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:49.271048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329b238-a26f-4e96-a284-f0eb78f5787d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:49.305888 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:49.326293 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4bb2b-3aab-495b-a5bc-2cd104e0abe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:49.327176 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4bb2b-3aab-495b-a5bc-2cd104e0abe8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:49.327434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4bb2b-3aab-495b-a5bc-2cd104e0abe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:49.327680 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4bb2b-3aab-495b-a5bc-2cd104e0abe8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:49.336988 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4bb2b-3aab-495b-a5bc-2cd104e0abe8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:49.338490 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4bb2b-3aab-495b-a5bc-2cd104e0abe8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:49.355464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e4d4bb2b-3aab-495b-a5bc-2cd104e0abe8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 16:20:49.355464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:49.355464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:49.355464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:49.355464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:49.355464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:49.355464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:49.355464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:49.355464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:49.355464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:49.355464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:49.355464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:49.355464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:20:49.355464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:20:49.355464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:20:49.355464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:20:49.357570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:49.357570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:49.357570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:20:49.357570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:49.357570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:20:49.357570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:49.357570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:49.357570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:49.357570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:49.357570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:49.357570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:49.357570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:49.357570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:49.357570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:49.357570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:49.357570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:49.357570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:49.357570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:49.359652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:49.359652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:49.359652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:20:49.359652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:20:49.359652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:20:49.359652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:20:49.359652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:20:49.359652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:20:49.359652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 16:20:49.359652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:49.359652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 327/657] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:49.361010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1256b-4a98-4953-a662-22107a8bf416 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:49.361010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1256b-4a98-4953-a662-22107a8bf416 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:49.361010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1256b-4a98-4953-a662-22107a8bf416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:49.380569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9858f94-78be-41ff-ba4c-35629b57f8a1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:49.380924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-95a1256b-4a98-4953-a662-22107a8bf416 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:49.382150 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-95a1256b-4a98-4953-a662-22107a8bf416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:49.394309 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:49.424630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a870db-d20a-4b54-8ac6-6f60b9d73725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:49.426105 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a870db-d20a-4b54-8ac6-6f60b9d73725 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:49.426386 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a870db-d20a-4b54-8ac6-6f60b9d73725 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:49.426659 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a870db-d20a-4b54-8ac6-6f60b9d73725 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:49.435988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a870db-d20a-4b54-8ac6-6f60b9d73725 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:49.437522 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a870db-d20a-4b54-8ac6-6f60b9d73725 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:49.459207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-e2a870db-d20a-4b54-8ac6-6f60b9d73725 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 16:20:49.459207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:49.459207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:49.459207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:49.459207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:49.459207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:49.459207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:49.459207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:49.459207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:49.459207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:49.459207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:49.459207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:49.459207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:20:49.459207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:20:49.459207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:20:49.459207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:20:49.467901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:49.467901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:49.467901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:20:49.467901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:49.467901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:20:49.467901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:49.467901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:49.467901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:49.467901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:49.467901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:49.467901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:49.467901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:49.467901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:49.467901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:49.467901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:49.467901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:49.467901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:49.467901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:49.469635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:49.469635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:49.469635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:20:49.469635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:20:49.469635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:20:49.469635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:20:49.469635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:20:49.469635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:20:49.469635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 16:20:49.469635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:49.469635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 331/658] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:20:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:49.469635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a870db-d20a-4b54-8ac6-6f60b9d73725 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:49.470912 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 328/659] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:49.470912 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1256b-4a98-4953-a662-22107a8bf416 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:49.593849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1256b-4a98-4953-a662-22107a8bf416 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:49.600055 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a870db-d20a-4b54-8ac6-6f60b9d73725 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:49.607351 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:49.629784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dcb3d-c553-43b1-addb-d40a207f6166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:49.630640 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dcb3d-c553-43b1-addb-d40a207f6166 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:49.630757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dcb3d-c553-43b1-addb-d40a207f6166 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:49.631001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dcb3d-c553-43b1-addb-d40a207f6166 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:49.631832 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dcb3d-c553-43b1-addb-d40a207f6166 None admin] RBAC: Adding query filter params (role.id=acbb2252c9f54cf8b789aa80f0a1fe85, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=3caa3dbc7bd24ebba28296a1eba9cefe) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:49.632170 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dcb3d-c553-43b1-addb-d40a207f6166 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:49.633642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dcb3d-c553-43b1-addb-d40a207f6166 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:49.635330 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41fd6d-8b83-4451-b53a-fdf31f6b4754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:49.636044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41fd6d-8b83-4451-b53a-fdf31f6b4754 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:49.636312 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41fd6d-8b83-4451-b53a-fdf31f6b4754 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:49.636589 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41fd6d-8b83-4451-b53a-fdf31f6b4754 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:49.637320 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41fd6d-8b83-4451-b53a-fdf31f6b4754 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:49.637625 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41fd6d-8b83-4451-b53a-fdf31f6b4754 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:49.639060 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41fd6d-8b83-4451-b53a-fdf31f6b4754 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:49.652296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 329/660] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:20:49 2022] GET /identity/v3/role_assignments?user.id=3caa3dbc7bd24ebba28296a1eba9cefe&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=acbb2252c9f54cf8b789aa80f0a1fe85 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:49.652296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dcb3d-c553-43b1-addb-d40a207f6166 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:49.656436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:49.666122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 332/661] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:49.666946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41fd6d-8b83-4451-b53a-fdf31f6b4754 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:49.770090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dcb3d-c553-43b1-addb-d40a207f6166 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:49.797754 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41fd6d-8b83-4451-b53a-fdf31f6b4754 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:49.811391 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a27e9-fb3e-41c3-abad-3d0aadab51a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:49.812220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a27e9-fb3e-41c3-abad-3d0aadab51a5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:49.812578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a27e9-fb3e-41c3-abad-3d0aadab51a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:49.812922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a27e9-fb3e-41c3-abad-3d0aadab51a5 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:49.813848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a27e9-fb3e-41c3-abad-3d0aadab51a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:49.814256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a27e9-fb3e-41c3-abad-3d0aadab51a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:49.816077 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363a27e9-fb3e-41c3-abad-3d0aadab51a5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:49.841988 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 330/662] 10.222.0.41 () {56 vars in 1137 bytes} [Fri May 27 16:20:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:49.843096 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a27e9-fb3e-41c3-abad-3d0aadab51a5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:49.843529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca4995-638d-4853-8628-a70c4492ebde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:49.844300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca4995-638d-4853-8628-a70c4492ebde None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:49.844581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca4995-638d-4853-8628-a70c4492ebde None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:49.844855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca4995-638d-4853-8628-a70c4492ebde None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:49.845731 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca4995-638d-4853-8628-a70c4492ebde None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:49.846085 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca4995-638d-4853-8628-a70c4492ebde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:49.847975 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca4995-638d-4853-8628-a70c4492ebde None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:49.876627 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 333/663] 10.222.0.41 () {56 vars in 1139 bytes} [Fri May 27 16:20:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:49.878837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca4995-638d-4853-8628-a70c4492ebde None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:49.918021 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:49.946848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:49.988327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a27e9-fb3e-41c3-abad-3d0aadab51a5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:50.016688 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca4995-638d-4853-8628-a70c4492ebde None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:50.029087 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924a8aa-ae03-4f5e-80cb-48036848600f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:50.029911 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924a8aa-ae03-4f5e-80cb-48036848600f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:50.030354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924a8aa-ae03-4f5e-80cb-48036848600f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:50.030619 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924a8aa-ae03-4f5e-80cb-48036848600f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:50.043875 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c924a8aa-ae03-4f5e-80cb-48036848600f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:50.052107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c924a8aa-ae03-4f5e-80cb-48036848600f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:50.052107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:50.052107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:50.052107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:50.052107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:50.052107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:50.052107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:50.052107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:50.052107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:50.052107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:50.052107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:50.052107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:50.052107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:50.052107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:50.052107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:50.052107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:50.053347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:50.053347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:50.053347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:50.053347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:50.053347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:50.053347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:50.053347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:50.053347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:50.053347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:50.053347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:50.053347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:50.053347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:50.053347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:50.053347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:50.053347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:50.053347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:50.054393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:50.054393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:50.054393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:50.054393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:50.054393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:50.054393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:50.054393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:50.054393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:50.054393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:50.054393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:50.054393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:20:50.054393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:50.056336 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 331/664] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:20:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:50.057117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924a8aa-ae03-4f5e-80cb-48036848600f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:50.062828 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acaf12-c3c8-4a70-92c9-f7c7796af14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:50.063649 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acaf12-c3c8-4a70-92c9-f7c7796af14c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:50.063928 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acaf12-c3c8-4a70-92c9-f7c7796af14c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:50.064246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acaf12-c3c8-4a70-92c9-f7c7796af14c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:50.072282 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acaf12-c3c8-4a70-92c9-f7c7796af14c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:50.073752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acaf12-c3c8-4a70-92c9-f7c7796af14c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:50.088769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-61acaf12-c3c8-4a70-92c9-f7c7796af14c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:50.088769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:50.088769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:50.088769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:50.088769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:50.088769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:50.088769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:50.088769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:50.088769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:50.088769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:50.088769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:50.088769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:50.088769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:20:50.088769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:20:50.088769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:20:50.089950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:20:50.089950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:50.089950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:50.089950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:50.089950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:50.089950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:50.089950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:50.089950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:50.089950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:50.089950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:50.089950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:50.089950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:50.089950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:50.089950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:50.089950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:50.089950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:50.089950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:50.091230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:20:50.091230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:20:50.091230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:20:50.091230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:20:50.091230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:20:50.091230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:20:50.091230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:50.091230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:50.091230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 334/665] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:50.091884 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acaf12-c3c8-4a70-92c9-f7c7796af14c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:50.193703 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924a8aa-ae03-4f5e-80cb-48036848600f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:50.195982 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:50.215881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acaf12-c3c8-4a70-92c9-f7c7796af14c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:50.228611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:50.238886 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de3a79-b23c-4e8f-8ae9-46c4ce3aa6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:50.239575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de3a79-b23c-4e8f-8ae9-46c4ce3aa6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:50.239996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de3a79-b23c-4e8f-8ae9-46c4ce3aa6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:50.240489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de3a79-b23c-4e8f-8ae9-46c4ce3aa6c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:50.264413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56317b6-c616-404a-b349-3f5b49b026f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:50.265073 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56317b6-c616-404a-b349-3f5b49b026f5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:50.265340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56317b6-c616-404a-b349-3f5b49b026f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:50.265613 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56317b6-c616-404a-b349-3f5b49b026f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:50.326847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de3a79-b23c-4e8f-8ae9-46c4ce3aa6c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:50.328402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de3a79-b23c-4e8f-8ae9-46c4ce3aa6c2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:50.357027 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56317b6-c616-404a-b349-3f5b49b026f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:50.358686 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56317b6-c616-404a-b349-3f5b49b026f5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:50.445866 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 332/666] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:50.446978 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de3a79-b23c-4e8f-8ae9-46c4ce3aa6c2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:50.462121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:50.478461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:50.484257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 335/667] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:50.485361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56317b6-c616-404a-b349-3f5b49b026f5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:50.572103 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de3a79-b23c-4e8f-8ae9-46c4ce3aa6c2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:50.612839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594e1ef-a03a-46a0-9806-2b1ae341c278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:50.613858 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594e1ef-a03a-46a0-9806-2b1ae341c278 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:50.614313 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594e1ef-a03a-46a0-9806-2b1ae341c278 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:50.614756 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594e1ef-a03a-46a0-9806-2b1ae341c278 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:50.615706 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594e1ef-a03a-46a0-9806-2b1ae341c278 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:50.616220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594e1ef-a03a-46a0-9806-2b1ae341c278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:50.617750 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c594e1ef-a03a-46a0-9806-2b1ae341c278 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:50.619245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56317b6-c616-404a-b349-3f5b49b026f5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:50.629263 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 333/668] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:20:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:50.630880 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594e1ef-a03a-46a0-9806-2b1ae341c278 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:50.655413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffa9ce-b52c-46de-8df6-5be8915a4dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:50.656119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffa9ce-b52c-46de-8df6-5be8915a4dcf None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:50.656409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffa9ce-b52c-46de-8df6-5be8915a4dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:50.656679 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffa9ce-b52c-46de-8df6-5be8915a4dcf None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:50.657480 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffa9ce-b52c-46de-8df6-5be8915a4dcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:50.657789 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffa9ce-b52c-46de-8df6-5be8915a4dcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:50.660261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffa9ce-b52c-46de-8df6-5be8915a4dcf None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:50.672948 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 336/669] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:20:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:50.679339 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffa9ce-b52c-46de-8df6-5be8915a4dcf None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:50.736282 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:50.769247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:50.782928 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594e1ef-a03a-46a0-9806-2b1ae341c278 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:50.811126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffa9ce-b52c-46de-8df6-5be8915a4dcf None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:50.839208 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388db01-5a3b-45f0-a6dd-2a56bd9a0729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:50.840434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388db01-5a3b-45f0-a6dd-2a56bd9a0729 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:50.840877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388db01-5a3b-45f0-a6dd-2a56bd9a0729 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:50.841450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388db01-5a3b-45f0-a6dd-2a56bd9a0729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:50.858233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388db01-5a3b-45f0-a6dd-2a56bd9a0729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:50.860120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388db01-5a3b-45f0-a6dd-2a56bd9a0729 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:50.876953 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5130ad7-dac5-453c-ab8c-32f85bc3cc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:50.878430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5130ad7-dac5-453c-ab8c-32f85bc3cc4d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:50.879373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5130ad7-dac5-453c-ab8c-32f85bc3cc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:50.879373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5130ad7-dac5-453c-ab8c-32f85bc3cc4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:50.887429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-7388db01-5a3b-45f0-a6dd-2a56bd9a0729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:50.887429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:50.887429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:50.887429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:50.887429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:50.887429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:50.887429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:50.887429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:50.887429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:50.887429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:50.887429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:50.887429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:50.887429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:50.887429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:50.887429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:50.896262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:50.896262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:50.896262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:50.896262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:50.896262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:50.896262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:50.896262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:50.896262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:50.896262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:50.896262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:50.896262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:50.896262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:50.896262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:50.896262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:50.896262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:50.896262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:50.896262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:50.897304 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:50.897304 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:50.897304 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:50.897304 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:50.897304 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 334/670] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:50.897304 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388db01-5a3b-45f0-a6dd-2a56bd9a0729 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:50.897647 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5130ad7-dac5-453c-ab8c-32f85bc3cc4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:50.897647 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5130ad7-dac5-453c-ab8c-32f85bc3cc4d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:50.918993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-e5130ad7-dac5-453c-ab8c-32f85bc3cc4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:50.918993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:50.918993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:50.918993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:50.918993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:50.918993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:50.918993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:50.918993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:50.918993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:50.918993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:50.918993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:50.918993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:50.918993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:50.918993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:50.918993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:50.919985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:50.919985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:50.919985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:50.919985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:50.919985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:50.919985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:50.919985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:50.919985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:50.919985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:50.919985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:50.919985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:50.919985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:50.919985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:50.919985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:50.919985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:50.919985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:50.919985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:50.922967 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:50.922967 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:50.922967 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:50.922967 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:50.922967 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 337/671] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:50.922967 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5130ad7-dac5-453c-ab8c-32f85bc3cc4d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:51.027037 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388db01-5a3b-45f0-a6dd-2a56bd9a0729 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:51.037453 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:51.046394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5130ad7-dac5-453c-ab8c-32f85bc3cc4d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:51.071093 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfaf91b-f669-4723-bd56-6556ff28e27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:51.071917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaf91b-f669-4723-bd56-6556ff28e27d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:51.072227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaf91b-f669-4723-bd56-6556ff28e27d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:51.072498 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaf91b-f669-4723-bd56-6556ff28e27d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:51.087283 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfaf91b-f669-4723-bd56-6556ff28e27d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:51.087488 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841066ed-ebeb-4f32-a6de-7f2b2e614728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:51.087620 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841066ed-ebeb-4f32-a6de-7f2b2e614728 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:51.087906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841066ed-ebeb-4f32-a6de-7f2b2e614728 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:51.088207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841066ed-ebeb-4f32-a6de-7f2b2e614728 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:51.088363 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfaf91b-f669-4723-bd56-6556ff28e27d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:51.089036 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841066ed-ebeb-4f32-a6de-7f2b2e614728 None admin] RBAC: Adding query filter params (role.id=acbb2252c9f54cf8b789aa80f0a1fe85, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=4561bdacf98d47a6beffbcc400120bcd) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:51.089415 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841066ed-ebeb-4f32-a6de-7f2b2e614728 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:51.090350 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:51.090787 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841066ed-ebeb-4f32-a6de-7f2b2e614728 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:51.097918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 338/672] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:20:50 2022] GET /identity/v3/role_assignments?user.id=4561bdacf98d47a6beffbcc400120bcd&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=acbb2252c9f54cf8b789aa80f0a1fe85 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:51.098562 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841066ed-ebeb-4f32-a6de-7f2b2e614728 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:51.120048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-3bfaf91b-f669-4723-bd56-6556ff28e27d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:51.120048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:51.120048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:51.120048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:51.120048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:51.120048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:51.120048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:51.120048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:51.120048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:51.120048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:51.120048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:51.120048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:51.120048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:51.120048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:51.120048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:51.121517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:51.121517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:51.121517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:51.121517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:51.121517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:51.121517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:51.121517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:51.121517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:51.121517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:51.121517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:51.121517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:51.121517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:51.121517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:51.121517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:51.121517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:51.121517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:51.121517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:51.122812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:51.122812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:51.122812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:51.122812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:51.125588 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 335/673] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:51.126930 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfaf91b-f669-4723-bd56-6556ff28e27d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:51.260987 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfaf91b-f669-4723-bd56-6556ff28e27d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:51.271706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841066ed-ebeb-4f32-a6de-7f2b2e614728 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:51.312670 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d989cbd-e10b-4e50-8f14-c907a2a9a976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:51.313779 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d989cbd-e10b-4e50-8f14-c907a2a9a976 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:51.314260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d989cbd-e10b-4e50-8f14-c907a2a9a976 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:51.314730 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d989cbd-e10b-4e50-8f14-c907a2a9a976 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:51.315797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d989cbd-e10b-4e50-8f14-c907a2a9a976 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:51.316407 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d989cbd-e10b-4e50-8f14-c907a2a9a976 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:51.318235 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d989cbd-e10b-4e50-8f14-c907a2a9a976 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:51.325402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be012f5a-d029-4e03-9500-65c513390c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:51.326100 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be012f5a-d029-4e03-9500-65c513390c33 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:51.326384 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be012f5a-d029-4e03-9500-65c513390c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:51.326658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be012f5a-d029-4e03-9500-65c513390c33 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:51.327406 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be012f5a-d029-4e03-9500-65c513390c33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:51.327711 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be012f5a-d029-4e03-9500-65c513390c33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:51.329187 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be012f5a-d029-4e03-9500-65c513390c33 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:51.339309 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 336/674] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:51.340782 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d989cbd-e10b-4e50-8f14-c907a2a9a976 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:51.345471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 339/675] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:51.352224 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be012f5a-d029-4e03-9500-65c513390c33 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:51.387183 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:51.451379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:51.500607 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be012f5a-d029-4e03-9500-65c513390c33 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:51.533462 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d989cbd-e10b-4e50-8f14-c907a2a9a976 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:51.555177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea089b39-471d-4e3b-9b9f-347f98f2e69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:51.556375 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea089b39-471d-4e3b-9b9f-347f98f2e69f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:51.556856 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea089b39-471d-4e3b-9b9f-347f98f2e69f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:51.557332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea089b39-471d-4e3b-9b9f-347f98f2e69f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:51.569265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea089b39-471d-4e3b-9b9f-347f98f2e69f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:51.572108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea089b39-471d-4e3b-9b9f-347f98f2e69f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:51.577537 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162cf3f-0550-46a0-adaf-40a7eb53fbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:51.578570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162cf3f-0550-46a0-adaf-40a7eb53fbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:51.579057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162cf3f-0550-46a0-adaf-40a7eb53fbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:51.579528 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162cf3f-0550-46a0-adaf-40a7eb53fbf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:51.580892 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162cf3f-0550-46a0-adaf-40a7eb53fbf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:51.581432 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162cf3f-0550-46a0-adaf-40a7eb53fbf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:51.583324 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162cf3f-0550-46a0-adaf-40a7eb53fbf1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:51.588299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ea089b39-471d-4e3b-9b9f-347f98f2e69f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:51.588299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:51.588299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:51.588299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:51.588299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:51.588299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:51.588299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:51.588299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:51.588299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:51.588299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:51.588299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:51.588299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:51.588299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:20:51.588299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:20:51.588299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:20:51.589301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:20:51.589301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:51.589301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:51.589301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:51.589301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:51.589301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:51.589301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:51.589301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:51.589301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:51.589301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:51.589301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:51.589301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:51.589301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:51.589301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:51.589301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:51.589301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:51.589301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:51.590272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:20:51.590272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:20:51.590272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:20:51.590272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:20:51.590272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:20:51.590272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:20:51.590272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:51.590272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:51.590272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 340/676] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:51.591323 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea089b39-471d-4e3b-9b9f-347f98f2e69f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:51.601714 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 337/677] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:51.602960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162cf3f-0550-46a0-adaf-40a7eb53fbf1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:51.698488 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:51.720890 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea089b39-471d-4e3b-9b9f-347f98f2e69f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:51.761679 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af65ef1-b786-4577-8f35-7074797f7a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:51.762561 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af65ef1-b786-4577-8f35-7074797f7a6d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:51.762843 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af65ef1-b786-4577-8f35-7074797f7a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:51.763137 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af65ef1-b786-4577-8f35-7074797f7a6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:51.765416 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162cf3f-0550-46a0-adaf-40a7eb53fbf1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:51.771852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af65ef1-b786-4577-8f35-7074797f7a6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:51.773398 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af65ef1-b786-4577-8f35-7074797f7a6d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:51.783457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:51.789472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-5af65ef1-b786-4577-8f35-7074797f7a6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:51.789472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:51.789472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:51.789472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:51.789472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:51.789472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:51.789472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:51.789472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:51.789472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:51.789472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:51.789472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:51.789472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:51.789472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:20:51.789472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:20:51.789472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:20:51.790468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:20:51.790468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:51.790468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:51.790468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:51.790468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:51.790468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:51.790468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:51.790468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:51.790468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:51.790468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:51.790468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:51.790468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:51.790468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:51.790468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:51.790468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:51.790468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:51.790468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:51.791452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:20:51.791452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:20:51.791452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:20:51.791452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:20:51.791452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:20:51.791452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:20:51.791452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:51.791452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:51.791452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 341/678] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:51.791966 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af65ef1-b786-4577-8f35-7074797f7a6d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:51.815509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b5fd6-568a-4f7e-b447-4b928309a83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:51.816902 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b5fd6-568a-4f7e-b447-4b928309a83e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:51.817590 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b5fd6-568a-4f7e-b447-4b928309a83e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:51.818158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b5fd6-568a-4f7e-b447-4b928309a83e None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:51.820266 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b5fd6-568a-4f7e-b447-4b928309a83e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:51.821355 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b5fd6-568a-4f7e-b447-4b928309a83e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:51.824696 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b5fd6-568a-4f7e-b447-4b928309a83e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:51.849681 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 338/679] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:20:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:51.851494 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b5fd6-568a-4f7e-b447-4b928309a83e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:51.915972 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af65ef1-b786-4577-8f35-7074797f7a6d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:51.960812 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dab2dc-6bd0-41e1-84fc-f1301d90745e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:51.961639 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dab2dc-6bd0-41e1-84fc-f1301d90745e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:51.961921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dab2dc-6bd0-41e1-84fc-f1301d90745e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:51.962190 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dab2dc-6bd0-41e1-84fc-f1301d90745e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:51.971075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dab2dc-6bd0-41e1-84fc-f1301d90745e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:51.974044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dab2dc-6bd0-41e1-84fc-f1301d90745e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:51.978046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:51.992430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-47dab2dc-6bd0-41e1-84fc-f1301d90745e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 16:20:51.992430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:51.992430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:51.992430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:51.992430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:51.992430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:51.992430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:51.992430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:51.992430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:51.992430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:51.992430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:51.992430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:51.992430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:20:51.992430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:20:51.992430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:20:51.992430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:20:51.993501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:51.993501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:51.993501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:20:51.993501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:51.993501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:20:51.993501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:51.993501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:51.993501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:51.993501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:51.993501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:51.993501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:51.993501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:51.993501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:51.993501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:51.993501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:51.993501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:51.993501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:51.993501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:51.994560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:51.994560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:51.994560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:20:51.994560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:20:51.994560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:20:51.994560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:20:51.994560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:20:51.994560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:20:51.994560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 16:20:51.994560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:51.998472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 342/680] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:20:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:51.999538 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dab2dc-6bd0-41e1-84fc-f1301d90745e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:52.000382 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b5fd6-568a-4f7e-b447-4b928309a83e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:52.042914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad3971-6981-4078-b666-c2a0a9b811e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:52.043576 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad3971-6981-4078-b666-c2a0a9b811e8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:52.043853 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad3971-6981-4078-b666-c2a0a9b811e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:52.044150 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad3971-6981-4078-b666-c2a0a9b811e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:52.044943 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad3971-6981-4078-b666-c2a0a9b811e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:52.045248 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad3971-6981-4078-b666-c2a0a9b811e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:52.046767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad3971-6981-4078-b666-c2a0a9b811e8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:52.060977 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 339/681] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:20:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:52.061837 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad3971-6981-4078-b666-c2a0a9b811e8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:52.103437 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:52.134819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dab2dc-6bd0-41e1-84fc-f1301d90745e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:52.179856 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d46d5d-9c4c-4557-8410-a0fd6fab1a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:52.180115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d46d5d-9c4c-4557-8410-a0fd6fab1a66 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:52.180342 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d46d5d-9c4c-4557-8410-a0fd6fab1a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:52.180631 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d46d5d-9c4c-4557-8410-a0fd6fab1a66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:52.181402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d46d5d-9c4c-4557-8410-a0fd6fab1a66 None admin] RBAC: Adding query filter params (role.id=acbb2252c9f54cf8b789aa80f0a1fe85, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=6f3fe9e871b34a8faed94550e27fefd3) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:52.181712 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d46d5d-9c4c-4557-8410-a0fd6fab1a66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:52.183193 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d46d5d-9c4c-4557-8410-a0fd6fab1a66 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:52.190042 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 343/682] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:20:51 2022] GET /identity/v3/role_assignments?user.id=6f3fe9e871b34a8faed94550e27fefd3&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=acbb2252c9f54cf8b789aa80f0a1fe85 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:52.191761 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22302685-fa55-4d51-b36a-454e764e584e None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:52.192087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22302685-fa55-4d51-b36a-454e764e584e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:52.192371 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22302685-fa55-4d51-b36a-454e764e584e None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:52.196086 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 344/683] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:52.196086 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22302685-fa55-4d51-b36a-454e764e584e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:52.205834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad3971-6981-4078-b666-c2a0a9b811e8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:52.264084 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286bf6f-398c-4b85-a921-b9ab3de6539f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:52.265210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286bf6f-398c-4b85-a921-b9ab3de6539f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:52.265964 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286bf6f-398c-4b85-a921-b9ab3de6539f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:52.266901 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286bf6f-398c-4b85-a921-b9ab3de6539f None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:52.268028 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286bf6f-398c-4b85-a921-b9ab3de6539f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:52.268575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286bf6f-398c-4b85-a921-b9ab3de6539f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:52.270307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286bf6f-398c-4b85-a921-b9ab3de6539f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:52.282554 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:52.306269 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 340/684] 10.222.0.41 () {56 vars in 1135 bytes} [Fri May 27 16:20:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:52.306269 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea52f3-99a4-49ad-b3cc-a7b114822093 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:52.306269 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea52f3-99a4-49ad-b3cc-a7b114822093 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:52.306269 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea52f3-99a4-49ad-b3cc-a7b114822093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:52.325239 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7bea52f3-99a4-49ad-b3cc-a7b114822093 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:52.326710 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7bea52f3-99a4-49ad-b3cc-a7b114822093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:52.348587 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22302685-fa55-4d51-b36a-454e764e584e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:52.387721 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0d21d-ea8b-4640-b36e-b5e6ef3bb039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:52.388737 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0d21d-ea8b-4640-b36e-b5e6ef3bb039 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:52.389193 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0d21d-ea8b-4640-b36e-b5e6ef3bb039 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:52.389638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0d21d-ea8b-4640-b36e-b5e6ef3bb039 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:52.390675 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0d21d-ea8b-4640-b36e-b5e6ef3bb039 None admin] RBAC: Adding query filter params (role.id=acbb2252c9f54cf8b789aa80f0a1fe85, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=b72987d279bf4767bad23918fc33302b) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:52.391170 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0d21d-ea8b-4640-b36e-b5e6ef3bb039 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:52.393367 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0d21d-ea8b-4640-b36e-b5e6ef3bb039 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:52.408050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 345/685] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:20:52 2022] GET /identity/v3/role_assignments?user.id=b72987d279bf4767bad23918fc33302b&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=acbb2252c9f54cf8b789aa80f0a1fe85 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:52.408050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0d21d-ea8b-4640-b36e-b5e6ef3bb039 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:52.420849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 341/686] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:52.448230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea52f3-99a4-49ad-b3cc-a7b114822093 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:52.483830 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:52.565977 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0d21d-ea8b-4640-b36e-b5e6ef3bb039 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:52.609115 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea52f3-99a4-49ad-b3cc-a7b114822093 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:52.624652 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:52.636384 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97f6c1-cd73-4669-ba9b-d734d95193f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:52.637450 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97f6c1-cd73-4669-ba9b-d734d95193f3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:52.637936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97f6c1-cd73-4669-ba9b-d734d95193f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:52.638157 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97f6c1-cd73-4669-ba9b-d734d95193f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:52.663795 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9ab3b-ad0f-4f05-b702-e3f232332c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:52.665119 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9ab3b-ad0f-4f05-b702-e3f232332c32 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:52.665647 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9ab3b-ad0f-4f05-b702-e3f232332c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:52.666113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9ab3b-ad0f-4f05-b702-e3f232332c32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:52.682875 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9ab3b-ad0f-4f05-b702-e3f232332c32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:52.692260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-73f9ab3b-ad0f-4f05-b702-e3f232332c32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:20:52.692260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:52.692260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:52.692260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:52.692260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:52.692260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:52.692260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:52.692260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:52.692260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:52.692260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:52.692260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:52.692260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:52.692260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:52.692260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:52.692260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:52.692260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:52.693261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:52.693261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:52.693261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:52.693261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:52.693261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:52.693261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:52.693261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:52.693261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:52.693261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:52.693261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:52.693261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:52.693261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:52.693261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:52.693261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:52.693261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:52.693261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:52.694133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:52.694133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:52.694133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:52.694133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:52.694133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:52.694133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:52.694133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:52.694133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:52.694133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:52.694133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:52.694133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:20:52.694133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:52.697088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 342/687] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:20:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:52.702486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9ab3b-ad0f-4f05-b702-e3f232332c32 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:52.724802 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97f6c1-cd73-4669-ba9b-d734d95193f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:52.726569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97f6c1-cd73-4669-ba9b-d734d95193f3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:52.806248 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:52.833623 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9ab3b-ad0f-4f05-b702-e3f232332c32 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:52.856045 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 346/688] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:52.862698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97f6c1-cd73-4669-ba9b-d734d95193f3 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:52.882752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53fcef-151d-4761-9c43-c849bfdc153a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:52.884051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53fcef-151d-4761-9c43-c849bfdc153a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:52.884738 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53fcef-151d-4761-9c43-c849bfdc153a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:52.885198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53fcef-151d-4761-9c43-c849bfdc153a None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:52.886515 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53fcef-151d-4761-9c43-c849bfdc153a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:52.887003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53fcef-151d-4761-9c43-c849bfdc153a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:52.889259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad53fcef-151d-4761-9c43-c849bfdc153a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:52.898595 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:52.903006 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 343/689] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:52.908594 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53fcef-151d-4761-9c43-c849bfdc153a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:52.979235 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97f6c1-cd73-4669-ba9b-d734d95193f3 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:53.014652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53fcef-151d-4761-9c43-c849bfdc153a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:53.015671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0bacc-2c93-4153-bcb5-b2848f70e7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:53.016601 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0bacc-2c93-4153-bcb5-b2848f70e7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:53.016949 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0bacc-2c93-4153-bcb5-b2848f70e7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:53.017333 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0bacc-2c93-4153-bcb5-b2848f70e7d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:53.028783 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0bacc-2c93-4153-bcb5-b2848f70e7d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:53.030456 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0bacc-2c93-4153-bcb5-b2848f70e7d1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:53.050445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-edc0bacc-2c93-4153-bcb5-b2848f70e7d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:53.050445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:53.050445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:53.050445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:53.050445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:53.050445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:53.050445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:53.050445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:53.050445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:53.050445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:53.050445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:53.050445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:53.050445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:53.050445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:53.050445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:53.051447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:53.051447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:53.051447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:53.051447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:53.051447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:53.051447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:53.051447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:53.051447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:53.051447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:53.051447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:53.051447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:53.051447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:53.051447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:53.051447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:53.051447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:53.051447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:53.051447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:53.052440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:53.052440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:53.052440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:53.052440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:53.056002 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee30bc-3c6c-4e57-99e0-771c9c73ae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:53.056398 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 347/690] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:53.057402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee30bc-3c6c-4e57-99e0-771c9c73ae95 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:53.057887 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee30bc-3c6c-4e57-99e0-771c9c73ae95 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:53.057993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0bacc-2c93-4153-bcb5-b2848f70e7d1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:53.058569 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee30bc-3c6c-4e57-99e0-771c9c73ae95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:53.070806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee30bc-3c6c-4e57-99e0-771c9c73ae95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:53.072671 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee30bc-3c6c-4e57-99e0-771c9c73ae95 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:53.075660 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:53.092130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-34ee30bc-3c6c-4e57-99e0-771c9c73ae95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:53.092130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:53.092130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:53.092130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:53.092130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:53.092130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:53.092130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:53.092130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:53.092130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:53.092130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:53.092130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:53.092130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:53.092130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:53.092130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:53.092130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:53.093140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:53.093140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:53.093140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:53.093140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:53.093140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:53.093140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:53.093140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:53.093140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:53.093140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:53.093140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:53.093140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:53.093140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:53.093140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:53.093140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:53.093140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:53.093140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:53.093140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:53.094159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:53.094159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:53.094159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:53.094159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:53.096611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 344/691] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:53.105027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee30bc-3c6c-4e57-99e0-771c9c73ae95 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:53.149274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:53.171411 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0bacc-2c93-4153-bcb5-b2848f70e7d1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:53.218453 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cae352-65d7-4e8b-bd67-71018b509bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:53.219824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae352-65d7-4e8b-bd67-71018b509bee None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:53.221060 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae352-65d7-4e8b-bd67-71018b509bee None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:53.222250 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cae352-65d7-4e8b-bd67-71018b509bee None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:53.223416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cae352-65d7-4e8b-bd67-71018b509bee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:53.224137 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cae352-65d7-4e8b-bd67-71018b509bee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:53.227589 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cae352-65d7-4e8b-bd67-71018b509bee None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:53.256610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 348/692] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:53.262486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cae352-65d7-4e8b-bd67-71018b509bee None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:53.308333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee30bc-3c6c-4e57-99e0-771c9c73ae95 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:53.383716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126da7d-b6e1-4c8f-b589-2d80456210a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:53.384427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126da7d-b6e1-4c8f-b589-2d80456210a7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:53.384712 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126da7d-b6e1-4c8f-b589-2d80456210a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:53.384985 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126da7d-b6e1-4c8f-b589-2d80456210a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:53.385715 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126da7d-b6e1-4c8f-b589-2d80456210a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:53.386022 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126da7d-b6e1-4c8f-b589-2d80456210a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:53.387425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126da7d-b6e1-4c8f-b589-2d80456210a7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:53.404149 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 345/693] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:53.409214 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126da7d-b6e1-4c8f-b589-2d80456210a7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:53.473994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cae352-65d7-4e8b-bd67-71018b509bee None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:53.504948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:53.531812 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9c1d5-3b0a-4c1e-b2f6-6dfda71c6e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:53.533202 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9c1d5-3b0a-4c1e-b2f6-6dfda71c6e22 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:53.533684 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9c1d5-3b0a-4c1e-b2f6-6dfda71c6e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:53.534236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9c1d5-3b0a-4c1e-b2f6-6dfda71c6e22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:53.543066 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9c1d5-3b0a-4c1e-b2f6-6dfda71c6e22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:53.545090 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9c1d5-3b0a-4c1e-b2f6-6dfda71c6e22 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:53.549169 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:53.563064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-2ce9c1d5-3b0a-4c1e-b2f6-6dfda71c6e22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:53.563064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:53.563064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:53.563064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:53.563064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:53.563064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:53.563064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:53.563064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:53.563064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:53.563064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:53.563064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:53.563064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:53.563064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:20:53.563064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:20:53.563064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:20:53.564063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:20:53.564063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:53.564063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:53.564063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:53.564063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:53.564063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:53.564063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:53.564063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:53.564063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:53.564063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:53.564063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:53.564063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:53.564063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:53.564063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:53.564063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:53.564063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:53.564063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:53.565006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:20:53.565006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:20:53.565006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:20:53.565006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:20:53.565006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:20:53.565006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:20:53.565006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:53.565006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:53.568302 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 349/694] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:53.573832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9c1d5-3b0a-4c1e-b2f6-6dfda71c6e22 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:53.633408 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126da7d-b6e1-4c8f-b589-2d80456210a7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:53.693374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9c1d5-3b0a-4c1e-b2f6-6dfda71c6e22 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:53.732956 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e2886-a672-4313-af22-e96777b17dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:53.734506 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e2886-a672-4313-af22-e96777b17dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:53.734992 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e2886-a672-4313-af22-e96777b17dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:53.735532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e2886-a672-4313-af22-e96777b17dd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:53.736627 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e2886-a672-4313-af22-e96777b17dd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:53.737156 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e2886-a672-4313-af22-e96777b17dd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:53.739544 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e2886-a672-4313-af22-e96777b17dd3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:53.754793 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 350/695] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:20:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:53.756761 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30808a7-d1c7-4ce8-af53-711f064f62a3 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:53.757288 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30808a7-d1c7-4ce8-af53-711f064f62a3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:53.757762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30808a7-d1c7-4ce8-af53-711f064f62a3 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:53.759984 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 351/696] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:53.761221 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30808a7-d1c7-4ce8-af53-711f064f62a3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:53.810790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228139ac-cf8a-440f-b81c-039e9ca57718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:53.811658 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228139ac-cf8a-440f-b81c-039e9ca57718 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:53.812049 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228139ac-cf8a-440f-b81c-039e9ca57718 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:53.812336 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228139ac-cf8a-440f-b81c-039e9ca57718 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:53.821097 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228139ac-cf8a-440f-b81c-039e9ca57718 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:53.823073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228139ac-cf8a-440f-b81c-039e9ca57718 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:53.835396 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:53.842219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-228139ac-cf8a-440f-b81c-039e9ca57718 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 16:20:53.842219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:53.842219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:53.842219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:53.842219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:53.842219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:53.842219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:53.842219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:53.842219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:53.842219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:53.842219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:53.842219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:53.842219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:20:53.842219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:20:53.842219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:20:53.842219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:20:53.843419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:53.843419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:53.843419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:20:53.843419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:53.843419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:20:53.843419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:53.843419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:53.843419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:53.843419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:53.843419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:53.843419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:53.843419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:53.843419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:53.843419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:53.843419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:53.843419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:53.843419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:53.843419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:53.844590 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:53.844590 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:53.844590 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:20:53.844590 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:20:53.844590 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:20:53.844590 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:20:53.844590 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:20:53.844590 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:20:53.844590 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 16:20:53.844590 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:53.848368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 346/697] 10.222.0.41 () {56 vars in 1093 bytes} [Fri May 27 16:20:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:53.850420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164cfff-3474-4af1-8636-58011f52c8cf None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:53.850713 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164cfff-3474-4af1-8636-58011f52c8cf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:53.850989 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164cfff-3474-4af1-8636-58011f52c8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:53.871231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3164cfff-3474-4af1-8636-58011f52c8cf None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:53.872755 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3164cfff-3474-4af1-8636-58011f52c8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:53.891621 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30808a7-d1c7-4ce8-af53-711f064f62a3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:53.937046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3c141-9610-4a43-8d89-128f86af4266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:53.937965 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3c141-9610-4a43-8d89-128f86af4266 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:53.938399 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3c141-9610-4a43-8d89-128f86af4266 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:53.938816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3c141-9610-4a43-8d89-128f86af4266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:53.940230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3c141-9610-4a43-8d89-128f86af4266 None admin] RBAC: Adding query filter params (role.id=acbb2252c9f54cf8b789aa80f0a1fe85, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=dbfcca96ad754692b3fb7f891013dafb) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:53.941011 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3c141-9610-4a43-8d89-128f86af4266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:53.943101 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3c141-9610-4a43-8d89-128f86af4266 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:53.956455 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 352/698] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:20:53 2022] GET /identity/v3/role_assignments?user.id=dbfcca96ad754692b3fb7f891013dafb&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=acbb2252c9f54cf8b789aa80f0a1fe85 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:53.957061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3c141-9610-4a43-8d89-128f86af4266 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:53.962487 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 347/699] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:54.008544 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164cfff-3474-4af1-8636-58011f52c8cf None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:54.102957 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:54.150982 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3c141-9610-4a43-8d89-128f86af4266 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:54.192628 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:54.203908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183a1ae-0bcb-4a4e-a10b-944e126adfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:54.204988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183a1ae-0bcb-4a4e-a10b-944e126adfae None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:54.205353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183a1ae-0bcb-4a4e-a10b-944e126adfae None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:54.205689 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183a1ae-0bcb-4a4e-a10b-944e126adfae None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:54.207381 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183a1ae-0bcb-4a4e-a10b-944e126adfae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:54.207566 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183a1ae-0bcb-4a4e-a10b-944e126adfae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:54.209627 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183a1ae-0bcb-4a4e-a10b-944e126adfae None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:54.237049 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 353/700] 10.222.0.41 () {56 vars in 1133 bytes} [Fri May 27 16:20:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:54.238876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183a1ae-0bcb-4a4e-a10b-944e126adfae None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:54.282078 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164cfff-3474-4af1-8636-58011f52c8cf None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:54.331207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfdff8-3b5e-4d5d-bb95-2689d12fa7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:54.332705 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfdff8-3b5e-4d5d-bb95-2689d12fa7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:54.333217 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfdff8-3b5e-4d5d-bb95-2689d12fa7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:54.333705 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfdff8-3b5e-4d5d-bb95-2689d12fa7a2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:54.334578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfdff8-3b5e-4d5d-bb95-2689d12fa7a2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:54.336229 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfdff8-3b5e-4d5d-bb95-2689d12fa7a2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:54.354265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e1cfdff8-3b5e-4d5d-bb95-2689d12fa7a2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 16:20:54.354265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:54.354265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:20:54.354265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:20:54.354265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:20:54.354265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:20:54.354265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:20:54.354265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:20:54.354265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 16:20:54.354265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:54.354265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:20:54.354265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:54.354265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:54.354265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:54.354265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:54.354265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:54.355347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:54.355347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:54.355347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:54.355347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:54.355347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:54.355347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:54.355347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:54.355347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:20:54.355347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:20:54.355347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:20:54.355347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:20:54.355347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:54.355347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:54.355347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:54.355347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:54.355347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:54.356233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:54.356233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:54.356233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:54.356233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:54.356233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:54.356233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:54.356233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:54.356233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:54.356233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:54.356233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:54.356233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:54.356233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:20:54.356233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:20:54.356233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 16:20:54.356233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:54.359436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 348/701] 10.222.0.41 () {56 vars in 1129 bytes} [Fri May 27 16:20:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:54.360990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183a1ae-0bcb-4a4e-a10b-944e126adfae None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:54.367753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfdff8-3b5e-4d5d-bb95-2689d12fa7a2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:54.409055 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d68692-a968-4b7b-93aa-abda92944abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:54.410550 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d68692-a968-4b7b-93aa-abda92944abd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:54.411278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d68692-a968-4b7b-93aa-abda92944abd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:54.412254 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d68692-a968-4b7b-93aa-abda92944abd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:54.496688 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:54.502797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfdff8-3b5e-4d5d-bb95-2689d12fa7a2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:54.513628 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d68692-a968-4b7b-93aa-abda92944abd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:54.515186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d68692-a968-4b7b-93aa-abda92944abd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:54.520517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:54.552358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1484cb8-ce85-42f2-8a38-4524a1d31ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:54.553149 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1484cb8-ce85-42f2-8a38-4524a1d31ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:54.553491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1484cb8-ce85-42f2-8a38-4524a1d31ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:54.553941 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1484cb8-ce85-42f2-8a38-4524a1d31ab9 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:54.555019 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1484cb8-ce85-42f2-8a38-4524a1d31ab9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:54.555400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1484cb8-ce85-42f2-8a38-4524a1d31ab9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:54.557057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1484cb8-ce85-42f2-8a38-4524a1d31ab9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:54.566488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 349/702] 10.222.0.41 () {56 vars in 1124 bytes} [Fri May 27 16:20:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:54.572589 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1484cb8-ce85-42f2-8a38-4524a1d31ab9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:54.643564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 354/703] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:54.649006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d68692-a968-4b7b-93aa-abda92944abd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:54.703747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1484cb8-ce85-42f2-8a38-4524a1d31ab9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:54.740955 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9da60-d8cd-4f8c-8c92-6f8b4156b53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:54.741872 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9da60-d8cd-4f8c-8c92-6f8b4156b53e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:54.741985 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9da60-d8cd-4f8c-8c92-6f8b4156b53e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:54.742209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9da60-d8cd-4f8c-8c92-6f8b4156b53e None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:54.742925 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9da60-d8cd-4f8c-8c92-6f8b4156b53e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:54.743233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9da60-d8cd-4f8c-8c92-6f8b4156b53e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:54.744788 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9da60-d8cd-4f8c-8c92-6f8b4156b53e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:54.750972 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:54.751588 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 350/704] 10.222.0.41 () {56 vars in 1124 bytes} [Fri May 27 16:20:54 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:54.778036 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d68692-a968-4b7b-93aa-abda92944abd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:54.827933 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce71e6-037b-418c-95b3-2ce593ace085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:54.829226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce71e6-037b-418c-95b3-2ce593ace085 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:54.830070 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce71e6-037b-418c-95b3-2ce593ace085 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:54.830537 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce71e6-037b-418c-95b3-2ce593ace085 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:54.849881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce71e6-037b-418c-95b3-2ce593ace085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:54.851791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce71e6-037b-418c-95b3-2ce593ace085 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:54.882110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-bfce71e6-037b-418c-95b3-2ce593ace085 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:54.882110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:54.882110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:54.882110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:54.882110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:54.882110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:54.882110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:54.882110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:54.882110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:54.882110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:54.882110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:54.882110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:54.882110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:54.882110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:54.882110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:54.883127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:54.883127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:54.883127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:54.883127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:54.883127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:54.883127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:54.883127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:54.883127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:54.883127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:54.883127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:54.883127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:54.883127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:54.883127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:54.883127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:54.883127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:54.883127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:54.883127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:54.884132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:54.884132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:54.884132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:54.884132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:54.886621 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 355/705] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:54.892162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9da60-d8cd-4f8c-8c92-6f8b4156b53e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:54.999561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:55.108937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9da60-d8cd-4f8c-8c92-6f8b4156b53e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:55.179388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998105b8-a47e-483f-a37a-732f63577c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:55.180509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998105b8-a47e-483f-a37a-732f63577c51 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:55.180993 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998105b8-a47e-483f-a37a-732f63577c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:55.181459 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998105b8-a47e-483f-a37a-732f63577c51 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:55.182760 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998105b8-a47e-483f-a37a-732f63577c51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:55.183288 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998105b8-a47e-483f-a37a-732f63577c51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:55.185871 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998105b8-a47e-483f-a37a-732f63577c51 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:55.206909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 351/706] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:55.212195 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce71e6-037b-418c-95b3-2ce593ace085 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:55.223298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02925a58-76e6-4da8-86c7-d13c8a768fe2 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:55.223582 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02925a58-76e6-4da8-86c7-d13c8a768fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:55.223857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02925a58-76e6-4da8-86c7-d13c8a768fe2 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:55.226518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 352/707] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:20:55.234467 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b6405-11a8-4d96-9421-cd872e84adac None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:55.234467 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b6405-11a8-4d96-9421-cd872e84adac None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:55.234691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b6405-11a8-4d96-9421-cd872e84adac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:55.272805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d18b6405-11a8-4d96-9421-cd872e84adac None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:55.276017 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d18b6405-11a8-4d96-9421-cd872e84adac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:55.428847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 353/708] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:55.509008 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b6405-11a8-4d96-9421-cd872e84adac None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:55.568405 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:55.627215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce71e6-037b-418c-95b3-2ce593ace085 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:55.672325 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b889c-9642-44d1-89ad-d7385ba63f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:55.673145 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b889c-9642-44d1-89ad-d7385ba63f1b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:55.673422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b889c-9642-44d1-89ad-d7385ba63f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:55.674943 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b889c-9642-44d1-89ad-d7385ba63f1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:55.679290 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:55.691324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b889c-9642-44d1-89ad-d7385ba63f1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:55.692481 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b889c-9642-44d1-89ad-d7385ba63f1b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:55.720093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-123b889c-9642-44d1-89ad-d7385ba63f1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:55.720093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:55.720093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:55.720093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:55.720093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:55.720093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:55.720093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:55.720093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:55.720093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:55.720093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:55.720093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:55.720093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:55.720093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:20:55.720093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:20:55.720093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:20:55.721102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:20:55.721102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:55.721102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:55.721102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:55.721102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:55.721102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:55.721102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:55.721102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:55.721102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:55.721102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:55.721102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:55.721102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:55.721102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:55.721102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:55.721102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:55.721102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:55.721102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:55.722638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:20:55.722638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:20:55.722638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:20:55.722638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:20:55.722638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:20:55.722638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:20:55.722638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:20:55.722638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:55.723685 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 356/709] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 511 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:55.733678 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b889c-9642-44d1-89ad-d7385ba63f1b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:55.741942 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b6405-11a8-4d96-9421-cd872e84adac None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:55.781818 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd070b-6b51-4688-acff-c669bbc35e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:55.783887 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd070b-6b51-4688-acff-c669bbc35e7f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:55.786526 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd070b-6b51-4688-acff-c669bbc35e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:55.787025 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd070b-6b51-4688-acff-c669bbc35e7f None admin] PATH_INFO: `/v3/services/network` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:55.787896 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd070b-6b51-4688-acff-c669bbc35e7f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:55.790919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd070b-6b51-4688-acff-c669bbc35e7f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:55.809571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a2cd070b-6b51-4688-acff-c669bbc35e7f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 16:20:55.809571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:55.809571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:20:55.809571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:20:55.809571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:20:55.809571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:20:55.809571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:20:55.809571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:20:55.809571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 16:20:55.809571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:55.809571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:20:55.809571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:55.809571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:55.809571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:55.809571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:55.809571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:55.809571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:55.810610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:55.810610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:55.810610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:55.810610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:55.810610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:55.810610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:55.810610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:20:55.810610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:20:55.810610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:20:55.810610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:20:55.810610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:55.810610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:55.810610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:55.810610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:55.810610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:55.810610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:55.811478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:55.811478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:55.811478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:55.811478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:55.811478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:55.811478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:55.811478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:55.811478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:55.811478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:55.811478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:55.811478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:20:55.811478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:20:55.811478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 16:20:55.811478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:55.824236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 354/710] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:20:55 2022] GET /identity/v3/services/network => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:55.833220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd070b-6b51-4688-acff-c669bbc35e7f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:55.919764 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b889c-9642-44d1-89ad-d7385ba63f1b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:55.958669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c4795-6e31-4845-a910-b9eb398a535a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:55.959728 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c4795-6e31-4845-a910-b9eb398a535a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:55.960349 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c4795-6e31-4845-a910-b9eb398a535a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:55.960841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c4795-6e31-4845-a910-b9eb398a535a None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:55.961888 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c4795-6e31-4845-a910-b9eb398a535a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:55.962432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c4795-6e31-4845-a910-b9eb398a535a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:55.964210 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c4795-6e31-4845-a910-b9eb398a535a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:55.971037 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:55.984047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 357/711] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:20:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:55.984047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f5716-5398-4c5d-9167-b429ae09444d None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:55.984047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f5716-5398-4c5d-9167-b429ae09444d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:55.984047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f5716-5398-4c5d-9167-b429ae09444d None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:55.988705 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 358/712] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:55.989700 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f5716-5398-4c5d-9167-b429ae09444d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:55.991268 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd070b-6b51-4688-acff-c669bbc35e7f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:56.038429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8069da-557d-490b-b273-429824a140b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:56.039535 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8069da-557d-490b-b273-429824a140b0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:56.040595 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8069da-557d-490b-b273-429824a140b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:56.041129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8069da-557d-490b-b273-429824a140b0 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:56.042094 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8069da-557d-490b-b273-429824a140b0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:56.043015 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8069da-557d-490b-b273-429824a140b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:56.045028 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8069da-557d-490b-b273-429824a140b0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:56.057044 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 355/713] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 16:20:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:20:56.058436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35211ca1-4429-450d-b7f1-f6a43d205b06 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:56.058725 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35211ca1-4429-450d-b7f1-f6a43d205b06 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:56.059001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35211ca1-4429-450d-b7f1-f6a43d205b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:56.063862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:56.078754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-35211ca1-4429-450d-b7f1-f6a43d205b06 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:56.080264 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-35211ca1-4429-450d-b7f1-f6a43d205b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:56.127968 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f5716-5398-4c5d-9167-b429ae09444d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:56.164448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 356/714] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:56.165411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35211ca1-4429-450d-b7f1-f6a43d205b06 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:56.168852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978d9a0-a9aa-4b9a-ba30-9b241108bfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:56.169758 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978d9a0-a9aa-4b9a-ba30-9b241108bfc1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:56.170256 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978d9a0-a9aa-4b9a-ba30-9b241108bfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:56.170725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978d9a0-a9aa-4b9a-ba30-9b241108bfc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:56.171745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978d9a0-a9aa-4b9a-ba30-9b241108bfc1 None admin] RBAC: Adding query filter params (role.id=e1e39192d3af465aa504728e32ab7cd2, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=3caa3dbc7bd24ebba28296a1eba9cefe) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:56.172306 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978d9a0-a9aa-4b9a-ba30-9b241108bfc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:56.173961 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978d9a0-a9aa-4b9a-ba30-9b241108bfc1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:56.188163 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 359/715] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:20:55 2022] GET /identity/v3/role_assignments?user.id=3caa3dbc7bd24ebba28296a1eba9cefe&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:56.208362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978d9a0-a9aa-4b9a-ba30-9b241108bfc1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:56.262522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:56.281098 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35211ca1-4429-450d-b7f1-f6a43d205b06 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:56.320162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395d736-cb4e-4292-85b1-64575d4a21cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:56.321384 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395d736-cb4e-4292-85b1-64575d4a21cb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:56.321876 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395d736-cb4e-4292-85b1-64575d4a21cb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:56.322351 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395d736-cb4e-4292-85b1-64575d4a21cb None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:56.323308 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395d736-cb4e-4292-85b1-64575d4a21cb None admin] RBAC: Adding query filter params (type=network) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:56.323908 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395d736-cb4e-4292-85b1-64575d4a21cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:56.325638 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395d736-cb4e-4292-85b1-64575d4a21cb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:56.332136 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 357/716] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 16:20:56 2022] GET /identity/v3/services?type=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:56.418120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978d9a0-a9aa-4b9a-ba30-9b241108bfc1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:56.448602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:56.479141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d23a8-3901-428e-a76e-19e0bed43fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:56.479979 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d23a8-3901-428e-a76e-19e0bed43fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:56.480293 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d23a8-3901-428e-a76e-19e0bed43fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:56.480572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d23a8-3901-428e-a76e-19e0bed43fa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:56.502584 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d23a8-3901-428e-a76e-19e0bed43fa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:56.504265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d23a8-3901-428e-a76e-19e0bed43fa4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:56.529611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-fc7d23a8-3901-428e-a76e-19e0bed43fa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:56.529611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:56.529611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:56.529611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:56.529611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:56.529611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:56.529611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:56.529611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:56.529611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:56.529611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:56.529611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:56.529611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:56.529611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:56.529611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:56.529611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:56.530563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:56.530563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:56.530563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:56.530563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:56.530563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:56.530563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:56.530563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:56.530563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:56.530563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:56.530563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:56.530563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:56.530563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:56.530563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:56.530563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:56.530563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:56.530563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:56.530563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:56.531513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:56.531513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:56.531513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:56.531513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:56.531513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 360/717] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:56.537369 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395d736-cb4e-4292-85b1-64575d4a21cb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:56.659936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395d736-cb4e-4292-85b1-64575d4a21cb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:56.699499 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bcdfc-17ce-47e0-a05c-5823f210cdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:56.700579 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bcdfc-17ce-47e0-a05c-5823f210cdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:56.701058 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bcdfc-17ce-47e0-a05c-5823f210cdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:56.701546 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bcdfc-17ce-47e0-a05c-5823f210cdd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:56.702492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bcdfc-17ce-47e0-a05c-5823f210cdd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:56.702993 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bcdfc-17ce-47e0-a05c-5823f210cdd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:56.704968 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bcdfc-17ce-47e0-a05c-5823f210cdd1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:56.718990 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 358/718] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:56.724571 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d23a8-3901-428e-a76e-19e0bed43fa4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:56.885001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d23a8-3901-428e-a76e-19e0bed43fa4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:56.928528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10966c79-aa0f-42fe-b060-dfc536be37f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:56.929295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10966c79-aa0f-42fe-b060-dfc536be37f1 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:56.929464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10966c79-aa0f-42fe-b060-dfc536be37f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:56.929735 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10966c79-aa0f-42fe-b060-dfc536be37f1 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:56.930439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10966c79-aa0f-42fe-b060-dfc536be37f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:56.931879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10966c79-aa0f-42fe-b060-dfc536be37f1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:56.956745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 361/719] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 16:20:56 2022] POST /identity/v3/users => generated 254 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:20:57.476795 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854a774-ae44-4175-91cc-c6170ae4b663 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:57.477861 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854a774-ae44-4175-91cc-c6170ae4b663 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:57.478350 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854a774-ae44-4175-91cc-c6170ae4b663 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:57.480239 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 359/720] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:57.486389 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebfeee-75e9-4e4b-80a9-8f0b7956fa1f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:57.486970 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebfeee-75e9-4e4b-80a9-8f0b7956fa1f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:57.487702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebfeee-75e9-4e4b-80a9-8f0b7956fa1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:57.508157 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-14ebfeee-75e9-4e4b-80a9-8f0b7956fa1f None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:57.509692 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-14ebfeee-75e9-4e4b-80a9-8f0b7956fa1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:57.538321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:57.601542 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 362/721] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:20:57.624664 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854a774-ae44-4175-91cc-c6170ae4b663 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:57.638897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:57.654726 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b8b75-73f5-4e33-b6d5-7e8c8e402100 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:57.655019 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b8b75-73f5-4e33-b6d5-7e8c8e402100 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:57.655301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b8b75-73f5-4e33-b6d5-7e8c8e402100 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:57.657066 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 363/722] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:57.664439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39049e-d2b0-45ea-8297-b96c8a04c0f2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:57.664716 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39049e-d2b0-45ea-8297-b96c8a04c0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:57.664987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39049e-d2b0-45ea-8297-b96c8a04c0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:57.686305 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3e39049e-d2b0-45ea-8297-b96c8a04c0f2 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:57.688003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3e39049e-d2b0-45ea-8297-b96c8a04c0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:57.782168 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854a774-ae44-4175-91cc-c6170ae4b663 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:57.805790 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 364/723] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 16:20:57.833011 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39049e-d2b0-45ea-8297-b96c8a04c0f2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:57.863169 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c44ab8-603e-4bc3-b484-bb7074c33f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:57.864611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c44ab8-603e-4bc3-b484-bb7074c33f32 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:57.865231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c44ab8-603e-4bc3-b484-bb7074c33f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:57.865988 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c44ab8-603e-4bc3-b484-bb7074c33f32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:57.894178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c44ab8-603e-4bc3-b484-bb7074c33f32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:57.909343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c1c44ab8-603e-4bc3-b484-bb7074c33f32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:20:57.909343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:57.909343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:57.909343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:57.909343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:57.909343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:57.909343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:57.909343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:57.909343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:57.909343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:57.909343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:57.909343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:57.909343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:57.909343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:57.909343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:57.909343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:57.910716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:57.910716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:57.910716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:57.910716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:57.910716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:57.910716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:57.910716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:57.910716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:57.910716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:57.910716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:57.910716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:57.910716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:57.910716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:57.910716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:57.910716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:57.910716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:57.911780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:57.911780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:57.911780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:57.911780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:57.911780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:57.911780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:57.911780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:57.911780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:57.911780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:57.911780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:57.911780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:20:57.911780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:57.917217 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 360/724] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:20:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:57.925360 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c44ab8-603e-4bc3-b484-bb7074c33f32 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:57.951687 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:57.977695 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39049e-d2b0-45ea-8297-b96c8a04c0f2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:58.054352 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9723eae-6a94-40ba-90af-84ad36838e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:58.055172 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9723eae-6a94-40ba-90af-84ad36838e58 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:58.055451 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9723eae-6a94-40ba-90af-84ad36838e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:58.055729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9723eae-6a94-40ba-90af-84ad36838e58 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:58.056600 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9723eae-6a94-40ba-90af-84ad36838e58 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:58.058681 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9723eae-6a94-40ba-90af-84ad36838e58 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:58.080037 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:58.085024 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 365/725] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 16:20:57 2022] POST /identity/v3/services => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:20:58.146296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c44ab8-603e-4bc3-b484-bb7074c33f32 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:58.205811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46881335-b778-474d-8c47-6ad54e8ea129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:58.206617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46881335-b778-474d-8c47-6ad54e8ea129 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:58.206870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46881335-b778-474d-8c47-6ad54e8ea129 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:58.207084 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46881335-b778-474d-8c47-6ad54e8ea129 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:58.207812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46881335-b778-474d-8c47-6ad54e8ea129 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:58.208160 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46881335-b778-474d-8c47-6ad54e8ea129 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:58.209567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46881335-b778-474d-8c47-6ad54e8ea129 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:58.227300 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 361/726] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:58.234045 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9723eae-6a94-40ba-90af-84ad36838e58 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:58.374726 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9723eae-6a94-40ba-90af-84ad36838e58 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:58.411570 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea6898-fbde-4e0a-be95-b5a4541b7451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:58.412413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea6898-fbde-4e0a-be95-b5a4541b7451 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:58.412694 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea6898-fbde-4e0a-be95-b5a4541b7451 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:58.412967 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea6898-fbde-4e0a-be95-b5a4541b7451 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:58.423697 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea6898-fbde-4e0a-be95-b5a4541b7451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:58.425751 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea6898-fbde-4e0a-be95-b5a4541b7451 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:58.434973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:58.445439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-3dea6898-fbde-4e0a-be95-b5a4541b7451 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:58.445439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:58.445439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:58.445439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:58.445439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:58.445439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:58.445439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:58.445439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:58.445439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:58.445439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:58.445439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:58.445439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:58.445439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:58.445439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:58.445439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:58.447548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:58.447548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:58.447548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:58.447548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:58.447548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:58.447548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:58.447548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:58.447548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:58.447548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:58.447548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:58.447548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:58.447548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:58.447548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:58.447548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:58.447548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:58.447548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:58.447548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:58.450661 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:58.450661 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:58.450661 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:58.450661 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:58.450661 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 366/727] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:58.457369 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46881335-b778-474d-8c47-6ad54e8ea129 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:58.569700 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46881335-b778-474d-8c47-6ad54e8ea129 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:58.601367 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:58.610821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5ff03-4f02-4815-b867-b80bd86f8681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:58.611772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5ff03-4f02-4815-b867-b80bd86f8681 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:58.612348 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5ff03-4f02-4815-b867-b80bd86f8681 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:58.613045 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5ff03-4f02-4815-b867-b80bd86f8681 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:58.614076 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5ff03-4f02-4815-b867-b80bd86f8681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:58.614565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5ff03-4f02-4815-b867-b80bd86f8681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:58.616200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5ff03-4f02-4815-b867-b80bd86f8681 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:58.631251 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 362/728] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:58.636414 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea6898-fbde-4e0a-be95-b5a4541b7451 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:58.812593 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea6898-fbde-4e0a-be95-b5a4541b7451 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:58.861809 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303784f-ecd6-4d30-956c-ce8d42980cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:58.863350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303784f-ecd6-4d30-956c-ce8d42980cae None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:58.863825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303784f-ecd6-4d30-956c-ce8d42980cae None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:58.864297 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303784f-ecd6-4d30-956c-ce8d42980cae None admin] PATH_INFO: `/v3/users/swift` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:58.872745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303784f-ecd6-4d30-956c-ce8d42980cae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:58.874703 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303784f-ecd6-4d30-956c-ce8d42980cae None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:58.891161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-2303784f-ecd6-4d30-956c-ce8d42980cae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 16:20:58.891161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:58.891161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:58.891161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:58.891161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:58.891161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:58.891161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:58.891161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:58.891161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:58.891161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:58.891161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:58.891161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:58.891161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:20:58.891161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:20:58.891161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:20:58.891161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:20:58.892255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:58.892255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:58.892255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:20:58.892255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:58.892255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:20:58.892255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:20:58.892255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:58.892255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:58.892255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:58.892255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:58.892255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:58.892255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:58.892255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:58.892255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:58.892255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:58.892255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:58.892255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:58.892255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:58.893227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:58.893227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:58.893227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:20:58.893227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:20:58.893227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:20:58.893227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:20:58.893227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:20:58.893227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:20:58.893227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 16:20:58.893227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:58.896219 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 367/729] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:20:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:58.905446 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5ff03-4f02-4815-b867-b80bd86f8681 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:59.050302 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5ff03-4f02-4815-b867-b80bd86f8681 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:59.098554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380060a4-1385-48a1-bdf7-f596a4feb150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:59.099492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380060a4-1385-48a1-bdf7-f596a4feb150 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:59.099918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380060a4-1385-48a1-bdf7-f596a4feb150 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:59.100387 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380060a4-1385-48a1-bdf7-f596a4feb150 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:59.101386 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380060a4-1385-48a1-bdf7-f596a4feb150 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:59.101851 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380060a4-1385-48a1-bdf7-f596a4feb150 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:59.103499 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380060a4-1385-48a1-bdf7-f596a4feb150 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:59.139050 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 363/730] 10.222.0.41 () {56 vars in 1135 bytes} [Fri May 27 16:20:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:59.145074 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303784f-ecd6-4d30-956c-ce8d42980cae None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:59.168573 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434c67d-50f8-4aa6-83ae-8ca1a60216df None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:59.168812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434c67d-50f8-4aa6-83ae-8ca1a60216df None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:59.169013 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434c67d-50f8-4aa6-83ae-8ca1a60216df None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:59.170667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 364/731] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:20:59.176486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5da291-a654-4f67-9c15-408f62caebca None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:59.176769 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5da291-a654-4f67-9c15-408f62caebca None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:59.177046 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5da291-a654-4f67-9c15-408f62caebca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:59.202870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2e5da291-a654-4f67-9c15-408f62caebca None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:59.204113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2e5da291-a654-4f67-9c15-408f62caebca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:59.276397 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:59.283269 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:59.334063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 365/732] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:59.353634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303784f-ecd6-4d30-956c-ce8d42980cae None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:59.366853 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5da291-a654-4f67-9c15-408f62caebca None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:59.413924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b927395-f341-4b3e-9a59-1f352a4145d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:59.414595 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b927395-f341-4b3e-9a59-1f352a4145d5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:59.414982 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b927395-f341-4b3e-9a59-1f352a4145d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:59.415263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b927395-f341-4b3e-9a59-1f352a4145d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:59.488298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5da291-a654-4f67-9c15-408f62caebca None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:59.494679 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b927395-f341-4b3e-9a59-1f352a4145d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:59.496275 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b927395-f341-4b3e-9a59-1f352a4145d5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:59.535276 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca8d3f-afa0-420c-af9c-92c3864e4b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:59.536263 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca8d3f-afa0-420c-af9c-92c3864e4b09 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:59.536649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca8d3f-afa0-420c-af9c-92c3864e4b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:59.536931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca8d3f-afa0-420c-af9c-92c3864e4b09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:59.547999 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca8d3f-afa0-420c-af9c-92c3864e4b09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:20:59.556488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-25ca8d3f-afa0-420c-af9c-92c3864e4b09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:20:59.556488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:59.556488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:59.556488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:59.556488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:59.556488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:59.556488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:59.556488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:59.556488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:59.556488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:59.556488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:59.556488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:59.556488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:20:59.556488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:20:59.556488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:20:59.556488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:20:59.557489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:20:59.557489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:20:59.557489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:20:59.557489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:20:59.557489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:59.557489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:59.557489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:59.557489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:59.557489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:59.557489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:59.557489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:59.557489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:59.557489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:59.557489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:59.557489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:59.557489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:59.559003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:59.559003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:59.559003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:59.559003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:59.559003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:20:59.559003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:20:59.559003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:20:59.559003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:20:59.559003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:20:59.559003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:20:59.559003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:20:59.559003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:59.559003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 366/733] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:20:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:20:59.559727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9385d39-3bbb-4bd9-9133-ca2eb2da0a9e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:59.559727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9385d39-3bbb-4bd9-9133-ca2eb2da0a9e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:59.560102 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9385d39-3bbb-4bd9-9133-ca2eb2da0a9e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:59.562248 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 367/734] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:20:59.563298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9385d39-3bbb-4bd9-9133-ca2eb2da0a9e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:59.567645 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:59.603564 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:59.639823 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 368/735] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:20:59 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 16:20:59.639823 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8353fa-3bd6-42df-a9a6-0be666463654 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:59.639823 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8353fa-3bd6-42df-a9a6-0be666463654 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:59.639823 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8353fa-3bd6-42df-a9a6-0be666463654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:59.659938 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6e8353fa-3bd6-42df-a9a6-0be666463654 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:20:59.660901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6e8353fa-3bd6-42df-a9a6-0be666463654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:20:59.688456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9385d39-3bbb-4bd9-9133-ca2eb2da0a9e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:59.728522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31c77e-ea11-47e1-ada7-17de95a7acac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:59.729881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31c77e-ea11-47e1-ada7-17de95a7acac None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:59.730401 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31c77e-ea11-47e1-ada7-17de95a7acac None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:59.730895 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31c77e-ea11-47e1-ada7-17de95a7acac None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:59.731005 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 369/736] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:20:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 16:20:59.731836 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8353fa-3bd6-42df-a9a6-0be666463654 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:59.732391 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31c77e-ea11-47e1-ada7-17de95a7acac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:20:59.732935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31c77e-ea11-47e1-ada7-17de95a7acac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:59.734783 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31c77e-ea11-47e1-ada7-17de95a7acac None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:59.746399 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 368/737] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:20:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:20:59.753403 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31c77e-ea11-47e1-ada7-17de95a7acac None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:59.825337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:59.839323 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8353fa-3bd6-42df-a9a6-0be666463654 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:59.873378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:20:59.875923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef4096-ef14-43b4-9013-feff6923fdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:59.877037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef4096-ef14-43b4-9013-feff6923fdfb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:59.877381 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef4096-ef14-43b4-9013-feff6923fdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:59.877829 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef4096-ef14-43b4-9013-feff6923fdfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:59.879315 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31c77e-ea11-47e1-ada7-17de95a7acac None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:20:59.889819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef4096-ef14-43b4-9013-feff6923fdfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:59.891639 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef4096-ef14-43b4-9013-feff6923fdfb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:59.911228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-67ef4096-ef14-43b4-9013-feff6923fdfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:59.911228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:59.911228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:59.911228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:59.911228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:59.911228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:59.911228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:59.911228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:59.911228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:59.911228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:59.911228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:59.911228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:59.911228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:59.911228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:59.911228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:59.912257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:59.912257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:59.912257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:59.912257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:59.912257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:59.912257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:59.912257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:59.912257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:59.912257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:20:59.912257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:59.912257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:59.912257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:59.912257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:59.912257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:59.912257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:59.912257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:59.912257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:59.913191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:59.913191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:59.913191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:59.913191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:20:59.917383 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 370/738] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:59.918404 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef4096-ef14-43b4-9013-feff6923fdfb None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:20:59.919633 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae927f-7b0b-4f1b-9fba-91303a7143b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:20:59.920714 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae927f-7b0b-4f1b-9fba-91303a7143b4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:20:59.921370 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae927f-7b0b-4f1b-9fba-91303a7143b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:20:59.921823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae927f-7b0b-4f1b-9fba-91303a7143b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:20:59.934380 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae927f-7b0b-4f1b-9fba-91303a7143b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:20:59.936482 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae927f-7b0b-4f1b-9fba-91303a7143b4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:20:59.957436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d5ae927f-7b0b-4f1b-9fba-91303a7143b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:59.957436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:20:59.957436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:20:59.957436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:20:59.957436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:20:59.957436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:20:59.957436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:20:59.957436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:20:59.957436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:20:59.957436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:20:59.957436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:20:59.957436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:20:59.957436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:20:59.957436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:20:59.957436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:20:59.958415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:20:59.958415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:20:59.958415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:20:59.958415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:20:59.958415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:20:59.958415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:20:59.958415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:20:59.958415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:20:59.958415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:20:59.958415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:20:59.958415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:20:59.958415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:20:59.958415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:20:59.958415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:20:59.958415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:20:59.958415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:20:59.958415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:20:59.959328 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:20:59.959328 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:20:59.959328 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:20:59.959328 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:20:59.965435 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 369/739] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:20:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:20:59.965435 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae927f-7b0b-4f1b-9fba-91303a7143b4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:00.035156 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef4096-ef14-43b4-9013-feff6923fdfb None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:00.073481 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaa60e-2e98-465c-ba47-b54e7443d58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:00.074158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaa60e-2e98-465c-ba47-b54e7443d58b None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:00.074442 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaa60e-2e98-465c-ba47-b54e7443d58b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:00.074715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaa60e-2e98-465c-ba47-b54e7443d58b None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:00.075438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eaa60e-2e98-465c-ba47-b54e7443d58b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:00.075911 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae927f-7b0b-4f1b-9fba-91303a7143b4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:00.076953 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eaa60e-2e98-465c-ba47-b54e7443d58b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:00.087269 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:00.100214 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 371/740] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 16:20:59 2022] POST /identity/v3/services => generated 240 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:21:00.102764 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17590407-144d-4043-8873-2f9ea2a8dcfe None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:00.103054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17590407-144d-4043-8873-2f9ea2a8dcfe None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:00.103330 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17590407-144d-4043-8873-2f9ea2a8dcfe None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:00.108205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 372/741] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:00.109274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17590407-144d-4043-8873-2f9ea2a8dcfe None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:00.127895 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc982d25-128f-4d9f-adab-379feb0f970f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:00.128888 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc982d25-128f-4d9f-adab-379feb0f970f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:00.129179 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc982d25-128f-4d9f-adab-379feb0f970f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:00.129458 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc982d25-128f-4d9f-adab-379feb0f970f None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:00.130198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc982d25-128f-4d9f-adab-379feb0f970f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:00.130596 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc982d25-128f-4d9f-adab-379feb0f970f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:00.132266 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc982d25-128f-4d9f-adab-379feb0f970f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:00.153298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 370/742] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:00.153298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345bfd5-7792-47c9-8e63-2303cba0f7ff None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:00.153298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345bfd5-7792-47c9-8e63-2303cba0f7ff None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:00.153298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345bfd5-7792-47c9-8e63-2303cba0f7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:00.163546 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:00.170601 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a345bfd5-7792-47c9-8e63-2303cba0f7ff None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:00.171948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a345bfd5-7792-47c9-8e63-2303cba0f7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:00.242355 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17590407-144d-4043-8873-2f9ea2a8dcfe None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:00.257341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 371/743] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:00.258398 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345bfd5-7792-47c9-8e63-2303cba0f7ff None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:00.300849 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce9674-f901-43d2-b73f-9ed6c4511d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:00.302004 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce9674-f901-43d2-b73f-9ed6c4511d8e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:00.302519 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce9674-f901-43d2-b73f-9ed6c4511d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:00.303029 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce9674-f901-43d2-b73f-9ed6c4511d8e None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:00.304055 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce9674-f901-43d2-b73f-9ed6c4511d8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:00.304635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce9674-f901-43d2-b73f-9ed6c4511d8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:00.306635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce9674-f901-43d2-b73f-9ed6c4511d8e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:00.322310 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 373/744] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:00.323683 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce9674-f901-43d2-b73f-9ed6c4511d8e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:00.397422 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345bfd5-7792-47c9-8e63-2303cba0f7ff None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:00.430074 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:00.457343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166d805-500c-41b9-9a15-3663185489c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:00.459088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166d805-500c-41b9-9a15-3663185489c1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:00.459490 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166d805-500c-41b9-9a15-3663185489c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:00.459868 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166d805-500c-41b9-9a15-3663185489c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:00.464246 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:00.471581 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166d805-500c-41b9-9a15-3663185489c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:00.473401 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166d805-500c-41b9-9a15-3663185489c1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:00.489103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce9674-f901-43d2-b73f-9ed6c4511d8e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:00.493549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-c166d805-500c-41b9-9a15-3663185489c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:00.493549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:00.493549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:00.493549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:00.493549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:00.493549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:00.493549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:00.493549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:00.493549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:00.493549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:00.493549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:00.493549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:00.493549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:21:00.493549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:21:00.493549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:21:00.494519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:21:00.494519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:00.494519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:00.494519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:00.494519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:00.494519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:00.494519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:00.494519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:00.494519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:00.494519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:00.494519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:00.494519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:00.494519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:00.494519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:00.494519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:00.494519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:00.494519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:00.495438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:21:00.495438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:21:00.495438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:21:00.495438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:21:00.495438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:21:00.495438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:21:00.495438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:00.495438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:00.499850 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 372/745] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:00.500839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166d805-500c-41b9-9a15-3663185489c1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:00.537026 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71002b0-c3e8-4b4b-b9ca-a9134f970185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:00.538225 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71002b0-c3e8-4b4b-b9ca-a9134f970185 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:00.538706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71002b0-c3e8-4b4b-b9ca-a9134f970185 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:00.539174 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71002b0-c3e8-4b4b-b9ca-a9134f970185 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:00.552487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71002b0-c3e8-4b4b-b9ca-a9134f970185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:21:00.561308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f71002b0-c3e8-4b4b-b9ca-a9134f970185 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:21:00.561308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:00.561308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:00.561308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:00.561308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:00.561308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:00.561308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:00.561308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:00.561308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:00.561308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:00.561308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:00.561308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:00.561308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:21:00.561308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:21:00.561308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:21:00.561308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:21:00.562361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:21:00.562361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:21:00.562361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:21:00.562361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:21:00.562361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:00.562361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:00.562361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:00.562361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:00.562361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:00.562361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:00.562361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:00.562361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:00.562361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:00.562361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:00.562361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:00.562361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:00.563257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:00.563257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:00.563257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:00.563257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:00.563257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:21:00.563257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:21:00.563257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:21:00.563257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:21:00.563257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:21:00.563257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:21:00.563257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:21:00.563257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:00.566896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 374/746] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:21:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:00.573453 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71002b0-c3e8-4b4b-b9ca-a9134f970185 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:00.637213 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166d805-500c-41b9-9a15-3663185489c1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:00.676514 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8c361-1c25-4b7e-80fa-875f10174ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:00.677726 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8c361-1c25-4b7e-80fa-875f10174ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:00.678210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8c361-1c25-4b7e-80fa-875f10174ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:00.678676 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8c361-1c25-4b7e-80fa-875f10174ed8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:00.688782 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8c361-1c25-4b7e-80fa-875f10174ed8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:00.691365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8c361-1c25-4b7e-80fa-875f10174ed8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:00.705624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71002b0-c3e8-4b4b-b9ca-a9134f970185 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:00.707961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-9ad8c361-1c25-4b7e-80fa-875f10174ed8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 16:21:00.707961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:00.707961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:00.707961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:00.707961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:00.707961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:00.707961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:00.707961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:00.707961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:00.707961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:00.707961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:00.707961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:00.707961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:21:00.707961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:21:00.707961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:21:00.707961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:21:00.708960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:00.708960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:00.708960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:21:00.708960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:00.708960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:21:00.708960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:00.708960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:00.708960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:00.708960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:00.708960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:00.708960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:00.708960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:00.708960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:00.708960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:00.708960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:00.708960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:00.708960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:00.708960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:00.709918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:00.709918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:00.709918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:21:00.709918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:21:00.709918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:21:00.709918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:21:00.709918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:21:00.709918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:21:00.709918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 16:21:00.709918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:00.712683 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 373/747] 10.222.0.41 () {56 vars in 1093 bytes} [Fri May 27 16:21:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:00.713801 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8c361-1c25-4b7e-80fa-875f10174ed8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:00.734834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:00.752685 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e890d7-8f68-455c-8e42-8839985a57bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:00.754368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e890d7-8f68-455c-8e42-8839985a57bd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:00.754860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e890d7-8f68-455c-8e42-8839985a57bd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:00.755356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e890d7-8f68-455c-8e42-8839985a57bd None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:00.756434 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e890d7-8f68-455c-8e42-8839985a57bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:00.756945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e890d7-8f68-455c-8e42-8839985a57bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:00.758616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e890d7-8f68-455c-8e42-8839985a57bd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:00.775248 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 375/748] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:21:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:00.777094 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e890d7-8f68-455c-8e42-8839985a57bd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:00.788903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:00.840676 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8c361-1c25-4b7e-80fa-875f10174ed8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:00.876958 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352c82e-e384-4215-b256-f4537e2ceb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:00.878271 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352c82e-e384-4215-b256-f4537e2ceb7e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:00.878653 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352c82e-e384-4215-b256-f4537e2ceb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:00.879078 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352c82e-e384-4215-b256-f4537e2ceb7e None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:00.879846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352c82e-e384-4215-b256-f4537e2ceb7e None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:00.880185 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352c82e-e384-4215-b256-f4537e2ceb7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:00.881611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352c82e-e384-4215-b256-f4537e2ceb7e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:00.890428 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e890d7-8f68-455c-8e42-8839985a57bd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:00.890613 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 374/749] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:21:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:00.891987 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa31aa-3199-4dd0-a649-38922fd0016c None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:00.892307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa31aa-3199-4dd0-a649-38922fd0016c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:00.892587 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa31aa-3199-4dd0-a649-38922fd0016c None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:00.896235 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 375/750] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:00.896235 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa31aa-3199-4dd0-a649-38922fd0016c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:00.939392 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ee92e-7ced-4392-a674-1cf3046c17d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:00.940000 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ee92e-7ced-4392-a674-1cf3046c17d7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:00.940339 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ee92e-7ced-4392-a674-1cf3046c17d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:00.940607 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ee92e-7ced-4392-a674-1cf3046c17d7 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:00.941711 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ee92e-7ced-4392-a674-1cf3046c17d7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:00.942245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ee92e-7ced-4392-a674-1cf3046c17d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:00.945028 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ee92e-7ced-4392-a674-1cf3046c17d7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:00.968515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 376/751] 10.222.0.41 () {56 vars in 1133 bytes} [Fri May 27 16:21:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:00.969841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f05d72-5309-43bd-b4d3-030be7ffbceb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:00.970154 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f05d72-5309-43bd-b4d3-030be7ffbceb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:00.970441 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f05d72-5309-43bd-b4d3-030be7ffbceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:00.988635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-36f05d72-5309-43bd-b4d3-030be7ffbceb None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:00.989844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-36f05d72-5309-43bd-b4d3-030be7ffbceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:01.017304 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa31aa-3199-4dd0-a649-38922fd0016c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:01.021442 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:01.036862 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:01.055268 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb1f5c-a5df-44cd-ba83-ec44b28fd8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:01.055931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb1f5c-a5df-44cd-ba83-ec44b28fd8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:01.056249 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb1f5c-a5df-44cd-ba83-ec44b28fd8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:01.056524 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb1f5c-a5df-44cd-ba83-ec44b28fd8f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:01.057347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb1f5c-a5df-44cd-ba83-ec44b28fd8f3 None admin] RBAC: Adding query filter params (role.id=e1e39192d3af465aa504728e32ab7cd2, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=dbfcca96ad754692b3fb7f891013dafb) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:01.057656 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb1f5c-a5df-44cd-ba83-ec44b28fd8f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:01.059177 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb1f5c-a5df-44cd-ba83-ec44b28fd8f3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:01.062219 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 377/752] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:01.065217 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 376/753] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:21:00 2022] GET /identity/v3/role_assignments?user.id=dbfcca96ad754692b3fb7f891013dafb&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:01.066247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb1f5c-a5df-44cd-ba83-ec44b28fd8f3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:01.068925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f05d72-5309-43bd-b4d3-030be7ffbceb None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:01.193131 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f05d72-5309-43bd-b4d3-030be7ffbceb None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:01.212834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb1f5c-a5df-44cd-ba83-ec44b28fd8f3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:01.234989 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decd205-769a-49d7-95f0-a035ae458362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:01.235909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decd205-769a-49d7-95f0-a035ae458362 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:01.236247 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decd205-769a-49d7-95f0-a035ae458362 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:01.236519 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9decd205-769a-49d7-95f0-a035ae458362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:01.253022 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decd205-769a-49d7-95f0-a035ae458362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:01.254543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9decd205-769a-49d7-95f0-a035ae458362 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:01.258025 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a676ffc-fccd-4ea2-848c-1423d8f695b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:01.259124 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a676ffc-fccd-4ea2-848c-1423d8f695b3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:01.259582 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a676ffc-fccd-4ea2-848c-1423d8f695b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:01.260065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a676ffc-fccd-4ea2-848c-1423d8f695b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:01.272406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a676ffc-fccd-4ea2-848c-1423d8f695b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:01.274248 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a676ffc-fccd-4ea2-848c-1423d8f695b3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:01.277549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-9decd205-769a-49d7-95f0-a035ae458362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:01.277549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:01.277549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:01.277549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:01.277549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:01.277549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:01.277549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:01.277549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:01.277549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:01.277549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:01.277549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:01.277549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:01.277549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:01.277549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:01.277549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:01.278486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:01.278486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:01.278486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:01.278486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:01.278486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:01.278486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:01.278486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:01.278486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:01.278486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:01.278486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:01.278486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:01.278486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:01.278486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:01.278486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:01.278486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:01.278486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:01.278486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:01.279390 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:01.279390 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:01.279390 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:01.279390 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:01.283383 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 378/754] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:01.285012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decd205-769a-49d7-95f0-a035ae458362 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:01.297457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-4a676ffc-fccd-4ea2-848c-1423d8f695b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:01.297457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:01.297457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:01.297457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:01.297457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:01.297457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:01.297457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:01.297457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:01.297457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:01.297457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:01.297457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:01.297457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:01.297457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:01.297457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:01.297457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:01.298411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:01.298411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:01.298411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:01.298411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:01.298411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:01.298411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:01.298411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:01.298411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:01.298411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:01.298411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:01.298411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:01.298411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:01.298411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:01.298411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:01.298411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:01.298411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:01.298411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:01.299349 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:01.299349 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:01.299349 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:01.299349 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:01.299349 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 377/755] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:01.299705 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a676ffc-fccd-4ea2-848c-1423d8f695b3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:01.321470 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:01.336962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:01.413330 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9decd205-769a-49d7-95f0-a035ae458362 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:01.414099 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a676ffc-fccd-4ea2-848c-1423d8f695b3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:01.450766 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5038f80-1bd8-4978-830c-3bd7ee2fc33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:01.450973 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ea27b-ea6a-40e5-b32d-39bb692d64a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:01.451512 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ea27b-ea6a-40e5-b32d-39bb692d64a7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:01.451789 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ea27b-ea6a-40e5-b32d-39bb692d64a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:01.452091 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ea27b-ea6a-40e5-b32d-39bb692d64a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:01.452476 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5038f80-1bd8-4978-830c-3bd7ee2fc33c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:01.452814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ea27b-ea6a-40e5-b32d-39bb692d64a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:01.453050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5038f80-1bd8-4978-830c-3bd7ee2fc33c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:01.453155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ea27b-ea6a-40e5-b32d-39bb692d64a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:01.453562 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5038f80-1bd8-4978-830c-3bd7ee2fc33c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:01.454408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5038f80-1bd8-4978-830c-3bd7ee2fc33c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:01.454516 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ea27b-ea6a-40e5-b32d-39bb692d64a7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:01.456744 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5038f80-1bd8-4978-830c-3bd7ee2fc33c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:01.473012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 378/756] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:01.473012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ea27b-ea6a-40e5-b32d-39bb692d64a7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:01.477155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-b5038f80-1bd8-4978-830c-3bd7ee2fc33c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 16:21:01.477155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:01.477155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:01.477155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:01.477155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:01.477155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:01.477155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:01.477155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:01.477155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 16:21:01.477155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:01.477155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:01.477155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:01.477155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:01.477155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:01.477155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:01.477155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:01.478327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:01.478327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:01.478327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:01.478327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:01.478327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:01.478327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:01.478327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:01.478327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:01.478327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:01.478327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:01.478327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:01.478327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:01.478327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:01.478327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:01.478327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:01.478327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:01.479340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:01.479340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:01.479340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:01.479340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:01.479340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:01.479340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:01.479340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:01.479340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:01.479340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:01.479340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:01.479340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:01.479340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:01.479340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:01.479340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 16:21:01.479340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:01.486817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 379/757] 10.222.0.41 () {56 vars in 1129 bytes} [Fri May 27 16:21:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:01.488193 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5038f80-1bd8-4978-830c-3bd7ee2fc33c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:01.580547 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:01.592987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:01.597120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ea27b-ea6a-40e5-b32d-39bb692d64a7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:01.607132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5038f80-1bd8-4978-830c-3bd7ee2fc33c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:01.635416 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2955bf-c2b9-47bd-8293-dd806ff0d03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:01.636148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2955bf-c2b9-47bd-8293-dd806ff0d03d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:01.636539 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2955bf-c2b9-47bd-8293-dd806ff0d03d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:01.636861 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2955bf-c2b9-47bd-8293-dd806ff0d03d None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:01.637829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2955bf-c2b9-47bd-8293-dd806ff0d03d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:01.638388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2955bf-c2b9-47bd-8293-dd806ff0d03d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:01.639934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2955bf-c2b9-47bd-8293-dd806ff0d03d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:01.646900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04887dc8-68cf-4923-9d9e-2945f7a49569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:01.648126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04887dc8-68cf-4923-9d9e-2945f7a49569 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:01.648552 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04887dc8-68cf-4923-9d9e-2945f7a49569 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:01.649045 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04887dc8-68cf-4923-9d9e-2945f7a49569 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:01.657506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 379/758] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:01.657506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2955bf-c2b9-47bd-8293-dd806ff0d03d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:01.662635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04887dc8-68cf-4923-9d9e-2945f7a49569 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:01.664465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04887dc8-68cf-4923-9d9e-2945f7a49569 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:01.682651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-04887dc8-68cf-4923-9d9e-2945f7a49569 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:21:01.682651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:01.682651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:01.682651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:01.682651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:01.682651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:01.682651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:01.682651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:01.682651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:01.682651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:01.682651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:01.682651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:01.682651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:21:01.682651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:21:01.682651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:21:01.682651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:21:01.683912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:01.683912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:01.683912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:21:01.683912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:01.683912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:21:01.683912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:01.683912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:01.683912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:01.683912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:01.683912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:01.683912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:01.683912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:01.683912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:01.683912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:01.683912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:01.683912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:01.683912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:01.683912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:01.684938 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:01.684938 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:01.684938 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:21:01.684938 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:21:01.684938 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:21:01.684938 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:21:01.684938 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:21:01.684938 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:21:01.684938 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:21:01.684938 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:01.692157 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 380/759] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 16:21:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:01.693434 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04887dc8-68cf-4923-9d9e-2945f7a49569 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:01.764738 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2955bf-c2b9-47bd-8293-dd806ff0d03d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:01.802342 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb81a2-8635-4b6c-8df6-ac88fad7a965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:01.803023 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb81a2-8635-4b6c-8df6-ac88fad7a965 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:01.803303 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb81a2-8635-4b6c-8df6-ac88fad7a965 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:01.803575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb81a2-8635-4b6c-8df6-ac88fad7a965 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:01.804328 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb81a2-8635-4b6c-8df6-ac88fad7a965 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:01.804625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb81a2-8635-4b6c-8df6-ac88fad7a965 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:01.805301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04887dc8-68cf-4923-9d9e-2945f7a49569 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:01.806098 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb81a2-8635-4b6c-8df6-ac88fad7a965 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:01.816785 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 380/760] 10.222.0.41 () {56 vars in 1124 bytes} [Fri May 27 16:21:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:01.816785 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb81a2-8635-4b6c-8df6-ac88fad7a965 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:01.836089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:01.854671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39431a9-6408-4aa2-a1fd-63703e50d7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:01.855916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39431a9-6408-4aa2-a1fd-63703e50d7bf None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:01.856418 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39431a9-6408-4aa2-a1fd-63703e50d7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:01.856837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39431a9-6408-4aa2-a1fd-63703e50d7bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:01.865103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39431a9-6408-4aa2-a1fd-63703e50d7bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:01.866933 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39431a9-6408-4aa2-a1fd-63703e50d7bf None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:01.883155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-d39431a9-6408-4aa2-a1fd-63703e50d7bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:01.883155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:01.883155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:01.883155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:01.883155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:01.883155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:01.883155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:01.883155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:01.883155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:01.883155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:01.883155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:01.883155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:01.883155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:21:01.883155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:21:01.883155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:21:01.884356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:21:01.884356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:01.884356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:01.884356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:01.884356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:01.884356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:01.884356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:01.884356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:01.884356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:01.884356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:01.884356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:01.884356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:01.884356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:01.884356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:01.884356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:01.884356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:01.884356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:01.885516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:21:01.885516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:21:01.885516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:21:01.885516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:21:01.885516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:21:01.885516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:21:01.885516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:01.885516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:01.892396 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 381/761] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:01.893611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39431a9-6408-4aa2-a1fd-63703e50d7bf None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:01.897864 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:01.933170 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb81a2-8635-4b6c-8df6-ac88fad7a965 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:01.972879 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9747588-6bdc-4887-ba83-f0f7aa5ec19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:01.974061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9747588-6bdc-4887-ba83-f0f7aa5ec19a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:01.974676 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9747588-6bdc-4887-ba83-f0f7aa5ec19a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:01.975288 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9747588-6bdc-4887-ba83-f0f7aa5ec19a None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:01.976732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9747588-6bdc-4887-ba83-f0f7aa5ec19a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:01.977232 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9747588-6bdc-4887-ba83-f0f7aa5ec19a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:01.979088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9747588-6bdc-4887-ba83-f0f7aa5ec19a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:02.005340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 381/762] 10.222.0.41 () {56 vars in 1149 bytes} [Fri May 27 16:21:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:02.005340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9747588-6bdc-4887-ba83-f0f7aa5ec19a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:02.020352 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39431a9-6408-4aa2-a1fd-63703e50d7bf None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:02.070875 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee9d3f-9e2e-4206-a7c9-2b0b3c209ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:02.073422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee9d3f-9e2e-4206-a7c9-2b0b3c209ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:02.074498 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee9d3f-9e2e-4206-a7c9-2b0b3c209ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:02.075204 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee9d3f-9e2e-4206-a7c9-2b0b3c209ac1 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:02.078171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee9d3f-9e2e-4206-a7c9-2b0b3c209ac1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:02.079023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee9d3f-9e2e-4206-a7c9-2b0b3c209ac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:02.083584 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee9d3f-9e2e-4206-a7c9-2b0b3c209ac1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:02.099932 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 382/763] 10.222.0.41 () {56 vars in 1124 bytes} [Fri May 27 16:21:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:02.101769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee9d3f-9e2e-4206-a7c9-2b0b3c209ac1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:02.123193 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:02.167814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9747588-6bdc-4887-ba83-f0f7aa5ec19a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:02.210400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c71a51-3861-401e-abfe-3a62ebd28770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:02.211122 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c71a51-3861-401e-abfe-3a62ebd28770 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:02.211513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c71a51-3861-401e-abfe-3a62ebd28770 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:02.211894 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c71a51-3861-401e-abfe-3a62ebd28770 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:02.213284 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c71a51-3861-401e-abfe-3a62ebd28770 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:02.213599 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c71a51-3861-401e-abfe-3a62ebd28770 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:02.216117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c71a51-3861-401e-abfe-3a62ebd28770 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:02.236417 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:02.256554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 382/764] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:21:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:02.258229 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c71a51-3861-401e-abfe-3a62ebd28770 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:02.288762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee9d3f-9e2e-4206-a7c9-2b0b3c209ac1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:02.349164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb93d36-f0cf-4d28-87c4-a1ee69b9ece6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:02.350216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb93d36-f0cf-4d28-87c4-a1ee69b9ece6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:02.350737 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb93d36-f0cf-4d28-87c4-a1ee69b9ece6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:02.351902 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb93d36-f0cf-4d28-87c4-a1ee69b9ece6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:02.404578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c71a51-3861-401e-abfe-3a62ebd28770 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:02.445279 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb93d36-f0cf-4d28-87c4-a1ee69b9ece6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:02.446776 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb93d36-f0cf-4d28-87c4-a1ee69b9ece6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:02.456079 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a696c2-1b17-4d8b-9a1f-9c7193470218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:02.458040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a696c2-1b17-4d8b-9a1f-9c7193470218 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:02.458534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a696c2-1b17-4d8b-9a1f-9c7193470218 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:02.459477 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a696c2-1b17-4d8b-9a1f-9c7193470218 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:02.460961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a696c2-1b17-4d8b-9a1f-9c7193470218 None admin] RBAC: Adding query filter params (interface=public, service_id=b72292940e214853aa888860b4e6474f, region_id=RegionOne) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:02.461506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a696c2-1b17-4d8b-9a1f-9c7193470218 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:02.463665 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a696c2-1b17-4d8b-9a1f-9c7193470218 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:02.470520 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:02.478689 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 383/765] 10.222.0.41 () {56 vars in 1251 bytes} [Fri May 27 16:21:02 2022] GET /identity/v3/endpoints?service_id=b72292940e214853aa888860b4e6474f&interface=public®ion_id=RegionOne => generated 194 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:02.480218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a696c2-1b17-4d8b-9a1f-9c7193470218 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:02.528584 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:02.582213 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 383/766] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:21:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:21:02.583857 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3f28f-fb90-4729-9581-43cfa2b3ab41 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:02.584317 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3f28f-fb90-4729-9581-43cfa2b3ab41 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:02.584738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3f28f-fb90-4729-9581-43cfa2b3ab41 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:02.588077 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 384/767] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:02.588077 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3f28f-fb90-4729-9581-43cfa2b3ab41 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:02.613774 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a696c2-1b17-4d8b-9a1f-9c7193470218 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:02.658057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681ca6f-78d7-4ce7-b8d9-b3ec5fd4b33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:02.658057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681ca6f-78d7-4ce7-b8d9-b3ec5fd4b33b None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:02.658057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681ca6f-78d7-4ce7-b8d9-b3ec5fd4b33b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:02.658057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681ca6f-78d7-4ce7-b8d9-b3ec5fd4b33b None admin] PATH_INFO: `/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/3caa3dbc7bd24ebba28296a1eba9cefe/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:02.661040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681ca6f-78d7-4ce7-b8d9-b3ec5fd4b33b None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5c551b621342e5a5a6e742d673d525, user_id=3caa3dbc7bd24ebba28296a1eba9cefe, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:02.662544 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2681ca6f-78d7-4ce7-b8d9-b3ec5fd4b33b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:02.681059 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 384/768] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:21:02 2022] PUT /identity/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/3caa3dbc7bd24ebba28296a1eba9cefe/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:21:02.682923 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681ca6f-78d7-4ce7-b8d9-b3ec5fd4b33b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:02.759173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3f28f-fb90-4729-9581-43cfa2b3ab41 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:02.779604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:02.818732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465eb0f-2c8f-491e-85bd-ea018fd29b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:02.820745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465eb0f-2c8f-491e-85bd-ea018fd29b87 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:02.821579 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465eb0f-2c8f-491e-85bd-ea018fd29b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:02.822388 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465eb0f-2c8f-491e-85bd-ea018fd29b87 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:02.824208 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465eb0f-2c8f-491e-85bd-ea018fd29b87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:02.827485 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465eb0f-2c8f-491e-85bd-ea018fd29b87 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:02.841965 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 385/769] 10.222.0.41 () {56 vars in 1087 bytes} [Fri May 27 16:21:02 2022] GET /identity/v3/services => generated 772 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:02.842446 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681ca6f-78d7-4ce7-b8d9-b3ec5fd4b33b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:02.844079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195135a-4fe8-4da8-aa78-4280a94b1182 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:02.844795 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195135a-4fe8-4da8-aa78-4280a94b1182 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:02.845329 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195135a-4fe8-4da8-aa78-4280a94b1182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:02.889428 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d195135a-4fe8-4da8-aa78-4280a94b1182 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:02.890696 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d195135a-4fe8-4da8-aa78-4280a94b1182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:02.895937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93730b9d-7c11-4e79-8ce6-dd2e293109db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:02.896805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93730b9d-7c11-4e79-8ce6-dd2e293109db None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:02.897085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93730b9d-7c11-4e79-8ce6-dd2e293109db None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:02.897356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93730b9d-7c11-4e79-8ce6-dd2e293109db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:02.920965 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93730b9d-7c11-4e79-8ce6-dd2e293109db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:02.923281 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93730b9d-7c11-4e79-8ce6-dd2e293109db None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:02.944701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:02.949340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-93730b9d-7c11-4e79-8ce6-dd2e293109db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:02.949340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:02.949340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:02.949340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:02.949340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:02.949340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:02.949340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:02.949340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:02.949340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:02.949340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:02.949340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:02.949340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:02.949340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:02.949340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:02.949340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:02.950767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:02.950767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:02.950767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:02.950767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:02.950767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:02.950767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:02.950767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:02.950767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:02.950767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:02.950767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:02.950767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:02.950767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:02.950767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:02.950767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:02.950767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:02.950767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:02.950767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:02.953650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:02.953650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:02.953650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:02.953650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:02.953650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 385/770] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:02.957920 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93730b9d-7c11-4e79-8ce6-dd2e293109db None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:03.014368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 386/771] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:03.054600 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195135a-4fe8-4da8-aa78-4280a94b1182 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:03.128838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93730b9d-7c11-4e79-8ce6-dd2e293109db None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:03.161042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:03.196345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aed46e-9629-4662-b7e3-ff7d7c6be214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:03.197470 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aed46e-9629-4662-b7e3-ff7d7c6be214 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:03.198035 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aed46e-9629-4662-b7e3-ff7d7c6be214 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:03.198511 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aed46e-9629-4662-b7e3-ff7d7c6be214 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:03.199557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aed46e-9629-4662-b7e3-ff7d7c6be214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:03.200116 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aed46e-9629-4662-b7e3-ff7d7c6be214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:03.201824 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aed46e-9629-4662-b7e3-ff7d7c6be214 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:03.221837 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 386/772] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:03.227313 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aed46e-9629-4662-b7e3-ff7d7c6be214 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:03.230728 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195135a-4fe8-4da8-aa78-4280a94b1182 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:03.284100 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92eaea1-52b8-46f0-aa1d-25e20999d31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:03.285372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eaea1-52b8-46f0-aa1d-25e20999d31d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:03.285861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eaea1-52b8-46f0-aa1d-25e20999d31d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:03.286323 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92eaea1-52b8-46f0-aa1d-25e20999d31d None admin] PATH_INFO: `/v3/services/network` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:03.287178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92eaea1-52b8-46f0-aa1d-25e20999d31d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:03.288790 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92eaea1-52b8-46f0-aa1d-25e20999d31d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:03.304031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f92eaea1-52b8-46f0-aa1d-25e20999d31d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 16:21:03.304031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:03.304031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:03.304031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:03.304031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:03.304031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:03.304031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:03.304031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:03.304031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 16:21:03.304031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:03.304031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:03.304031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:03.304031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:03.304031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:03.304031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:03.304031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:03.304031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:03.305096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:03.305096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:03.305096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:03.305096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:03.305096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:03.305096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:03.305096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:03.305096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:03.305096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:03.305096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:03.305096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:03.305096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:03.305096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:03.305096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:03.305096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:03.305096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:03.305946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:03.305946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:03.305946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:03.305946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:03.305946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:03.305946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:03.305946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:03.305946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:03.305946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:03.305946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:03.305946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:03.305946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:03.305946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 16:21:03.305946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:03.313554 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 387/773] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:03 2022] GET /identity/v3/services/network => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:21:03.315177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92eaea1-52b8-46f0-aa1d-25e20999d31d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:03.345772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:03.365735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aed46e-9629-4662-b7e3-ff7d7c6be214 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:03.427536 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c35ef-70cf-4868-9afb-fb9b90f995b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:03.428399 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c35ef-70cf-4868-9afb-fb9b90f995b5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:03.428675 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c35ef-70cf-4868-9afb-fb9b90f995b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:03.429167 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c35ef-70cf-4868-9afb-fb9b90f995b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:03.445554 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92eaea1-52b8-46f0-aa1d-25e20999d31d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:03.447073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c35ef-70cf-4868-9afb-fb9b90f995b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:03.448703 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c35ef-70cf-4868-9afb-fb9b90f995b5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:03.475793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b63c35ef-70cf-4868-9afb-fb9b90f995b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:03.475793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:03.475793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:03.475793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:03.475793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:03.475793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:03.475793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:03.475793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:03.475793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:03.475793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:03.475793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:03.475793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:03.475793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:21:03.475793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:21:03.475793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:21:03.476821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:21:03.476821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:03.476821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:03.476821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:03.476821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:03.476821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:03.476821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:03.476821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:03.476821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:03.476821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:03.476821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:03.476821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:03.476821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:03.476821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:03.476821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:03.476821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:03.476821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:03.477733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:21:03.477733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:21:03.477733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:21:03.477733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:21:03.477733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:21:03.477733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:21:03.477733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:03.477733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:03.477733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 387/774] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:21:03.485037 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c35ef-70cf-4868-9afb-fb9b90f995b5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:03.504044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a8648-e3b9-433a-b76d-fc792de52690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:03.504044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a8648-e3b9-433a-b76d-fc792de52690 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:03.504044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a8648-e3b9-433a-b76d-fc792de52690 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:03.504044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a8648-e3b9-433a-b76d-fc792de52690 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:03.504493 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a8648-e3b9-433a-b76d-fc792de52690 None admin] RBAC: Adding query filter params (name=network) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:03.504493 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a8648-e3b9-433a-b76d-fc792de52690 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:03.504493 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a8648-e3b9-433a-b76d-fc792de52690 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:03.513687 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 388/775] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 16:21:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:03.516365 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fe8ea-5b6f-4748-ba8a-85c2f72db78b None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:03.516985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fe8ea-5b6f-4748-ba8a-85c2f72db78b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:03.517423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fe8ea-5b6f-4748-ba8a-85c2f72db78b None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:03.519718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 389/776] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:03.520661 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fe8ea-5b6f-4748-ba8a-85c2f72db78b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:03.548616 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:03.624973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:03.638324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fe8ea-5b6f-4748-ba8a-85c2f72db78b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:03.670741 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c35ef-70cf-4868-9afb-fb9b90f995b5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:03.676889 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c1048-dc28-4148-bf6f-10ad177ec912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:03.677853 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c1048-dc28-4148-bf6f-10ad177ec912 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:03.678335 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c1048-dc28-4148-bf6f-10ad177ec912 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:03.678785 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c1048-dc28-4148-bf6f-10ad177ec912 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:03.679667 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c1048-dc28-4148-bf6f-10ad177ec912 None admin] RBAC: Adding query filter params (type=network) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:03.680173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c1048-dc28-4148-bf6f-10ad177ec912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:03.681738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c1048-dc28-4148-bf6f-10ad177ec912 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:03.687577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 390/777] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 16:21:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:03.689177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ff262-51a4-44e4-a312-23c9ac4563c3 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:03.689690 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ff262-51a4-44e4-a312-23c9ac4563c3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:03.690669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ff262-51a4-44e4-a312-23c9ac4563c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:03.712190 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e17ff262-51a4-44e4-a312-23c9ac4563c3 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:03.714144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e17ff262-51a4-44e4-a312-23c9ac4563c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:03.742339 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71168c50-11ac-42ab-9a12-4601cfae8ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:03.743422 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71168c50-11ac-42ab-9a12-4601cfae8ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:03.743870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71168c50-11ac-42ab-9a12-4601cfae8ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:03.744384 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71168c50-11ac-42ab-9a12-4601cfae8ed8 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:03.745769 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71168c50-11ac-42ab-9a12-4601cfae8ed8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:03.746338 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71168c50-11ac-42ab-9a12-4601cfae8ed8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:03.749288 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71168c50-11ac-42ab-9a12-4601cfae8ed8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:03.772678 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 388/778] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:21:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:03.774282 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71168c50-11ac-42ab-9a12-4601cfae8ed8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:03.791448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 391/779] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:03.801425 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ff262-51a4-44e4-a312-23c9ac4563c3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:03.906459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:03.924240 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ff262-51a4-44e4-a312-23c9ac4563c3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:03.938275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:03.949862 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71168c50-11ac-42ab-9a12-4601cfae8ed8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:03.975894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6912d-c1eb-4a5d-aa72-b0fb98f99932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:03.976588 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6912d-c1eb-4a5d-aa72-b0fb98f99932 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:03.976874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6912d-c1eb-4a5d-aa72-b0fb98f99932 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:03.977188 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6912d-c1eb-4a5d-aa72-b0fb98f99932 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:03.977994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6912d-c1eb-4a5d-aa72-b0fb98f99932 None admin] RBAC: Adding query filter params (role.id=acbb2252c9f54cf8b789aa80f0a1fe85, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=2ccee0bc7e2b41f4a2fe2a891a95b318) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:03.978308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6912d-c1eb-4a5d-aa72-b0fb98f99932 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:03.979994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6912d-c1eb-4a5d-aa72-b0fb98f99932 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:03.987606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0dc70-c13f-47d3-a6b0-ce3373ce0f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:03.988603 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0dc70-c13f-47d3-a6b0-ce3373ce0f28 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:03.989103 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0dc70-c13f-47d3-a6b0-ce3373ce0f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:03.989638 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0dc70-c13f-47d3-a6b0-ce3373ce0f28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:03.990628 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0dc70-c13f-47d3-a6b0-ce3373ce0f28 None admin] RBAC: Adding query filter params (interface=public, service_id=73eb25bf8b1f408495341102bb903493, region_id=RegionOne) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:03.991135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0dc70-c13f-47d3-a6b0-ce3373ce0f28 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:03.992789 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0dc70-c13f-47d3-a6b0-ce3373ce0f28 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:03.994826 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 392/780] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:21:03 2022] GET /identity/v3/role_assignments?user.id=2ccee0bc7e2b41f4a2fe2a891a95b318&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=acbb2252c9f54cf8b789aa80f0a1fe85 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:03.996420 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6912d-c1eb-4a5d-aa72-b0fb98f99932 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:04.004255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 389/781] 10.222.0.41 () {56 vars in 1251 bytes} [Fri May 27 16:21:03 2022] GET /identity/v3/endpoints?service_id=73eb25bf8b1f408495341102bb903493&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:04.006077 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0dc70-c13f-47d3-a6b0-ce3373ce0f28 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:04.118117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0dc70-c13f-47d3-a6b0-ce3373ce0f28 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:04.167214 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28a249-4f8a-4084-90a6-a713fef01814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:04.168354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28a249-4f8a-4084-90a6-a713fef01814 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:04.168835 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28a249-4f8a-4084-90a6-a713fef01814 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:04.169336 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28a249-4f8a-4084-90a6-a713fef01814 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:04.170323 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28a249-4f8a-4084-90a6-a713fef01814 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:04.171996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28a249-4f8a-4084-90a6-a713fef01814 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:04.183026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 390/782] 10.222.0.41 () {56 vars in 1087 bytes} [Fri May 27 16:21:04 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:04.206007 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6912d-c1eb-4a5d-aa72-b0fb98f99932 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:04.270607 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493bdca-369e-4cce-96a4-1938e9cbd0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:04.272149 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493bdca-369e-4cce-96a4-1938e9cbd0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:04.272738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493bdca-369e-4cce-96a4-1938e9cbd0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:04.273260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493bdca-369e-4cce-96a4-1938e9cbd0e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:04.297351 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493bdca-369e-4cce-96a4-1938e9cbd0e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:21:04.306865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-6493bdca-369e-4cce-96a4-1938e9cbd0e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:21:04.306865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:04.306865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:04.306865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:04.306865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:04.306865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:04.306865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:04.306865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:04.306865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:04.306865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:04.306865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:04.306865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:04.306865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:21:04.306865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:21:04.306865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:21:04.306865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:21:04.307914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:21:04.307914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:21:04.307914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:21:04.307914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:21:04.307914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:04.307914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:04.307914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:04.307914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:04.307914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:04.307914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:04.307914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:04.307914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:04.307914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:04.307914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:04.307914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:04.307914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:04.309444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:04.309444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:04.309444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:04.309444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:04.309444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:21:04.309444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:21:04.309444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:21:04.309444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:21:04.309444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:21:04.309444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:21:04.309444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:21:04.309444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:04.309444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 393/783] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:21:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:04.314380 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28a249-4f8a-4084-90a6-a713fef01814 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:04.351218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:04.458657 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28a249-4f8a-4084-90a6-a713fef01814 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:04.496838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e01c3f-4f80-421c-a063-809acf2bf9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:04.497526 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e01c3f-4f80-421c-a063-809acf2bf9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:04.497808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e01c3f-4f80-421c-a063-809acf2bf9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:04.498078 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e01c3f-4f80-421c-a063-809acf2bf9b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:04.498956 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e01c3f-4f80-421c-a063-809acf2bf9b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:04.499285 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e01c3f-4f80-421c-a063-809acf2bf9b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:04.500810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e01c3f-4f80-421c-a063-809acf2bf9b1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:04.511101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 391/784] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:21:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:04.516597 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493bdca-369e-4cce-96a4-1938e9cbd0e9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:04.542460 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:04.655737 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493bdca-369e-4cce-96a4-1938e9cbd0e9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:04.692062 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2100fe4-b9ec-4e28-805a-44753911bbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:04.692898 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100fe4-b9ec-4e28-805a-44753911bbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:04.693184 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100fe4-b9ec-4e28-805a-44753911bbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:04.693464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2100fe4-b9ec-4e28-805a-44753911bbe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:04.705824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2100fe4-b9ec-4e28-805a-44753911bbe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:04.707528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2100fe4-b9ec-4e28-805a-44753911bbe0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:04.725963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-d2100fe4-b9ec-4e28-805a-44753911bbe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:04.725963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:04.725963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:04.725963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:04.725963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:04.725963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:04.725963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:04.725963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:04.725963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:04.725963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:04.725963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:04.725963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:04.725963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:04.725963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:04.725963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:04.726914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:04.726914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:04.726914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:04.726914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:04.726914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:04.726914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:04.726914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:04.726914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:04.726914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:04.726914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:04.726914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:04.726914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:04.726914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:04.726914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:04.726914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:04.726914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:04.726914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:04.727848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:04.727848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:04.727848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:04.727848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:04.727848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 394/785] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:04.733348 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e01c3f-4f80-421c-a063-809acf2bf9b1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:04.860334 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:04.899702 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e01c3f-4f80-421c-a063-809acf2bf9b1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:04.979574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb2d18-51ef-4cd5-a21f-3e0a8f03a245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:04.980685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb2d18-51ef-4cd5-a21f-3e0a8f03a245 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:04.981186 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb2d18-51ef-4cd5-a21f-3e0a8f03a245 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:04.981686 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb2d18-51ef-4cd5-a21f-3e0a8f03a245 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:04.983162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb2d18-51ef-4cd5-a21f-3e0a8f03a245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:04.983774 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb2d18-51ef-4cd5-a21f-3e0a8f03a245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:04.986438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb2d18-51ef-4cd5-a21f-3e0a8f03a245 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:05.014196 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 392/786] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:05.020474 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2100fe4-b9ec-4e28-805a-44753911bbe0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:05.143415 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:05.209499 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2100fe4-b9ec-4e28-805a-44753911bbe0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:05.269997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d629e3d-f801-4051-bcf6-b5f40f142a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:05.270764 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d629e3d-f801-4051-bcf6-b5f40f142a22 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:05.271050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d629e3d-f801-4051-bcf6-b5f40f142a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:05.271324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d629e3d-f801-4051-bcf6-b5f40f142a22 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:05.289299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d629e3d-f801-4051-bcf6-b5f40f142a22 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:05.290633 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d629e3d-f801-4051-bcf6-b5f40f142a22 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:05.307087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-7d629e3d-f801-4051-bcf6-b5f40f142a22 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 16:21:05.307087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:05.307087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:05.307087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:05.307087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:05.307087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:05.307087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:05.307087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:05.307087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:05.307087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:05.307087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:05.307087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:05.307087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:21:05.307087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:21:05.307087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:21:05.307087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:21:05.308604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:05.308604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:05.308604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:21:05.308604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:05.308604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:21:05.308604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:05.308604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:05.308604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:05.308604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:05.308604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:05.308604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:05.308604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:05.308604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:05.308604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:05.308604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:05.308604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:05.308604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:05.308604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:05.309578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:05.309578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:05.309578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:21:05.309578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:21:05.309578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:21:05.309578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:21:05.309578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:21:05.309578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:21:05.309578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 16:21:05.309578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:05.309578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 395/787] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:21:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:21:05.314355 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb2d18-51ef-4cd5-a21f-3e0a8f03a245 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:05.485352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb2d18-51ef-4cd5-a21f-3e0a8f03a245 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:05.544271 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eb31a-98d8-486b-b708-0c2a4dac764f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:05.544902 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eb31a-98d8-486b-b708-0c2a4dac764f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:05.545185 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eb31a-98d8-486b-b708-0c2a4dac764f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:05.545566 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eb31a-98d8-486b-b708-0c2a4dac764f None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:05.546909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5eb31a-98d8-486b-b708-0c2a4dac764f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:05.547224 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5eb31a-98d8-486b-b708-0c2a4dac764f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:05.549224 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5eb31a-98d8-486b-b708-0c2a4dac764f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:05.575979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:05.582997 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 393/788] 10.222.0.41 () {56 vars in 1135 bytes} [Fri May 27 16:21:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:05.588418 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d629e3d-f801-4051-bcf6-b5f40f142a22 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:05.747641 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d629e3d-f801-4051-bcf6-b5f40f142a22 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:05.775719 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c6b86-cba6-4142-a7ee-01afb29fdf9f None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:05.776296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c6b86-cba6-4142-a7ee-01afb29fdf9f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:05.776296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c6b86-cba6-4142-a7ee-01afb29fdf9f None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:05.777719 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 394/789] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:21:05.784713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:05.791802 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07f771-0588-4378-8ff1-3e43e85c5e1b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:05.792177 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07f771-0588-4378-8ff1-3e43e85c5e1b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:05.792396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07f771-0588-4378-8ff1-3e43e85c5e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:05.802970 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44e380-f66a-4c0f-8bea-2e8367e4d72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:05.803779 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44e380-f66a-4c0f-8bea-2e8367e4d72a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:05.804087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44e380-f66a-4c0f-8bea-2e8367e4d72a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:05.804365 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44e380-f66a-4c0f-8bea-2e8367e4d72a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:05.817125 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44e380-f66a-4c0f-8bea-2e8367e4d72a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:05.818742 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44e380-f66a-4c0f-8bea-2e8367e4d72a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:05.829257 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4e07f771-0588-4378-8ff1-3e43e85c5e1b None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:05.831024 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4e07f771-0588-4378-8ff1-3e43e85c5e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:05.838671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-9a44e380-f66a-4c0f-8bea-2e8367e4d72a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:05.838671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:05.838671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:05.838671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:05.838671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:05.838671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:05.838671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:05.838671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:05.838671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:05.838671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:05.838671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:05.838671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:05.838671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:05.838671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:05.838671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:05.839671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:05.839671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:05.839671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:05.839671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:05.839671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:05.839671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:05.839671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:05.839671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:05.839671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:05.839671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:05.839671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:05.839671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:05.839671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:05.839671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:05.839671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:05.839671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:05.839671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:05.840644 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:05.840644 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:05.840644 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:05.840644 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:05.840644 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 396/790] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:05.852733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44e380-f66a-4c0f-8bea-2e8367e4d72a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:05.936520 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 395/791] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:05.971641 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07f771-0588-4378-8ff1-3e43e85c5e1b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:06.050948 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44e380-f66a-4c0f-8bea-2e8367e4d72a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:06.130662 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07f771-0588-4378-8ff1-3e43e85c5e1b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:06.132044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46937f7-1765-4efa-b79f-841cef7d5941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:06.132733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46937f7-1765-4efa-b79f-841cef7d5941 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:06.133040 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46937f7-1765-4efa-b79f-841cef7d5941 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:06.133467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46937f7-1765-4efa-b79f-841cef7d5941 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:06.134202 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46937f7-1765-4efa-b79f-841cef7d5941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:06.135518 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46937f7-1765-4efa-b79f-841cef7d5941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:06.138024 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46937f7-1765-4efa-b79f-841cef7d5941 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:06.160124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 397/792] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:06.162113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da17ae-fe58-4ba7-9fbb-58cf7002cbc1 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:06.162413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da17ae-fe58-4ba7-9fbb-58cf7002cbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:06.162641 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da17ae-fe58-4ba7-9fbb-58cf7002cbc1 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:06.164230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 398/793] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:06.166061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da17ae-fe58-4ba7-9fbb-58cf7002cbc1 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:06.180268 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:06.188853 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541a54e-4db9-4224-b65f-071899efb9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:06.190257 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541a54e-4db9-4224-b65f-071899efb9bd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:06.190765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541a54e-4db9-4224-b65f-071899efb9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:06.191279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541a54e-4db9-4224-b65f-071899efb9bd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:06.192189 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541a54e-4db9-4224-b65f-071899efb9bd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:06.193963 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541a54e-4db9-4224-b65f-071899efb9bd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:06.203459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:06.210984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-6541a54e-4db9-4224-b65f-071899efb9bd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 16:21:06.210984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:06.210984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:06.210984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:06.210984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:06.210984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:06.210984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:06.210984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:06.210984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 16:21:06.210984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:06.210984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:06.210984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:06.210984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:06.210984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:06.210984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:06.210984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:06.211995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:06.211995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:06.211995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:06.211995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:06.211995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:06.211995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:06.211995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:06.211995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:06.211995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:06.211995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:06.211995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:06.211995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:06.211995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:06.211995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:06.211995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:06.211995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:06.212883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:06.212883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:06.212883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:06.212883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:06.212883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:06.212883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:06.212883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:06.212883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:06.212883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:06.212883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:06.212883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:06.212883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:06.212883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:06.212883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 16:21:06.212883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:06.215954 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 396/794] 10.222.0.41 () {56 vars in 1129 bytes} [Fri May 27 16:21:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:06.217654 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615026ad-3983-43c4-87c5-de05bcc1cc7a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:06.218136 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615026ad-3983-43c4-87c5-de05bcc1cc7a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:06.218647 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615026ad-3983-43c4-87c5-de05bcc1cc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:06.241382 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-615026ad-3983-43c4-87c5-de05bcc1cc7a None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:06.242953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-615026ad-3983-43c4-87c5-de05bcc1cc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:06.279971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da17ae-fe58-4ba7-9fbb-58cf7002cbc1 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:06.317429 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782ecb9-1c92-4648-bd9c-5e6b1513ebbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:06.318237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782ecb9-1c92-4648-bd9c-5e6b1513ebbb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:06.318402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782ecb9-1c92-4648-bd9c-5e6b1513ebbb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:06.318696 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782ecb9-1c92-4648-bd9c-5e6b1513ebbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:06.328069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782ecb9-1c92-4648-bd9c-5e6b1513ebbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:06.328069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782ecb9-1c92-4648-bd9c-5e6b1513ebbb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:06.328709 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 397/795] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:06.330212 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615026ad-3983-43c4-87c5-de05bcc1cc7a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:06.342825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-d782ecb9-1c92-4648-bd9c-5e6b1513ebbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:06.342825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:06.342825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:06.342825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:06.342825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:06.342825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:06.342825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:06.342825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:06.342825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:06.342825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:06.342825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:06.342825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:06.342825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:21:06.342825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:21:06.342825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:21:06.343819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:21:06.343819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:06.343819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:06.343819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:06.343819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:06.343819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:06.343819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:06.343819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:06.343819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:06.343819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:06.343819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:06.343819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:06.343819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:06.343819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:06.343819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:06.343819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:06.343819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:06.345196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:21:06.345196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:21:06.345196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:21:06.345196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:21:06.345196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:21:06.345196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:21:06.345196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:06.345196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:06.345196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 399/796] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:06.350757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782ecb9-1c92-4648-bd9c-5e6b1513ebbb None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:06.448406 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:06.459445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782ecb9-1c92-4648-bd9c-5e6b1513ebbb None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:06.462506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615026ad-3983-43c4-87c5-de05bcc1cc7a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:06.488902 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:06.497803 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723d802-4ea8-46b9-bfd1-70a99a73b4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:06.498485 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723d802-4ea8-46b9-bfd1-70a99a73b4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:06.498772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723d802-4ea8-46b9-bfd1-70a99a73b4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:06.499050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723d802-4ea8-46b9-bfd1-70a99a73b4f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:06.499850 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723d802-4ea8-46b9-bfd1-70a99a73b4f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:06.500197 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723d802-4ea8-46b9-bfd1-70a99a73b4f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:06.501671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723d802-4ea8-46b9-bfd1-70a99a73b4f5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:06.503303 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdfaec-81b8-4b89-a924-d2e0a8888093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:06.504264 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdfaec-81b8-4b89-a924-d2e0a8888093 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:06.504745 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdfaec-81b8-4b89-a924-d2e0a8888093 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:06.505233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdfaec-81b8-4b89-a924-d2e0a8888093 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:06.506138 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdfaec-81b8-4b89-a924-d2e0a8888093 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:06.506703 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdfaec-81b8-4b89-a924-d2e0a8888093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:06.508330 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdfaec-81b8-4b89-a924-d2e0a8888093 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:06.513989 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 398/797] 10.222.0.41 () {56 vars in 1124 bytes} [Fri May 27 16:21:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:06.515265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdfaec-81b8-4b89-a924-d2e0a8888093 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:06.520280 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 400/798] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:21:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:06.521395 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723d802-4ea8-46b9-bfd1-70a99a73b4f5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:06.626254 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdfaec-81b8-4b89-a924-d2e0a8888093 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:06.635131 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723d802-4ea8-46b9-bfd1-70a99a73b4f5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:06.664645 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a5587-96af-4e81-b21d-8f9ed3a7d78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:06.665924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a5587-96af-4e81-b21d-8f9ed3a7d78e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:06.666429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a5587-96af-4e81-b21d-8f9ed3a7d78e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:06.666959 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a5587-96af-4e81-b21d-8f9ed3a7d78e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:06.673434 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb3493-95e5-4498-a5e8-21ee45f749c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:06.674144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb3493-95e5-4498-a5e8-21ee45f749c7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:06.674493 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb3493-95e5-4498-a5e8-21ee45f749c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:06.674913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb3493-95e5-4498-a5e8-21ee45f749c7 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:06.676311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb3493-95e5-4498-a5e8-21ee45f749c7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:06.676852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb3493-95e5-4498-a5e8-21ee45f749c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:06.679539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb3493-95e5-4498-a5e8-21ee45f749c7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:06.682796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a5587-96af-4e81-b21d-8f9ed3a7d78e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:21:06.689181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 401/799] 10.222.0.41 () {56 vars in 1124 bytes} [Fri May 27 16:21:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:06.690866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb3493-95e5-4498-a5e8-21ee45f749c7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:06.692200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-e32a5587-96af-4e81-b21d-8f9ed3a7d78e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:21:06.692200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:06.692200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:06.692200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:06.692200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:06.692200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:06.692200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:06.692200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:06.692200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:06.692200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:06.692200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:06.692200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:06.692200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:21:06.692200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:21:06.692200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:21:06.692200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:21:06.693227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:21:06.693227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:21:06.693227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:21:06.693227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:21:06.693227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:06.693227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:06.693227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:06.693227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:06.693227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:06.693227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:06.693227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:06.693227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:06.693227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:06.693227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:06.693227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:06.693227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:06.694090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:06.694090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:06.694090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:06.694090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:06.694090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:21:06.694090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:21:06.694090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:21:06.694090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:21:06.694090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:21:06.694090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:21:06.694090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:21:06.694090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:06.697207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 399/800] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:21:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:06.698273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a5587-96af-4e81-b21d-8f9ed3a7d78e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:06.723984 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:06.756496 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:06.812447 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a5587-96af-4e81-b21d-8f9ed3a7d78e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:06.850085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3210e0-5460-46da-96c4-fbeceabe9fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:06.850897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3210e0-5460-46da-96c4-fbeceabe9fef None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:06.851187 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3210e0-5460-46da-96c4-fbeceabe9fef None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:06.851635 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3210e0-5460-46da-96c4-fbeceabe9fef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:06.852439 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3210e0-5460-46da-96c4-fbeceabe9fef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:06.854013 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3210e0-5460-46da-96c4-fbeceabe9fef None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:06.855792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb3493-95e5-4498-a5e8-21ee45f749c7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:06.879101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 400/801] 10.222.0.41 () {60 vars in 1144 bytes} [Fri May 27 16:21:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:21:06.880036 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3210e0-5460-46da-96c4-fbeceabe9fef None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:06.931622 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ce260-7c1c-404e-a332-cb82fb6882b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:06.933103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ce260-7c1c-404e-a332-cb82fb6882b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:06.933397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ce260-7c1c-404e-a332-cb82fb6882b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:06.933670 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ce260-7c1c-404e-a332-cb82fb6882b0 None admin] PATH_INFO: `/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/dbfcca96ad754692b3fb7f891013dafb/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:06.938048 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ce260-7c1c-404e-a332-cb82fb6882b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5c551b621342e5a5a6e742d673d525, user_id=dbfcca96ad754692b3fb7f891013dafb, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:06.940794 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ce260-7c1c-404e-a332-cb82fb6882b0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:06.972429 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 402/802] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:21:06 2022] PUT /identity/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/dbfcca96ad754692b3fb7f891013dafb/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:21:06.975263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57147e-947a-47b4-9cbd-6e562d3091e5 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:06.975696 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57147e-947a-47b4-9cbd-6e562d3091e5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:06.976303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57147e-947a-47b4-9cbd-6e562d3091e5 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:06.979277 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 403/803] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:06.987186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a3ace-2884-4f00-8198-1c08cd12411f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:06.987830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a3ace-2884-4f00-8198-1c08cd12411f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:06.988204 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a3ace-2884-4f00-8198-1c08cd12411f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:07.038244 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9c3a3ace-2884-4f00-8198-1c08cd12411f None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:07.044629 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9c3a3ace-2884-4f00-8198-1c08cd12411f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:07.053140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3210e0-5460-46da-96c4-fbeceabe9fef None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:07.058151 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:07.108886 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fe16f-1cc4-4497-9912-5729e7e0a418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:07.110648 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fe16f-1cc4-4497-9912-5729e7e0a418 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:07.112036 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fe16f-1cc4-4497-9912-5729e7e0a418 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:07.112606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fe16f-1cc4-4497-9912-5729e7e0a418 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:07.114468 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fe16f-1cc4-4497-9912-5729e7e0a418 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:07.115030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fe16f-1cc4-4497-9912-5729e7e0a418 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:07.116862 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fe16f-1cc4-4497-9912-5729e7e0a418 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:07.132065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 401/804] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:21:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:07.139579 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fe16f-1cc4-4497-9912-5729e7e0a418 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:07.198698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 404/805] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:07.218033 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de134b44-3d04-437c-b115-36262db9c543 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:07.218580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de134b44-3d04-437c-b115-36262db9c543 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:07.219006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de134b44-3d04-437c-b115-36262db9c543 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:07.220987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 405/806] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:21:07.227897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9e2f4-f1ba-4e8d-a60c-3471a0ab95c3 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:07.228579 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9e2f4-f1ba-4e8d-a60c-3471a0ab95c3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:07.229074 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9e2f4-f1ba-4e8d-a60c-3471a0ab95c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:07.235461 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:07.255252 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-90a9e2f4-f1ba-4e8d-a60c-3471a0ab95c3 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:07.256879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-90a9e2f4-f1ba-4e8d-a60c-3471a0ab95c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:07.285821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fe16f-1cc4-4497-9912-5729e7e0a418 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:07.327505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0caf4e-8a05-4482-9938-cc6355d637af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:07.328733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0caf4e-8a05-4482-9938-cc6355d637af None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:07.329185 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0caf4e-8a05-4482-9938-cc6355d637af None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:07.329944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0caf4e-8a05-4482-9938-cc6355d637af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:07.336902 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 406/807] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:21:07.336902 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9e2f4-f1ba-4e8d-a60c-3471a0ab95c3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:07.354422 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0caf4e-8a05-4482-9938-cc6355d637af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:07.356554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0caf4e-8a05-4482-9938-cc6355d637af None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:07.384201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ae0caf4e-8a05-4482-9938-cc6355d637af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:07.384201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:07.384201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:07.384201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:07.384201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:07.384201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:07.384201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:07.384201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:07.384201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:07.384201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:07.384201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:07.384201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:07.384201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:07.384201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:07.384201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:07.385273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:07.385273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:07.385273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:07.385273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:07.385273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:07.385273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:07.385273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:07.385273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:07.385273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:07.385273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:07.385273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:07.385273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:07.385273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:07.385273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:07.385273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:07.385273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:07.385273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:07.386186 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:07.386186 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:07.386186 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:07.386186 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:07.392704 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 402/808] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:07.394188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0caf4e-8a05-4482-9938-cc6355d637af None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:07.445459 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:07.474139 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9e2f4-f1ba-4e8d-a60c-3471a0ab95c3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:07.514553 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:07.524143 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a12b1d-b41c-4b8a-8e66-d7979b025ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:07.525332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a12b1d-b41c-4b8a-8e66-d7979b025ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:07.525976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a12b1d-b41c-4b8a-8e66-d7979b025ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:07.526411 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a12b1d-b41c-4b8a-8e66-d7979b025ae8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:07.545690 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a12b1d-b41c-4b8a-8e66-d7979b025ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:21:07.561841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-79a12b1d-b41c-4b8a-8e66-d7979b025ae8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:21:07.561841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:07.561841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:07.561841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:07.561841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:07.561841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:07.561841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:07.561841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:07.561841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:07.561841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:07.561841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:07.561841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:07.561841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:21:07.561841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:21:07.561841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:21:07.561841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:21:07.563713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:21:07.563713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:21:07.563713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:21:07.563713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:21:07.563713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:07.563713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:07.563713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:07.563713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:07.563713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:07.563713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:07.563713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:07.563713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:07.563713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:07.563713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:07.563713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:07.563713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:07.564708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:07.564708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:07.564708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:07.564708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:07.564708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:21:07.564708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:21:07.564708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:21:07.564708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:21:07.564708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:21:07.564708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:21:07.564708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:21:07.564708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:07.568302 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 407/809] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:21:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:07.570017 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a12b1d-b41c-4b8a-8e66-d7979b025ae8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:07.608486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0caf4e-8a05-4482-9938-cc6355d637af None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:07.649498 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd325a5b-0d6a-45ab-a52a-bb63fafa2eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:07.650888 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd325a5b-0d6a-45ab-a52a-bb63fafa2eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:07.651198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd325a5b-0d6a-45ab-a52a-bb63fafa2eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:07.651452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd325a5b-0d6a-45ab-a52a-bb63fafa2eb4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:07.652128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd325a5b-0d6a-45ab-a52a-bb63fafa2eb4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:07.653836 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd325a5b-0d6a-45ab-a52a-bb63fafa2eb4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:07.667919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-fd325a5b-0d6a-45ab-a52a-bb63fafa2eb4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 16:21:07.667919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:07.667919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:07.667919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:07.667919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:07.667919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:07.667919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:07.667919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:07.667919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 16:21:07.667919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:07.667919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:07.667919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:07.667919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:07.667919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:07.667919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:07.667919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:07.667919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:07.669841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:07.669841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:07.669841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:07.669841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:07.669841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:07.669841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:07.669841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:07.669841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:07.669841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:07.669841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:07.669841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:07.669841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:07.669841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:07.669841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:07.669841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:07.669841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:07.671521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:07.671521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:07.671521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:07.671521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:07.671521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:07.671521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:07.671521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:07.671521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:07.671521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:07.671521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:07.671521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:07.671521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:07.671521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 16:21:07.671521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:07.674202 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 403/810] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:07 2022] GET /identity/v3/services/network => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:07.676187 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd325a5b-0d6a-45ab-a52a-bb63fafa2eb4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:07.741241 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a12b1d-b41c-4b8a-8e66-d7979b025ae8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:07.779648 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223dd766-3046-4c93-875d-ba024e0ec0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:07.780714 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dd766-3046-4c93-875d-ba024e0ec0dd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:07.781261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dd766-3046-4c93-875d-ba024e0ec0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:07.781773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dd766-3046-4c93-875d-ba024e0ec0dd None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:07.782768 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223dd766-3046-4c93-875d-ba024e0ec0dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:07.783286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223dd766-3046-4c93-875d-ba024e0ec0dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:07.785144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223dd766-3046-4c93-875d-ba024e0ec0dd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:07.790139 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:07.808279 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 408/811] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:07.809654 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223dd766-3046-4c93-875d-ba024e0ec0dd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:07.815061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd325a5b-0d6a-45ab-a52a-bb63fafa2eb4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:07.854262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652da233-7007-4e7e-aec2-349e52a7f873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:07.855322 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652da233-7007-4e7e-aec2-349e52a7f873 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:07.855815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652da233-7007-4e7e-aec2-349e52a7f873 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:07.856353 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652da233-7007-4e7e-aec2-349e52a7f873 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:07.857341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652da233-7007-4e7e-aec2-349e52a7f873 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:07.857874 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652da233-7007-4e7e-aec2-349e52a7f873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:07.859563 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652da233-7007-4e7e-aec2-349e52a7f873 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:07.870518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 404/812] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:21:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:07.872202 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652da233-7007-4e7e-aec2-349e52a7f873 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:07.892123 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:07.970559 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223dd766-3046-4c93-875d-ba024e0ec0dd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:08.004270 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652da233-7007-4e7e-aec2-349e52a7f873 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:08.017398 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0188d-cdd2-4590-a115-7d38bb3e0cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:08.018863 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0188d-cdd2-4590-a115-7d38bb3e0cef None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:08.019369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0188d-cdd2-4590-a115-7d38bb3e0cef None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:08.019840 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0188d-cdd2-4590-a115-7d38bb3e0cef None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:08.021288 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0188d-cdd2-4590-a115-7d38bb3e0cef None admin] RBAC: Adding query filter params (name=network) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:08.021860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0188d-cdd2-4590-a115-7d38bb3e0cef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:08.023592 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0188d-cdd2-4590-a115-7d38bb3e0cef None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:08.034925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 409/813] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 16:21:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:08.034925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0188d-cdd2-4590-a115-7d38bb3e0cef None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:08.053574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f601a5d-44f9-467b-84a2-4d40b92e7f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:08.055017 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f601a5d-44f9-467b-84a2-4d40b92e7f15 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:08.055518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f601a5d-44f9-467b-84a2-4d40b92e7f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:08.056036 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f601a5d-44f9-467b-84a2-4d40b92e7f15 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:08.070745 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f601a5d-44f9-467b-84a2-4d40b92e7f15 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:08.073640 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f601a5d-44f9-467b-84a2-4d40b92e7f15 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:08.102129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-3f601a5d-44f9-467b-84a2-4d40b92e7f15 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 16:21:08.102129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:08.102129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:08.102129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:08.102129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:08.102129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:08.102129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:08.102129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:08.102129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:08.102129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:08.102129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:08.102129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:08.102129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:21:08.102129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:21:08.102129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:21:08.102129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:21:08.103181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:08.103181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:08.103181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:21:08.103181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:08.103181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:21:08.103181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:08.103181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:08.103181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:08.103181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:08.103181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:08.103181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:08.103181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:08.103181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:08.103181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:08.103181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:08.103181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:08.103181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:08.103181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:08.105089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:08.105089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:08.105089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:21:08.105089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:21:08.105089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:21:08.105089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:21:08.105089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:21:08.105089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:21:08.105089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 16:21:08.105089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:08.105089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 405/814] 10.222.0.41 () {56 vars in 1093 bytes} [Fri May 27 16:21:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:08.110955 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f601a5d-44f9-467b-84a2-4d40b92e7f15 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:08.115114 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:08.165453 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0188d-cdd2-4590-a115-7d38bb3e0cef None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:08.187218 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:08.210697 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef470d-8959-4c84-be3f-233862c1e85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:08.211652 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef470d-8959-4c84-be3f-233862c1e85f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:08.211893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef470d-8959-4c84-be3f-233862c1e85f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:08.212223 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef470d-8959-4c84-be3f-233862c1e85f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:08.225750 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef470d-8959-4c84-be3f-233862c1e85f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:08.227434 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef470d-8959-4c84-be3f-233862c1e85f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:08.230442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f601a5d-44f9-467b-84a2-4d40b92e7f15 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:08.253205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-fbef470d-8959-4c84-be3f-233862c1e85f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:08.253205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:08.253205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:08.253205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:08.253205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:08.253205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:08.253205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:08.253205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:08.253205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:08.253205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:08.253205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:08.253205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:08.253205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:08.253205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:08.253205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:08.254215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:08.254215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:08.254215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:08.254215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:08.254215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:08.254215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:08.254215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:08.254215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:08.254215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:08.254215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:08.254215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:08.254215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:08.254215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:08.254215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:08.254215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:08.254215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:08.254215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:08.255114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:08.255114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:08.255114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:08.255114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:08.255114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 410/815] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:08.255845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef470d-8959-4c84-be3f-233862c1e85f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:08.277348 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6e94b-7c3c-4915-a241-627e40dcedd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:08.278395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6e94b-7c3c-4915-a241-627e40dcedd3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:08.278876 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6e94b-7c3c-4915-a241-627e40dcedd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:08.279426 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6e94b-7c3c-4915-a241-627e40dcedd3 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:08.280391 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6e94b-7c3c-4915-a241-627e40dcedd3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:08.280879 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6e94b-7c3c-4915-a241-627e40dcedd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:08.282501 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6e94b-7c3c-4915-a241-627e40dcedd3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:08.293629 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 406/816] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 16:21:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:08.294683 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6e94b-7c3c-4915-a241-627e40dcedd3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:08.381084 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:08.420344 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6e94b-7c3c-4915-a241-627e40dcedd3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:08.425508 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef470d-8959-4c84-be3f-233862c1e85f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:08.460555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492157df-076a-47c0-bf45-6e2e8a3ce698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:08.461589 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492157df-076a-47c0-bf45-6e2e8a3ce698 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:08.462050 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492157df-076a-47c0-bf45-6e2e8a3ce698 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:08.462501 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492157df-076a-47c0-bf45-6e2e8a3ce698 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:08.463466 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492157df-076a-47c0-bf45-6e2e8a3ce698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:08.463997 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492157df-076a-47c0-bf45-6e2e8a3ce698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:08.465618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492157df-076a-47c0-bf45-6e2e8a3ce698 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:08.470334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c86482-72da-4350-9573-d9f5d2dfa8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:08.471228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c86482-72da-4350-9573-d9f5d2dfa8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:08.471672 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c86482-72da-4350-9573-d9f5d2dfa8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:08.472029 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c86482-72da-4350-9573-d9f5d2dfa8e1 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:08.472948 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c86482-72da-4350-9573-d9f5d2dfa8e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:08.473317 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c86482-72da-4350-9573-d9f5d2dfa8e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:08.475530 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c86482-72da-4350-9573-d9f5d2dfa8e1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:08.481083 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 407/817] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:08.482148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492157df-076a-47c0-bf45-6e2e8a3ce698 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:08.502092 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 411/818] 10.222.0.41 () {56 vars in 1133 bytes} [Fri May 27 16:21:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:08.503343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c86482-72da-4350-9573-d9f5d2dfa8e1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:08.533899 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:08.630499 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492157df-076a-47c0-bf45-6e2e8a3ce698 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:08.653062 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c86482-72da-4350-9573-d9f5d2dfa8e1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:08.660547 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:08.669859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088d5fe-d054-42cd-9e99-ad656d8d1bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:08.670751 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088d5fe-d054-42cd-9e99-ad656d8d1bf9 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:08.670931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088d5fe-d054-42cd-9e99-ad656d8d1bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:08.671194 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088d5fe-d054-42cd-9e99-ad656d8d1bf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:08.671961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088d5fe-d054-42cd-9e99-ad656d8d1bf9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:08.673457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8088d5fe-d054-42cd-9e99-ad656d8d1bf9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:08.696504 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 408/819] 10.222.0.41 () {60 vars in 1144 bytes} [Fri May 27 16:21:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:21:08.697769 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088d5fe-d054-42cd-9e99-ad656d8d1bf9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:08.733796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529acb2-7865-4112-986d-f764a3ba7f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:08.734665 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529acb2-7865-4112-986d-f764a3ba7f43 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:08.735004 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529acb2-7865-4112-986d-f764a3ba7f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:08.735285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529acb2-7865-4112-986d-f764a3ba7f43 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:08.754953 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529acb2-7865-4112-986d-f764a3ba7f43 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:08.757763 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529acb2-7865-4112-986d-f764a3ba7f43 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:08.797023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-3529acb2-7865-4112-986d-f764a3ba7f43 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:21:08.797023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:08.797023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:08.797023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:08.797023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:08.797023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:08.797023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:08.797023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:08.797023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:08.797023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:08.797023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:08.797023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:08.797023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:21:08.797023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:21:08.797023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:21:08.797023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:21:08.799182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:08.799182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:08.799182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:21:08.799182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:08.799182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:21:08.799182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:08.799182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:08.799182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:08.799182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:08.799182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:08.799182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:08.799182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:08.799182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:08.799182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:08.799182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:08.799182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:08.799182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:08.799182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:08.802020 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:08.802020 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:08.802020 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:21:08.802020 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:21:08.802020 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:21:08.802020 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:21:08.802020 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:21:08.802020 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:21:08.802020 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:21:08.802020 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:08.811406 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 412/820] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 16:21:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:08.813239 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529acb2-7865-4112-986d-f764a3ba7f43 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:08.906274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088d5fe-d054-42cd-9e99-ad656d8d1bf9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:08.960896 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa78974-03db-4da3-9313-b08c08041ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:08.961586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa78974-03db-4da3-9313-b08c08041ecd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:08.961870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa78974-03db-4da3-9313-b08c08041ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:08.962780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa78974-03db-4da3-9313-b08c08041ecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:08.985052 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:09.013610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529acb2-7865-4112-986d-f764a3ba7f43 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:09.036930 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:09.055276 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17e548-45e1-4c70-8a12-2041c7b85203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:09.056350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17e548-45e1-4c70-8a12-2041c7b85203 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:09.056854 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17e548-45e1-4c70-8a12-2041c7b85203 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:09.057292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17e548-45e1-4c70-8a12-2041c7b85203 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:09.058296 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17e548-45e1-4c70-8a12-2041c7b85203 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:09.058755 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17e548-45e1-4c70-8a12-2041c7b85203 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:09.059179 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa78974-03db-4da3-9313-b08c08041ecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:09.060607 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17e548-45e1-4c70-8a12-2041c7b85203 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:09.060730 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa78974-03db-4da3-9313-b08c08041ecd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:09.082148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 413/821] 10.222.0.41 () {56 vars in 1149 bytes} [Fri May 27 16:21:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:09.088262 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17e548-45e1-4c70-8a12-2041c7b85203 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:09.183069 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 409/822] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:21:08 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:21:09.188592 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa78974-03db-4da3-9313-b08c08041ecd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:09.221002 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17e548-45e1-4c70-8a12-2041c7b85203 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:09.270963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03069a09-a044-4e4d-8002-c89917ee6785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:09.272215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03069a09-a044-4e4d-8002-c89917ee6785 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:09.272682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03069a09-a044-4e4d-8002-c89917ee6785 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:09.273095 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03069a09-a044-4e4d-8002-c89917ee6785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:09.282142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:09.284986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:09.296153 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03069a09-a044-4e4d-8002-c89917ee6785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:09.296153 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03069a09-a044-4e4d-8002-c89917ee6785 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:09.302905 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa78974-03db-4da3-9313-b08c08041ecd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:09.320448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-03069a09-a044-4e4d-8002-c89917ee6785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:09.320448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:09.320448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:09.320448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:09.320448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:09.320448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:09.320448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:09.320448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:09.320448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:09.320448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:09.320448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:09.320448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:09.320448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:09.320448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:09.320448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:09.321632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:09.321632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:09.321632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:09.321632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:09.321632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:09.321632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:09.321632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:09.321632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:09.321632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:09.321632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:09.321632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:09.321632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:09.321632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:09.321632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:09.321632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:09.321632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:09.321632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:09.322746 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:09.322746 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:09.322746 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:09.322746 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:09.323701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 414/823] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:09.331241 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03069a09-a044-4e4d-8002-c89917ee6785 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:09.359259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f3c35-a05d-4619-a0de-1f8f7a4bdfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:09.360118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f3c35-a05d-4619-a0de-1f8f7a4bdfc0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:09.360407 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f3c35-a05d-4619-a0de-1f8f7a4bdfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:09.360685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f3c35-a05d-4619-a0de-1f8f7a4bdfc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:09.371832 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f3c35-a05d-4619-a0de-1f8f7a4bdfc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:09.373376 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f3c35-a05d-4619-a0de-1f8f7a4bdfc0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:09.391940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d19f3c35-a05d-4619-a0de-1f8f7a4bdfc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:09.391940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:09.391940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:09.391940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:09.391940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:09.391940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:09.391940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:09.391940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:09.391940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:09.391940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:09.391940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:09.391940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:09.391940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:09.391940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:09.391940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:09.393752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:09.393752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:09.393752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:09.393752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:09.393752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:09.393752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:09.393752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:09.393752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:09.393752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:09.393752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:09.393752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:09.393752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:09.393752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:09.393752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:09.393752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:09.393752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:09.393752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:09.395262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:09.395262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:09.395262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:09.395262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:09.395262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 410/824] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:09.395262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4c7fe-a6be-4397-8497-8d1c42ad648f None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:09.395262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4c7fe-a6be-4397-8497-8d1c42ad648f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:09.396068 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4c7fe-a6be-4397-8497-8d1c42ad648f None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:09.399721 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 411/825] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:09.402263 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4c7fe-a6be-4397-8497-8d1c42ad648f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:09.461705 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03069a09-a044-4e4d-8002-c89917ee6785 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:09.508499 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8c533-0b37-4935-a826-df9a8d27a62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:09.509533 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c533-0b37-4935-a826-df9a8d27a62c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:09.509822 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c533-0b37-4935-a826-df9a8d27a62c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:09.510159 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c533-0b37-4935-a826-df9a8d27a62c None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:09.511038 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8c533-0b37-4935-a826-df9a8d27a62c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:09.511344 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8c533-0b37-4935-a826-df9a8d27a62c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:09.513685 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8c533-0b37-4935-a826-df9a8d27a62c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:09.527067 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 415/826] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:09.528346 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4c7fe-a6be-4397-8497-8d1c42ad648f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:09.528686 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc7dee-401b-4661-82aa-b893c4790891 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:09.528973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc7dee-401b-4661-82aa-b893c4790891 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:09.529298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc7dee-401b-4661-82aa-b893c4790891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:09.551173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0fcc7dee-401b-4661-82aa-b893c4790891 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:09.552466 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0fcc7dee-401b-4661-82aa-b893c4790891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:09.576034 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a23a3-0d83-404a-a1bb-6649180f0b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:09.576800 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a23a3-0d83-404a-a1bb-6649180f0b3d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:09.577073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a23a3-0d83-404a-a1bb-6649180f0b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:09.577347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a23a3-0d83-404a-a1bb-6649180f0b3d None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:09.578349 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a23a3-0d83-404a-a1bb-6649180f0b3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:09.578834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a23a3-0d83-404a-a1bb-6649180f0b3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:09.580665 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a23a3-0d83-404a-a1bb-6649180f0b3d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:09.583511 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:09.593530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 412/827] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:09.594958 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05b9dc-0843-4b9f-99b4-ce0a49f69dc4 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:09.595244 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05b9dc-0843-4b9f-99b4-ce0a49f69dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:09.595517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05b9dc-0843-4b9f-99b4-ce0a49f69dc4 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:09.600678 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 413/828] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:09.600678 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05b9dc-0843-4b9f-99b4-ce0a49f69dc4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:09.608822 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:09.630495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 416/829] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:09.631370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc7dee-401b-4661-82aa-b893c4790891 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:09.723039 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05b9dc-0843-4b9f-99b4-ce0a49f69dc4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:09.743594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc7dee-401b-4661-82aa-b893c4790891 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:09.761280 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e485c6-dfe1-4cd0-b0b0-54743b1c8b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:09.762091 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e485c6-dfe1-4cd0-b0b0-54743b1c8b02 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:09.762370 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e485c6-dfe1-4cd0-b0b0-54743b1c8b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:09.762639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e485c6-dfe1-4cd0-b0b0-54743b1c8b02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:09.769810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e485c6-dfe1-4cd0-b0b0-54743b1c8b02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:09.771291 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e485c6-dfe1-4cd0-b0b0-54743b1c8b02 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:09.779735 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a049f3-8793-45b5-826f-86a0389fc38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:09.780633 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a049f3-8793-45b5-826f-86a0389fc38b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:09.780922 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a049f3-8793-45b5-826f-86a0389fc38b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:09.781199 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a049f3-8793-45b5-826f-86a0389fc38b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:09.786533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d1e485c6-dfe1-4cd0-b0b0-54743b1c8b02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:09.786533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:09.786533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:09.786533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:09.786533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:09.786533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:09.786533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:09.786533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:09.786533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:09.786533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:09.786533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:09.786533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:09.786533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:21:09.786533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:21:09.786533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:21:09.787733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:21:09.787733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:09.787733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:09.787733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:09.787733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:09.787733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:09.787733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:09.787733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:09.787733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:09.787733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:09.787733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:09.787733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:09.787733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:09.787733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:09.787733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:09.787733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:09.787733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:09.788915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:21:09.788915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:21:09.788915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:21:09.788915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:21:09.788915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:21:09.788915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:21:09.788915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:09.788915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:09.789460 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a049f3-8793-45b5-826f-86a0389fc38b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:09.790444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a049f3-8793-45b5-826f-86a0389fc38b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:09.792171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 414/830] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:09.793724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb44d90-d4cb-4d92-b4a9-0ec8d55ba502 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:09.794018 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb44d90-d4cb-4d92-b4a9-0ec8d55ba502 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:09.794294 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb44d90-d4cb-4d92-b4a9-0ec8d55ba502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:09.805676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-e3a049f3-8793-45b5-826f-86a0389fc38b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:09.805676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:09.805676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:09.805676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:09.805676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:09.805676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:09.805676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:09.805676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:09.805676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:09.805676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:09.805676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:09.805676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:09.805676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:21:09.805676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:21:09.805676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:21:09.806923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:21:09.806923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:09.806923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:09.806923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:09.806923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:09.806923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:09.806923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:09.806923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:09.806923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:09.806923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:09.806923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:09.806923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:09.806923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:09.806923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:09.806923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:09.806923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:09.806923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:09.807842 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:21:09.807842 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:21:09.807842 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:21:09.807842 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:21:09.807842 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:21:09.807842 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:21:09.807842 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:09.807842 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:09.807842 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 417/831] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:09.808389 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a049f3-8793-45b5-826f-86a0389fc38b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:09.813660 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5fb44d90-d4cb-4d92-b4a9-0ec8d55ba502 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:09.815070 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5fb44d90-d4cb-4d92-b4a9-0ec8d55ba502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:09.862035 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:09.886671 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:09.915132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 415/832] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:09.916490 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb44d90-d4cb-4d92-b4a9-0ec8d55ba502 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:09.926166 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a049f3-8793-45b5-826f-86a0389fc38b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:09.963324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bff6f3-5073-4dc8-8ccd-a4379bdb9018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:09.964458 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bff6f3-5073-4dc8-8ccd-a4379bdb9018 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:09.964458 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bff6f3-5073-4dc8-8ccd-a4379bdb9018 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:09.964718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bff6f3-5073-4dc8-8ccd-a4379bdb9018 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:09.977159 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bff6f3-5073-4dc8-8ccd-a4379bdb9018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:21:09.984919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-94bff6f3-5073-4dc8-8ccd-a4379bdb9018 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:21:09.984919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:09.984919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:09.984919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:09.984919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:09.984919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:09.984919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:09.984919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:09.984919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:09.984919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:09.984919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:09.984919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:09.984919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:21:09.984919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:21:09.984919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:21:09.984919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:21:09.986464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:21:09.986464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:21:09.986464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:21:09.986464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:21:09.986464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:09.986464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:09.986464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:09.986464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:09.986464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:09.986464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:09.986464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:09.986464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:09.986464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:09.986464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:09.986464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:09.986464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:09.989410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:09.989410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:09.989410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:09.989410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:09.989410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:21:09.989410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:21:09.989410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:21:09.989410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:21:09.989410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:21:09.989410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:21:09.989410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:21:09.989410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:09.989410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 418/833] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:21:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:09.989410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bff6f3-5073-4dc8-8ccd-a4379bdb9018 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:10.056756 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb44d90-d4cb-4d92-b4a9-0ec8d55ba502 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:10.098074 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd659651-f00b-4dc4-a68f-c3c4e67ace12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:10.098845 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd659651-f00b-4dc4-a68f-c3c4e67ace12 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:10.099123 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd659651-f00b-4dc4-a68f-c3c4e67ace12 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:10.099396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd659651-f00b-4dc4-a68f-c3c4e67ace12 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:10.100220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd659651-f00b-4dc4-a68f-c3c4e67ace12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:10.100524 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd659651-f00b-4dc4-a68f-c3c4e67ace12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:10.102006 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd659651-f00b-4dc4-a68f-c3c4e67ace12 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:10.104614 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bff6f3-5073-4dc8-8ccd-a4379bdb9018 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:10.107251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:10.114927 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 416/834] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:21:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:10.115775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd659651-f00b-4dc4-a68f-c3c4e67ace12 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:10.147129 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76967a42-fe20-4584-91f4-c9279784317d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:10.147803 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76967a42-fe20-4584-91f4-c9279784317d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:10.148116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76967a42-fe20-4584-91f4-c9279784317d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:10.148394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76967a42-fe20-4584-91f4-c9279784317d None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:10.149183 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76967a42-fe20-4584-91f4-c9279784317d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:10.149491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76967a42-fe20-4584-91f4-c9279784317d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:10.150948 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76967a42-fe20-4584-91f4-c9279784317d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:10.164986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 419/835] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:21:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:10.165849 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76967a42-fe20-4584-91f4-c9279784317d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:10.168811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:10.226051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd659651-f00b-4dc4-a68f-c3c4e67ace12 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:10.271785 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce182d-92fb-4956-90ab-fcfd3950ab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:10.272540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce182d-92fb-4956-90ab-fcfd3950ab11 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:10.272823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce182d-92fb-4956-90ab-fcfd3950ab11 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:10.273153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce182d-92fb-4956-90ab-fcfd3950ab11 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:10.273812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce182d-92fb-4956-90ab-fcfd3950ab11 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:10.275283 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce182d-92fb-4956-90ab-fcfd3950ab11 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:10.288113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-fbce182d-92fb-4956-90ab-fcfd3950ab11 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 16:21:10.288113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:10.288113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:10.288113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:10.288113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:10.288113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:10.288113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:10.288113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:10.288113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 16:21:10.288113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:10.288113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:10.288113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:10.288113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:10.288113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:10.288113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:10.288113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:10.288113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:10.290101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:10.290101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:10.290101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:10.290101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:10.290101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:10.290101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:10.290101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:10.290101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:10.290101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:10.290101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:10.290101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:10.290101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:10.290101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:10.290101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:10.290101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:10.290101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:10.292442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:10.292442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:10.292442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:10.292442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:10.292442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:10.292442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:10.292442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:10.292442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:10.292442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:10.292442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:10.292442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:10.292442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:10.292442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 16:21:10.292442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:10.294584 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76967a42-fe20-4584-91f4-c9279784317d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:10.294746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 417/836] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:21:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:10.294746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce182d-92fb-4956-90ab-fcfd3950ab11 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:10.331187 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62f394-8380-4963-ad59-1149630df589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:10.331875 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62f394-8380-4963-ad59-1149630df589 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:10.332194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62f394-8380-4963-ad59-1149630df589 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:10.332466 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62f394-8380-4963-ad59-1149630df589 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:10.333228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62f394-8380-4963-ad59-1149630df589 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:10.333530 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62f394-8380-4963-ad59-1149630df589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:10.334935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62f394-8380-4963-ad59-1149630df589 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:10.344317 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 420/837] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:21:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:10.345107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62f394-8380-4963-ad59-1149630df589 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:10.373281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:10.409030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce182d-92fb-4956-90ab-fcfd3950ab11 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:10.420361 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:10.445196 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15e924-dc23-4f8e-a324-ae755ee61898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:10.446206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15e924-dc23-4f8e-a324-ae755ee61898 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:10.446626 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15e924-dc23-4f8e-a324-ae755ee61898 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:10.446983 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15e924-dc23-4f8e-a324-ae755ee61898 None admin] PATH_INFO: `/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/2ccee0bc7e2b41f4a2fe2a891a95b318/roles/acbb2252c9f54cf8b789aa80f0a1fe85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:10.456731 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62f394-8380-4963-ad59-1149630df589 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:10.464093 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15e924-dc23-4f8e-a324-ae755ee61898 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5c551b621342e5a5a6e742d673d525, user_id=2ccee0bc7e2b41f4a2fe2a891a95b318, role_id=acbb2252c9f54cf8b789aa80f0a1fe85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:10.465591 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15e924-dc23-4f8e-a324-ae755ee61898 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:10.480790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 418/838] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:21:10 2022] PUT /identity/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/2ccee0bc7e2b41f4a2fe2a891a95b318/roles/acbb2252c9f54cf8b789aa80f0a1fe85 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:21:10.481626 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15e924-dc23-4f8e-a324-ae755ee61898 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:10.502051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc465b-30bb-4abc-95df-f17421ac68d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:10.502974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc465b-30bb-4abc-95df-f17421ac68d0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:10.503319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc465b-30bb-4abc-95df-f17421ac68d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:10.503649 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc465b-30bb-4abc-95df-f17421ac68d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:10.504678 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc465b-30bb-4abc-95df-f17421ac68d0 None admin] RBAC: Adding query filter params (role.id=e1e39192d3af465aa504728e32ab7cd2, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=3caa3dbc7bd24ebba28296a1eba9cefe) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:10.504988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc465b-30bb-4abc-95df-f17421ac68d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:10.506697 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc465b-30bb-4abc-95df-f17421ac68d0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:10.520255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 421/839] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:21:10 2022] GET /identity/v3/role_assignments?user.id=3caa3dbc7bd24ebba28296a1eba9cefe&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:10.521295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc465b-30bb-4abc-95df-f17421ac68d0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:10.626623 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15e924-dc23-4f8e-a324-ae755ee61898 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:10.665909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:10.680766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ead5d-cd88-4d3b-a4b1-c99861146d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:10.681483 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ead5d-cd88-4d3b-a4b1-c99861146d64 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:10.681810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ead5d-cd88-4d3b-a4b1-c99861146d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:10.682125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ead5d-cd88-4d3b-a4b1-c99861146d64 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:10.683012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ead5d-cd88-4d3b-a4b1-c99861146d64 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:10.683330 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ead5d-cd88-4d3b-a4b1-c99861146d64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:10.684954 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ead5d-cd88-4d3b-a4b1-c99861146d64 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:10.688498 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc465b-30bb-4abc-95df-f17421ac68d0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:10.697035 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 419/840] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:21:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:10.698160 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ead5d-cd88-4d3b-a4b1-c99861146d64 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:10.735027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:10.738914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e76a2e-ba3f-45b6-a5d8-6fa737e3bde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:10.739805 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e76a2e-ba3f-45b6-a5d8-6fa737e3bde7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:10.740229 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e76a2e-ba3f-45b6-a5d8-6fa737e3bde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:10.740572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e76a2e-ba3f-45b6-a5d8-6fa737e3bde7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:10.756453 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e76a2e-ba3f-45b6-a5d8-6fa737e3bde7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:10.758057 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e76a2e-ba3f-45b6-a5d8-6fa737e3bde7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:10.779807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-57e76a2e-ba3f-45b6-a5d8-6fa737e3bde7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:10.779807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:10.779807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:10.779807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:10.779807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:10.779807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:10.779807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:10.779807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:10.779807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:10.779807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:10.779807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:10.779807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:10.779807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:10.779807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:10.779807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:10.781181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:10.781181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:10.781181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:10.781181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:10.781181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:10.781181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:10.781181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:10.781181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:10.781181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:10.781181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:10.781181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:10.781181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:10.781181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:10.781181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:10.781181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:10.781181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:10.781181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:10.782578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:10.782578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:10.782578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:10.782578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:10.782578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 422/841] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:10.787369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e76a2e-ba3f-45b6-a5d8-6fa737e3bde7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:10.851770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ead5d-cd88-4d3b-a4b1-c99861146d64 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:10.894060 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1170e8-c28e-48d3-b325-dd293e662eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:10.894502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1170e8-c28e-48d3-b325-dd293e662eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:10.894779 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1170e8-c28e-48d3-b325-dd293e662eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:10.895052 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1170e8-c28e-48d3-b325-dd293e662eb3 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:10.895858 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1170e8-c28e-48d3-b325-dd293e662eb3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:10.896083 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1170e8-c28e-48d3-b325-dd293e662eb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:10.897488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1170e8-c28e-48d3-b325-dd293e662eb3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:10.902926 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 420/842] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:21:10 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:10.949648 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e76a2e-ba3f-45b6-a5d8-6fa737e3bde7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:10.993857 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5bb3d-3192-4a4e-87a5-db6d0b45b51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:10.994855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5bb3d-3192-4a4e-87a5-db6d0b45b51e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:10.995286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5bb3d-3192-4a4e-87a5-db6d0b45b51e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:10.995713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5bb3d-3192-4a4e-87a5-db6d0b45b51e None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:10.996651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5bb3d-3192-4a4e-87a5-db6d0b45b51e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:10.997113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5bb3d-3192-4a4e-87a5-db6d0b45b51e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:10.998715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5bb3d-3192-4a4e-87a5-db6d0b45b51e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:11.010955 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:11.014867 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 423/843] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:11.020437 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1170e8-c28e-48d3-b325-dd293e662eb3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:11.155941 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:11.170456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1170e8-c28e-48d3-b325-dd293e662eb3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:11.210197 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffbbab-6390-4b58-97b6-8d9b058fe458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:11.211365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffbbab-6390-4b58-97b6-8d9b058fe458 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:11.211741 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffbbab-6390-4b58-97b6-8d9b058fe458 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:11.212282 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffbbab-6390-4b58-97b6-8d9b058fe458 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:11.221148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffbbab-6390-4b58-97b6-8d9b058fe458 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:11.222987 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffbbab-6390-4b58-97b6-8d9b058fe458 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:11.240041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-13ffbbab-6390-4b58-97b6-8d9b058fe458 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 16:21:11.240041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:11.240041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:11.240041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:11.240041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:11.240041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:11.240041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:11.240041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:11.240041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:11.240041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:11.240041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:11.240041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:11.240041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:21:11.240041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:21:11.240041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:21:11.240041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:21:11.241178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:11.241178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:11.241178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:21:11.241178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:11.241178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:21:11.241178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:11.241178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:11.241178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:11.241178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:11.241178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:11.241178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:11.241178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:11.241178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:11.241178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:11.241178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:11.241178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:11.241178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:11.241178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:11.242390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:11.242390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:11.242390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:21:11.242390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:21:11.242390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:21:11.242390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:21:11.242390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:21:11.242390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:21:11.242390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 16:21:11.242390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:11.242390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 421/844] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:21:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:11.247489 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5bb3d-3192-4a4e-87a5-db6d0b45b51e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:11.368470 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5bb3d-3192-4a4e-87a5-db6d0b45b51e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:11.405505 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7650af-83e7-4092-b1d4-10a4d9c24a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:11.406263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7650af-83e7-4092-b1d4-10a4d9c24a1b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:11.406509 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7650af-83e7-4092-b1d4-10a4d9c24a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:11.406812 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7650af-83e7-4092-b1d4-10a4d9c24a1b None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:11.407848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7650af-83e7-4092-b1d4-10a4d9c24a1b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:11.408189 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7650af-83e7-4092-b1d4-10a4d9c24a1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:11.409736 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7650af-83e7-4092-b1d4-10a4d9c24a1b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:11.435715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 424/845] 10.222.0.41 () {56 vars in 1135 bytes} [Fri May 27 16:21:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:11.445143 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffbbab-6390-4b58-97b6-8d9b058fe458 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:11.556137 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffbbab-6390-4b58-97b6-8d9b058fe458 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:11.601947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145d3b0-413d-4f6f-a402-9017a543fe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:11.603598 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145d3b0-413d-4f6f-a402-9017a543fe47 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:11.604398 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145d3b0-413d-4f6f-a402-9017a543fe47 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:11.605130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145d3b0-413d-4f6f-a402-9017a543fe47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:11.636683 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:11.722892 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145d3b0-413d-4f6f-a402-9017a543fe47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:11.726031 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145d3b0-413d-4f6f-a402-9017a543fe47 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:11.906158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 422/846] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:21:11 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:21:11.915695 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7650af-83e7-4092-b1d4-10a4d9c24a1b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:12.025619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:12.079178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7650af-83e7-4092-b1d4-10a4d9c24a1b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:12.118892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6cc291-5e8f-4a2d-a335-0b71dca7755e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:12.119721 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cc291-5e8f-4a2d-a335-0b71dca7755e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:12.119999 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cc291-5e8f-4a2d-a335-0b71dca7755e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:12.120302 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cc291-5e8f-4a2d-a335-0b71dca7755e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:12.134015 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6cc291-5e8f-4a2d-a335-0b71dca7755e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:12.135568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6cc291-5e8f-4a2d-a335-0b71dca7755e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:12.156799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-af6cc291-5e8f-4a2d-a335-0b71dca7755e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:12.156799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:12.156799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:12.156799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:12.156799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:12.156799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:12.156799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:12.156799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:12.156799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:12.156799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:12.156799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:12.156799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:12.156799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:12.156799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:12.156799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:12.159610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:12.159610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:12.159610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:12.159610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:12.159610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:12.159610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:12.159610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:12.159610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:12.159610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:12.159610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:12.159610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:12.159610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:12.159610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:12.159610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:12.159610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:12.159610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:12.159610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:12.161421 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:12.161421 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:12.161421 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:12.161421 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:12.161421 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 425/847] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:12.163881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145d3b0-413d-4f6f-a402-9017a543fe47 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:12.223055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:12.276738 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145d3b0-413d-4f6f-a402-9017a543fe47 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:12.313403 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80830ce-f171-4824-bad2-50bf4cc52a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:12.314077 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80830ce-f171-4824-bad2-50bf4cc52a42 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:12.314359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80830ce-f171-4824-bad2-50bf4cc52a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:12.314630 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80830ce-f171-4824-bad2-50bf4cc52a42 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:12.315449 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80830ce-f171-4824-bad2-50bf4cc52a42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:12.315754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80830ce-f171-4824-bad2-50bf4cc52a42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:12.317191 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80830ce-f171-4824-bad2-50bf4cc52a42 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:12.331244 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 423/848] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:12.337164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6cc291-5e8f-4a2d-a335-0b71dca7755e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:12.444257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6cc291-5e8f-4a2d-a335-0b71dca7755e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:12.455799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:12.480938 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c4510-4091-4f4b-8174-75b781d2285d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:12.481767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c4510-4091-4f4b-8174-75b781d2285d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:12.482049 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c4510-4091-4f4b-8174-75b781d2285d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:12.482322 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c4510-4091-4f4b-8174-75b781d2285d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:12.490231 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c4510-4091-4f4b-8174-75b781d2285d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:12.491720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c4510-4091-4f4b-8174-75b781d2285d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:12.507615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-183c4510-4091-4f4b-8174-75b781d2285d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:12.507615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:12.507615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:12.507615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:12.507615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:12.507615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:12.507615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:12.507615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:12.507615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:12.507615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:12.507615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:12.507615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:12.507615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:21:12.507615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:21:12.507615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:21:12.508680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:21:12.508680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:12.508680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:12.508680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:12.508680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:12.508680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:12.508680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:12.508680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:12.508680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:12.508680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:12.508680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:12.508680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:12.508680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:12.508680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:12.508680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:12.508680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:12.508680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:12.509619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:21:12.509619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:21:12.509619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:21:12.509619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:21:12.509619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:21:12.509619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:21:12.509619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:12.509619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:12.509619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 426/849] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:12.516830 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80830ce-f171-4824-bad2-50bf4cc52a42 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:12.632700 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80830ce-f171-4824-bad2-50bf4cc52a42 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:12.642954 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:12.672366 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f9e0d-accd-4791-8050-69c4d6d50eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:12.673037 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f9e0d-accd-4791-8050-69c4d6d50eeb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:12.673315 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f9e0d-accd-4791-8050-69c4d6d50eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:12.673587 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f9e0d-accd-4791-8050-69c4d6d50eeb None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:12.674413 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f9e0d-accd-4791-8050-69c4d6d50eeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:12.674766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f9e0d-accd-4791-8050-69c4d6d50eeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:12.676724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463f9e0d-accd-4791-8050-69c4d6d50eeb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:12.690634 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 424/850] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:21:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:12.696980 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c4510-4091-4f4b-8174-75b781d2285d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:12.872300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c4510-4091-4f4b-8174-75b781d2285d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:12.935092 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33c88b-5fd0-4e76-8f31-833e15dd0789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:12.936262 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33c88b-5fd0-4e76-8f31-833e15dd0789 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:12.936771 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33c88b-5fd0-4e76-8f31-833e15dd0789 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:12.937271 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33c88b-5fd0-4e76-8f31-833e15dd0789 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:12.938920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33c88b-5fd0-4e76-8f31-833e15dd0789 None admin] RBAC: Adding query filter params (role.id=e1e39192d3af465aa504728e32ab7cd2, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=dbfcca96ad754692b3fb7f891013dafb) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:12.939453 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33c88b-5fd0-4e76-8f31-833e15dd0789 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:12.942300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33c88b-5fd0-4e76-8f31-833e15dd0789 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:12.954827 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 427/851] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:21:12 2022] GET /identity/v3/role_assignments?user.id=dbfcca96ad754692b3fb7f891013dafb&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:13.065916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5420f14-b6ef-49bf-a6d8-29d651661644 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:13.066397 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5420f14-b6ef-49bf-a6d8-29d651661644 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:13.066800 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5420f14-b6ef-49bf-a6d8-29d651661644 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:13.068857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 425/852] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:13.075570 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90f0ef-60b8-42a1-bc38-1547446ae33d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:13.076224 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90f0ef-60b8-42a1-bc38-1547446ae33d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:13.076816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90f0ef-60b8-42a1-bc38-1547446ae33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:13.107194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-5a90f0ef-60b8-42a1-bc38-1547446ae33d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:13.109432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5a90f0ef-60b8-42a1-bc38-1547446ae33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:13.165138 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:13.225881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8514957-d17c-4a70-8d19-1f01f368904c None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:13.226427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8514957-d17c-4a70-8d19-1f01f368904c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:13.226427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8514957-d17c-4a70-8d19-1f01f368904c None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:13.227974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 426/853] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:13.233616 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b7d63-948c-46d7-b7df-1d0e76b547d5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:13.233918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b7d63-948c-46d7-b7df-1d0e76b547d5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:13.234177 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b7d63-948c-46d7-b7df-1d0e76b547d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:13.239210 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 428/854] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:13.240685 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9ba1b-bfb2-495c-b87b-aa98c3f1cbe8 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:13.240978 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9ba1b-bfb2-495c-b87b-aa98c3f1cbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:13.241256 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9ba1b-bfb2-495c-b87b-aa98c3f1cbe8 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:13.243042 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 429/855] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:13.248686 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b6ca3-2681-4036-b1a1-c16d04caf198 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:13.248994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b6ca3-2681-4036-b1a1-c16d04caf198 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:13.249245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b6ca3-2681-4036-b1a1-c16d04caf198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:13.267205 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d22b7d63-948c-46d7-b7df-1d0e76b547d5 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:13.267416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-059b6ca3-2681-4036-b1a1-c16d04caf198 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:13.268784 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-059b6ca3-2681-4036-b1a1-c16d04caf198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:13.269301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d22b7d63-948c-46d7-b7df-1d0e76b547d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:13.355851 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 430/856] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:21:13.356583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b6ca3-2681-4036-b1a1-c16d04caf198 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:13.383313 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 427/857] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:21:13.384353 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b7d63-948c-46d7-b7df-1d0e76b547d5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:13.468998 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:13.477588 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b6ca3-2681-4036-b1a1-c16d04caf198 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:13.509279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:13.514346 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b7d63-948c-46d7-b7df-1d0e76b547d5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:13.518801 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f72d2-7034-493f-a816-7d366ae212d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:13.519941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f72d2-7034-493f-a816-7d366ae212d7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:13.520421 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f72d2-7034-493f-a816-7d366ae212d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:13.520857 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f72d2-7034-493f-a816-7d366ae212d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:13.533649 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f72d2-7034-493f-a816-7d366ae212d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:21:13.542162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-793f72d2-7034-493f-a816-7d366ae212d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:21:13.542162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:13.542162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:13.542162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:13.542162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:13.542162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:13.542162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:13.542162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:13.542162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:13.542162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:13.542162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:13.542162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:13.542162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:21:13.542162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:21:13.542162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:21:13.542162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:21:13.543416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:21:13.543416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:21:13.543416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:21:13.543416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:21:13.543416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:13.543416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:13.543416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:13.543416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:13.543416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:13.543416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:13.543416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:13.543416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:13.543416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:13.543416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:13.543416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:13.543416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:13.544433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:13.544433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:13.544433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:13.544433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:13.544433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:21:13.544433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:21:13.544433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:21:13.544433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:21:13.544433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:21:13.544433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:21:13.544433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:21:13.544433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:13.550769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 431/858] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:21:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:13.550769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f72d2-7034-493f-a816-7d366ae212d7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:13.559556 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30212419-09ee-4153-9289-407b5c05e9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:13.560444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30212419-09ee-4153-9289-407b5c05e9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:13.560724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30212419-09ee-4153-9289-407b5c05e9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:13.560995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30212419-09ee-4153-9289-407b5c05e9d9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:13.561657 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30212419-09ee-4153-9289-407b5c05e9d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:13.563088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30212419-09ee-4153-9289-407b5c05e9d9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:13.577153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-30212419-09ee-4153-9289-407b5c05e9d9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 16:21:13.577153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:13.577153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:13.577153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:13.577153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:13.577153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:13.577153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:13.577153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:13.577153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 16:21:13.577153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:13.577153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:13.577153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:13.577153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:13.577153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:13.577153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:13.577153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:13.578434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:13.578434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:13.578434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:13.578434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:13.578434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:13.578434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:13.578434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:13.578434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:13.578434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:13.578434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:13.578434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:13.578434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:13.578434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:13.578434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:13.578434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:13.578434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:13.579354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:13.579354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:13.579354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:13.579354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:13.579354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:13.579354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:13.579354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:13.579354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:13.579354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:13.579354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:13.579354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:13.579354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:13.579354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:13.579354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 16:21:13.579354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:13.579354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 428/859] 10.222.0.41 () {56 vars in 1132 bytes} [Fri May 27 16:21:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:13.580973 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30212419-09ee-4153-9289-407b5c05e9d9 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:13.668416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f72d2-7034-493f-a816-7d366ae212d7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:13.708026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30212419-09ee-4153-9289-407b5c05e9d9 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:13.715054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b5546-84cb-4671-bbd1-1adcbe2ff400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:13.715751 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b5546-84cb-4671-bbd1-1adcbe2ff400 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:13.716041 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b5546-84cb-4671-bbd1-1adcbe2ff400 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:13.716345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b5546-84cb-4671-bbd1-1adcbe2ff400 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:13.717365 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b5546-84cb-4671-bbd1-1adcbe2ff400 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:13.718481 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b5546-84cb-4671-bbd1-1adcbe2ff400 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:13.735156 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 432/860] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 16:21:13 2022] POST /identity/v3/services => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:21:13.736002 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b5546-84cb-4671-bbd1-1adcbe2ff400 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:13.755955 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:13.794431 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34931f99-ebbb-4c4f-8f31-d013132cc3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:13.795129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34931f99-ebbb-4c4f-8f31-d013132cc3ef None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:13.795411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34931f99-ebbb-4c4f-8f31-d013132cc3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:13.795685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34931f99-ebbb-4c4f-8f31-d013132cc3ef None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:13.796526 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34931f99-ebbb-4c4f-8f31-d013132cc3ef None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:13.796906 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34931f99-ebbb-4c4f-8f31-d013132cc3ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:13.799385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34931f99-ebbb-4c4f-8f31-d013132cc3ef None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:13.816999 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 429/861] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:21:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:13.818022 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34931f99-ebbb-4c4f-8f31-d013132cc3ef None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:13.844852 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:13.895825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b5546-84cb-4671-bbd1-1adcbe2ff400 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:13.947250 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19101cb8-b970-430a-bb17-5cb0b87f621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:13.948261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19101cb8-b970-430a-bb17-5cb0b87f621e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:13.948551 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19101cb8-b970-430a-bb17-5cb0b87f621e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:13.948830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19101cb8-b970-430a-bb17-5cb0b87f621e None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:13.949606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19101cb8-b970-430a-bb17-5cb0b87f621e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:13.949906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19101cb8-b970-430a-bb17-5cb0b87f621e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:13.951330 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19101cb8-b970-430a-bb17-5cb0b87f621e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:13.960196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 433/862] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 16:21:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:13.969917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34931f99-ebbb-4c4f-8f31-d013132cc3ef None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:13.970527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19101cb8-b970-430a-bb17-5cb0b87f621e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:14.017825 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a9064-b5c2-402a-b2a1-722844b4f957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:14.018802 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a9064-b5c2-402a-b2a1-722844b4f957 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:14.018929 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a9064-b5c2-402a-b2a1-722844b4f957 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:14.019109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a9064-b5c2-402a-b2a1-722844b4f957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:14.032055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a9064-b5c2-402a-b2a1-722844b4f957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:14.033927 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a9064-b5c2-402a-b2a1-722844b4f957 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:14.053373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-f62a9064-b5c2-402a-b2a1-722844b4f957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:14.053373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:14.053373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:14.053373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:14.053373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:14.053373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:14.053373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:14.053373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:14.053373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:14.053373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:14.053373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:14.053373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:14.053373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:14.053373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:14.053373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:14.054378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:14.054378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:14.054378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:14.054378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:14.054378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:14.054378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:14.054378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:14.054378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:14.054378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:14.054378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:14.054378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:14.054378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:14.054378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:14.054378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:14.054378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:14.054378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:14.054378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:14.055372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:14.055372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:14.055372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:14.055372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:14.055372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 430/863] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:14.061372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a9064-b5c2-402a-b2a1-722844b4f957 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:14.080180 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:14.106030 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19101cb8-b970-430a-bb17-5cb0b87f621e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:14.140543 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:14.145604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6842e88-092d-4f35-ae27-f5ff918134f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:14.146564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6842e88-092d-4f35-ae27-f5ff918134f2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:14.146991 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6842e88-092d-4f35-ae27-f5ff918134f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:14.147416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6842e88-092d-4f35-ae27-f5ff918134f2 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:14.148317 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6842e88-092d-4f35-ae27-f5ff918134f2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:14.148766 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6842e88-092d-4f35-ae27-f5ff918134f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:14.150391 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6842e88-092d-4f35-ae27-f5ff918134f2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:14.157634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 434/864] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 16:21:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:14.180336 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a9064-b5c2-402a-b2a1-722844b4f957 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:14.223505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70dff6-57ad-4e7b-96f9-024b9ab24287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:14.224543 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70dff6-57ad-4e7b-96f9-024b9ab24287 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:14.225025 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70dff6-57ad-4e7b-96f9-024b9ab24287 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:14.225465 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70dff6-57ad-4e7b-96f9-024b9ab24287 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:14.226442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70dff6-57ad-4e7b-96f9-024b9ab24287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:14.227566 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70dff6-57ad-4e7b-96f9-024b9ab24287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:14.229386 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70dff6-57ad-4e7b-96f9-024b9ab24287 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:14.246086 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 431/865] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:14.253654 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6842e88-092d-4f35-ae27-f5ff918134f2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:14.407206 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6842e88-092d-4f35-ae27-f5ff918134f2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:14.448333 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9ff4b-a894-432f-82b7-cb91492677bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:14.449415 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9ff4b-a894-432f-82b7-cb91492677bd None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:14.449726 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9ff4b-a894-432f-82b7-cb91492677bd None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:14.450006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9ff4b-a894-432f-82b7-cb91492677bd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:14.460731 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9ff4b-a894-432f-82b7-cb91492677bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:14.462240 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9ff4b-a894-432f-82b7-cb91492677bd None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:14.479459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-0ac9ff4b-a894-432f-82b7-cb91492677bd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:21:14.479459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:14.479459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:14.479459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:14.479459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:14.479459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:14.479459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:14.479459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:14.479459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:14.479459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:14.479459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:14.479459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:14.479459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:21:14.479459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:21:14.479459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:21:14.479459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:21:14.480573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:14.480573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:14.480573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:21:14.480573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:14.480573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:21:14.480573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:14.480573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:14.480573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:14.480573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:14.480573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:14.480573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:14.480573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:14.480573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:14.480573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:14.480573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:14.480573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:14.480573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:14.480573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:14.482959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:14.482959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:14.482959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:21:14.482959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:21:14.482959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:21:14.482959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:21:14.482959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:21:14.482959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:21:14.482959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:21:14.482959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:14.482959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 435/866] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 16:21:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:14.488598 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70dff6-57ad-4e7b-96f9-024b9ab24287 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:14.668888 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70dff6-57ad-4e7b-96f9-024b9ab24287 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:14.704838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:14.714619 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa26820-4b7a-4c26-a7ad-550c0ea1ae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:14.715709 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa26820-4b7a-4c26-a7ad-550c0ea1ae93 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:14.716234 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa26820-4b7a-4c26-a7ad-550c0ea1ae93 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:14.716712 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa26820-4b7a-4c26-a7ad-550c0ea1ae93 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:14.717758 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa26820-4b7a-4c26-a7ad-550c0ea1ae93 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:14.722759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa26820-4b7a-4c26-a7ad-550c0ea1ae93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:14.724907 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa26820-4b7a-4c26-a7ad-550c0ea1ae93 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:14.766949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 432/867] 10.222.0.41 () {56 vars in 1149 bytes} [Fri May 27 16:21:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:14.769931 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9ff4b-a894-432f-82b7-cb91492677bd None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:14.781434 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:14.960876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9ff4b-a894-432f-82b7-cb91492677bd None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:14.996969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc00195-99e1-4ddb-b198-0045a16f679f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:14.997673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc00195-99e1-4ddb-b198-0045a16f679f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:14.997960 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc00195-99e1-4ddb-b198-0045a16f679f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:14.998232 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc00195-99e1-4ddb-b198-0045a16f679f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:15.072782 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc00195-99e1-4ddb-b198-0045a16f679f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:15.074277 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc00195-99e1-4ddb-b198-0045a16f679f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:15.076345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:15.189910 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 436/868] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:21:14 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:21:15.195022 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa26820-4b7a-4c26-a7ad-550c0ea1ae93 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:15.307770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa26820-4b7a-4c26-a7ad-550c0ea1ae93 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:15.344893 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9803f6-0f07-43f8-ae53-9b6f58f9823f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:15.345742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9803f6-0f07-43f8-ae53-9b6f58f9823f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:15.346065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9803f6-0f07-43f8-ae53-9b6f58f9823f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:15.346519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9803f6-0f07-43f8-ae53-9b6f58f9823f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:15.357069 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9803f6-0f07-43f8-ae53-9b6f58f9823f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:15.358565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9803f6-0f07-43f8-ae53-9b6f58f9823f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:15.376781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-3b9803f6-0f07-43f8-ae53-9b6f58f9823f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:15.376781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:15.376781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:15.376781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:15.376781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:15.376781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:15.376781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:15.376781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:15.376781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:15.376781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:15.376781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:15.376781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:15.376781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:15.376781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:15.376781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:15.378947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:15.378947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:15.378947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:15.378947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:15.378947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:15.378947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:15.378947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:15.378947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:15.378947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:15.378947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:15.378947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:15.378947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:15.378947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:15.378947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:15.378947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:15.378947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:15.378947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:15.381023 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:15.381023 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:15.381023 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:15.381023 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:15.381023 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 433/869] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:21:15.389139 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc00195-99e1-4ddb-b198-0045a16f679f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:15.503957 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc00195-99e1-4ddb-b198-0045a16f679f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:15.505534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15511e1d-a3b0-4a8a-be44-9163b833c4c3 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:15.505876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:15.506326 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15511e1d-a3b0-4a8a-be44-9163b833c4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:15.506822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15511e1d-a3b0-4a8a-be44-9163b833c4c3 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:15.508935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 434/870] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:21:15.515183 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a9a5b-d42d-4518-962c-20c1dc0c9c81 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:15.515825 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a9a5b-d42d-4518-962c-20c1dc0c9c81 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:15.516367 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a9a5b-d42d-4518-962c-20c1dc0c9c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:15.536979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-599a9a5b-d42d-4518-962c-20c1dc0c9c81 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:15.538542 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-599a9a5b-d42d-4518-962c-20c1dc0c9c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:15.549045 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41670d55-bf08-4a39-9203-3436a80a812e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:15.550350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41670d55-bf08-4a39-9203-3436a80a812e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:15.550626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41670d55-bf08-4a39-9203-3436a80a812e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:15.550900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41670d55-bf08-4a39-9203-3436a80a812e None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:15.551654 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41670d55-bf08-4a39-9203-3436a80a812e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:15.551957 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41670d55-bf08-4a39-9203-3436a80a812e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:15.553419 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41670d55-bf08-4a39-9203-3436a80a812e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:15.571806 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 437/871] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:15.573405 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41670d55-bf08-4a39-9203-3436a80a812e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:15.591358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:15.648034 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 435/872] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:21:15.664386 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a9a5b-d42d-4518-962c-20c1dc0c9c81 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:15.705486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41670d55-bf08-4a39-9203-3436a80a812e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:15.742783 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65f44a-4199-4153-b9ce-f2b6b2abbb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:15.743606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65f44a-4199-4153-b9ce-f2b6b2abbb78 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:15.743890 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65f44a-4199-4153-b9ce-f2b6b2abbb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:15.744200 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65f44a-4199-4153-b9ce-f2b6b2abbb78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:15.755921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65f44a-4199-4153-b9ce-f2b6b2abbb78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:15.757326 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65f44a-4199-4153-b9ce-f2b6b2abbb78 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:15.772528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-9c65f44a-4199-4153-b9ce-f2b6b2abbb78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:15.772528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:15.772528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:15.772528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:15.772528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:15.772528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:15.772528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:15.772528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:15.772528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:15.772528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:15.772528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:15.772528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:15.772528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:21:15.772528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:21:15.772528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:21:15.773572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:21:15.773572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:15.773572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:15.773572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:15.773572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:15.773572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:15.773572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:15.773572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:15.773572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:15.773572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:15.773572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:15.773572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:15.773572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:15.773572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:15.773572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:15.773572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:15.773572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:15.774501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:21:15.774501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:21:15.774501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:21:15.774501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:21:15.774501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:21:15.774501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:21:15.774501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:15.774501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:15.778705 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 438/873] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:21:15.779644 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65f44a-4199-4153-b9ce-f2b6b2abbb78 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:15.785005 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a9a5b-d42d-4518-962c-20c1dc0c9c81 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:15.805067 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:15.821561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2c43f-4e1d-4788-9816-40da4e5f0e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:15.822804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2c43f-4e1d-4788-9816-40da4e5f0e73 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:15.823279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2c43f-4e1d-4788-9816-40da4e5f0e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:15.823743 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2c43f-4e1d-4788-9816-40da4e5f0e73 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:15.824630 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2c43f-4e1d-4788-9816-40da4e5f0e73 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:15.826243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2c43f-4e1d-4788-9816-40da4e5f0e73 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:15.839674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2ee2c43f-4e1d-4788-9816-40da4e5f0e73 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:21:15.839674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:15.839674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:15.839674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:15.839674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:15.839674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:15.839674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:15.839674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:15.839674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:21:15.839674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:15.839674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:15.839674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:15.839674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:15.839674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:15.839674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:15.839674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:15.839674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:15.840934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:15.840934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:15.840934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:15.840934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:15.840934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:15.840934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:15.840934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:15.840934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:15.840934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:15.840934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:15.840934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:15.840934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:15.840934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:15.840934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:15.840934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:15.840934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:15.841982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:15.841982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:15.841982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:15.841982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:15.841982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:15.841982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:15.841982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:15.841982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:15.841982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:15.841982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:15.841982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:15.841982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:15.841982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:21:15.841982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:15.849476 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 436/874] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 16:21:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:21:15.850647 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2c43f-4e1d-4788-9816-40da4e5f0e73 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:15.887683 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:15.889391 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65f44a-4199-4153-b9ce-f2b6b2abbb78 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:15.929137 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc061124-00f4-4f28-94f7-400592414e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:15.929815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc061124-00f4-4f28-94f7-400592414e86 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:15.930100 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc061124-00f4-4f28-94f7-400592414e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:15.930379 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc061124-00f4-4f28-94f7-400592414e86 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:15.931332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc061124-00f4-4f28-94f7-400592414e86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:15.931595 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc061124-00f4-4f28-94f7-400592414e86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:15.933589 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc061124-00f4-4f28-94f7-400592414e86 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:15.952373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 439/875] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:21:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:15.954309 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc061124-00f4-4f28-94f7-400592414e86 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:15.961426 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2c43f-4e1d-4788-9816-40da4e5f0e73 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:15.996611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526aeea5-bb9a-4176-8fea-ee583a2df15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:15.997582 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526aeea5-bb9a-4176-8fea-ee583a2df15d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:15.998080 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526aeea5-bb9a-4176-8fea-ee583a2df15d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:15.998493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526aeea5-bb9a-4176-8fea-ee583a2df15d None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:15.999328 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526aeea5-bb9a-4176-8fea-ee583a2df15d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:15.999786 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526aeea5-bb9a-4176-8fea-ee583a2df15d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:16.001345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526aeea5-bb9a-4176-8fea-ee583a2df15d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:16.012628 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 437/876] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 16:21:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:16.013858 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526aeea5-bb9a-4176-8fea-ee583a2df15d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:16.049166 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:16.073389 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc061124-00f4-4f28-94f7-400592414e86 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:16.111013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b51d5c-22c8-4471-8ed0-ae71d8078f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:16.111781 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b51d5c-22c8-4471-8ed0-ae71d8078f8f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:16.112098 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b51d5c-22c8-4471-8ed0-ae71d8078f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:16.112380 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b51d5c-22c8-4471-8ed0-ae71d8078f8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:16.113233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b51d5c-22c8-4471-8ed0-ae71d8078f8f None admin] RBAC: Adding query filter params (role.id=acbb2252c9f54cf8b789aa80f0a1fe85, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=2ccee0bc7e2b41f4a2fe2a891a95b318) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:16.113551 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b51d5c-22c8-4471-8ed0-ae71d8078f8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:16.115255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b51d5c-22c8-4471-8ed0-ae71d8078f8f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:16.127682 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526aeea5-bb9a-4176-8fea-ee583a2df15d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:16.128314 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 440/877] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:21:15 2022] GET /identity/v3/role_assignments?user.id=2ccee0bc7e2b41f4a2fe2a891a95b318&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=acbb2252c9f54cf8b789aa80f0a1fe85 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:16.130029 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:16.176205 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e796e-2ba3-49b8-b873-c2a279d6f559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:16.176205 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e796e-2ba3-49b8-b873-c2a279d6f559 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:16.176205 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e796e-2ba3-49b8-b873-c2a279d6f559 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:16.176205 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e796e-2ba3-49b8-b873-c2a279d6f559 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:16.176660 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e796e-2ba3-49b8-b873-c2a279d6f559 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:16.176660 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e796e-2ba3-49b8-b873-c2a279d6f559 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:16.176660 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e796e-2ba3-49b8-b873-c2a279d6f559 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:16.185464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 438/878] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 16:21:16 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:16.224439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c9a38-db9d-46d2-825b-4930450fd18c None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:16.224760 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c9a38-db9d-46d2-825b-4930450fd18c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:16.225175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c9a38-db9d-46d2-825b-4930450fd18c None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:16.227069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 441/879] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:16.233197 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4490b40-f830-491d-9626-a4591f4e928a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:16.233537 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4490b40-f830-491d-9626-a4591f4e928a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:16.233753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4490b40-f830-491d-9626-a4591f4e928a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:16.256582 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d4490b40-f830-491d-9626-a4591f4e928a None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:16.257859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d4490b40-f830-491d-9626-a4591f4e928a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:16.349164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 439/880] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:16.371424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c9a38-db9d-46d2-825b-4930450fd18c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:16.524298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c9a38-db9d-46d2-825b-4930450fd18c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:16.563361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9ccb5-a844-4ae1-ac44-675dbe6f56a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:16.564677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9ccb5-a844-4ae1-ac44-675dbe6f56a9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:16.565923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9ccb5-a844-4ae1-ac44-675dbe6f56a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:16.566394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9ccb5-a844-4ae1-ac44-675dbe6f56a9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:16.567271 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9ccb5-a844-4ae1-ac44-675dbe6f56a9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:16.568952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9ccb5-a844-4ae1-ac44-675dbe6f56a9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:16.583911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-fad9ccb5-a844-4ae1-ac44-675dbe6f56a9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 16:21:16.583911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:16.583911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:16.583911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:16.583911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:16.583911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:16.583911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:16.583911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:16.583911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 16:21:16.583911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:16.583911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:16.583911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:16.583911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:16.583911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:16.583911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:16.583911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:16.583911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:16.585706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:16.585706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:16.585706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:16.585706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:16.585706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:16.585706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:16.585706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:16.585706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:16.585706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:16.585706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:16.585706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:16.585706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:16.585706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:16.585706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:16.585706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:16.585706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:16.586573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:16.586573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:16.586573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:16.586573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:16.586573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:16.586573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:16.586573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:16.586573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:16.586573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:16.586573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:16.586573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:16.586573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:16.586573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 16:21:16.586573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:16.589307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 442/881] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:21:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:16.596064 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4490b40-f830-491d-9626-a4591f4e928a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:16.652128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4345a-ff0a-4231-845c-8a6ab3595547 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:16.652350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4345a-ff0a-4231-845c-8a6ab3595547 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:16.652635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4345a-ff0a-4231-845c-8a6ab3595547 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:16.655407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 443/882] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:21:16.660323 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92236b3d-9ab3-4bdf-be9d-4a82faf640c2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:16.660602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92236b3d-9ab3-4bdf-be9d-4a82faf640c2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:16.660880 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92236b3d-9ab3-4bdf-be9d-4a82faf640c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:16.684499 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-92236b3d-9ab3-4bdf-be9d-4a82faf640c2 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:16.687140 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-92236b3d-9ab3-4bdf-be9d-4a82faf640c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:16.693677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:16.700390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:16.707712 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4490b40-f830-491d-9626-a4591f4e928a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:16.755252 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ae92f-ab07-4d2e-a0a1-534c03d51db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:16.756305 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ae92f-ab07-4d2e-a0a1-534c03d51db4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:16.756796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ae92f-ab07-4d2e-a0a1-534c03d51db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:16.757281 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ae92f-ab07-4d2e-a0a1-534c03d51db4 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:16.758216 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ae92f-ab07-4d2e-a0a1-534c03d51db4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:16.758719 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ae92f-ab07-4d2e-a0a1-534c03d51db4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:16.760415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ae92f-ab07-4d2e-a0a1-534c03d51db4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:16.773868 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 440/883] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:21:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:16.775799 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ae92f-ab07-4d2e-a0a1-534c03d51db4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:16.800085 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 444/884] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:21:16.827455 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92236b3d-9ab3-4bdf-be9d-4a82faf640c2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:16.913376 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ae92f-ab07-4d2e-a0a1-534c03d51db4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:16.967198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9d834-ac87-41c2-a631-44b1f2c3a77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:16.968651 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9d834-ac87-41c2-a631-44b1f2c3a77e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:16.969723 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9d834-ac87-41c2-a631-44b1f2c3a77e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:16.970446 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9d834-ac87-41c2-a631-44b1f2c3a77e None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:16.971676 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9d834-ac87-41c2-a631-44b1f2c3a77e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:16.972430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9d834-ac87-41c2-a631-44b1f2c3a77e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:16.974838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9d834-ac87-41c2-a631-44b1f2c3a77e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:16.976136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92236b3d-9ab3-4bdf-be9d-4a82faf640c2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:16.988038 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 441/885] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:21:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:16.989282 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9d834-ac87-41c2-a631-44b1f2c3a77e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:17.017261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b7cf0-fbe0-45d3-b1bb-48934271a0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:17.018176 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b7cf0-fbe0-45d3-b1bb-48934271a0e9 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:17.018610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b7cf0-fbe0-45d3-b1bb-48934271a0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:17.018958 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b7cf0-fbe0-45d3-b1bb-48934271a0e9 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:17.019826 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b7cf0-fbe0-45d3-b1bb-48934271a0e9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:17.021437 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b7cf0-fbe0-45d3-b1bb-48934271a0e9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:17.022774 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:17.035441 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:17.049604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 445/886] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 16:21:16 2022] POST /identity/v3/services => generated 269 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:21:17.120944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9d834-ac87-41c2-a631-44b1f2c3a77e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:17.169454 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021e569-31df-46a6-b83e-d4d5c1a3af39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:17.170447 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021e569-31df-46a6-b83e-d4d5c1a3af39 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:17.171001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021e569-31df-46a6-b83e-d4d5c1a3af39 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:17.171445 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021e569-31df-46a6-b83e-d4d5c1a3af39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:17.172449 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021e569-31df-46a6-b83e-d4d5c1a3af39 None admin] RBAC: Adding query filter params (interface=public, service_id=d946938b122f40a5aadb8f8c9ddb0169, region_id=RegionOne) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:17.172951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021e569-31df-46a6-b83e-d4d5c1a3af39 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:17.174641 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021e569-31df-46a6-b83e-d4d5c1a3af39 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:17.181341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 442/887] 10.222.0.41 () {56 vars in 1251 bytes} [Fri May 27 16:21:16 2022] GET /identity/v3/endpoints?service_id=d946938b122f40a5aadb8f8c9ddb0169&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:17.187337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b7cf0-fbe0-45d3-b1bb-48934271a0e9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:17.298717 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b7cf0-fbe0-45d3-b1bb-48934271a0e9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:17.338747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ee18c-ff68-4980-b1bf-3262a4fec136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:17.339817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ee18c-ff68-4980-b1bf-3262a4fec136 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:17.340326 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ee18c-ff68-4980-b1bf-3262a4fec136 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:17.340800 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ee18c-ff68-4980-b1bf-3262a4fec136 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:17.341695 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ee18c-ff68-4980-b1bf-3262a4fec136 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:17.343277 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ee18c-ff68-4980-b1bf-3262a4fec136 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:17.350495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 446/888] 10.222.0.41 () {56 vars in 1087 bytes} [Fri May 27 16:21:17 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:21:18.557112 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb8e9f-9852-44b7-b400-de7d7ef5bd72 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:18.558177 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb8e9f-9852-44b7-b400-de7d7ef5bd72 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:18.558655 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb8e9f-9852-44b7-b400-de7d7ef5bd72 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:18.560654 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 443/889] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:18.565956 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ce818-6077-4a00-85d2-f76dae4e19c8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:18.566403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ce818-6077-4a00-85d2-f76dae4e19c8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:18.566583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ce818-6077-4a00-85d2-f76dae4e19c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:18.584489 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-846ce818-6077-4a00-85d2-f76dae4e19c8 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:18.585690 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-846ce818-6077-4a00-85d2-f76dae4e19c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:18.606286 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fea056-a8e4-4302-a375-f2083ba4c552 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:18.606593 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fea056-a8e4-4302-a375-f2083ba4c552 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:18.606840 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fea056-a8e4-4302-a375-f2083ba4c552 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:18.608509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 444/890] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:18.614552 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea30fee-9354-42e9-bbf9-640483a25a76 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:18.614842 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea30fee-9354-42e9-bbf9-640483a25a76 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:18.615119 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea30fee-9354-42e9-bbf9-640483a25a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:18.633818 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-bea30fee-9354-42e9-bbf9-640483a25a76 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:18.635012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bea30fee-9354-42e9-bbf9-640483a25a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:18.655753 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:18.668631 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 447/891] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:21:18.693176 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ce818-6077-4a00-85d2-f76dae4e19c8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:18.725608 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 445/892] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:18.750748 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea30fee-9354-42e9-bbf9-640483a25a76 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:18.766420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:18.802643 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ce818-6077-4a00-85d2-f76dae4e19c8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:18.849407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb2b88-6941-4a1b-a6ed-50bc095e0c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:18.850861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb2b88-6941-4a1b-a6ed-50bc095e0c90 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:18.851609 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb2b88-6941-4a1b-a6ed-50bc095e0c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:18.852387 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fb2b88-6941-4a1b-a6ed-50bc095e0c90 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:18.867185 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea30fee-9354-42e9-bbf9-640483a25a76 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:18.872703 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fb2b88-6941-4a1b-a6ed-50bc095e0c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:21:18.890274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-d6fb2b88-6941-4a1b-a6ed-50bc095e0c90 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:21:18.890274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:18.890274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:18.890274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:18.890274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:18.890274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:18.890274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:18.890274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:18.890274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:18.890274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:18.890274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:18.890274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:18.890274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:21:18.890274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:21:18.890274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:21:18.890274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:21:18.892122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:21:18.892122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:21:18.892122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:21:18.892122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:21:18.892122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:18.892122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:18.892122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:18.892122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:18.892122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:18.892122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:18.892122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:18.892122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:18.892122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:18.892122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:18.892122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:18.892122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:18.893870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:18.893870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:18.893870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:18.893870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:18.893870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:21:18.893870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:21:18.893870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:21:18.893870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:21:18.893870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:21:18.893870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:21:18.893870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:21:18.893870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:18.901885 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 448/893] 10.222.0.41 () {56 vars in 1120 bytes} [Fri May 27 16:21:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:18.904105 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb2b88-6941-4a1b-a6ed-50bc095e0c90 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:18.905418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcbcfd-59d0-48e7-b16d-a0269b969b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:18.906174 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcbcfd-59d0-48e7-b16d-a0269b969b82 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:18.906526 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcbcfd-59d0-48e7-b16d-a0269b969b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:18.906869 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcbcfd-59d0-48e7-b16d-a0269b969b82 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:18.907675 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcbcfd-59d0-48e7-b16d-a0269b969b82 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:18.912947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcbcfd-59d0-48e7-b16d-a0269b969b82 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:18.933033 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 446/894] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 16:21:18 2022] POST /identity/v3/services => generated 241 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:21:18.979176 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:19.031433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fb2b88-6941-4a1b-a6ed-50bc095e0c90 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:19.075911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e4bf4-c387-4fd6-bb31-a197823a75d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:19.076663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e4bf4-c387-4fd6-bb31-a197823a75d0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:19.076950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e4bf4-c387-4fd6-bb31-a197823a75d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:19.077226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e4bf4-c387-4fd6-bb31-a197823a75d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:19.078035 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e4bf4-c387-4fd6-bb31-a197823a75d0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:19.078345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e4bf4-c387-4fd6-bb31-a197823a75d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:19.080191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e4bf4-c387-4fd6-bb31-a197823a75d0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:19.090082 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 449/895] 10.222.0.41 () {56 vars in 1115 bytes} [Fri May 27 16:21:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:19.096066 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcbcfd-59d0-48e7-b16d-a0269b969b82 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:19.205816 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:19.257113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcbcfd-59d0-48e7-b16d-a0269b969b82 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:19.316906 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b80cf8-42d2-463e-a92b-4cede6712397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:19.318169 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b80cf8-42d2-463e-a92b-4cede6712397 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:19.318681 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b80cf8-42d2-463e-a92b-4cede6712397 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:19.319188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b80cf8-42d2-463e-a92b-4cede6712397 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:19.333526 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b80cf8-42d2-463e-a92b-4cede6712397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:19.335521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b80cf8-42d2-463e-a92b-4cede6712397 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:19.355267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a2b80cf8-42d2-463e-a92b-4cede6712397 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:19.355267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:19.355267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:19.355267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:19.355267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:19.355267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:19.355267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:19.355267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:19.355267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:19.355267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:19.355267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:19.355267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:19.355267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:19.355267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:19.355267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:19.356331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:19.356331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:19.356331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:19.356331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:19.356331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:19.356331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:19.356331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:19.356331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:19.356331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:19.356331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:19.356331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:19.356331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:19.356331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:19.356331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:19.356331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:19.356331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:19.356331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:19.357317 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:19.357317 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:19.357317 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:19.357317 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:19.360047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 447/896] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:19.366259 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e4bf4-c387-4fd6-bb31-a197823a75d0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:19.369649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38617455-4a65-436b-bdf2-9ed95a4f444c None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:19.369946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38617455-4a65-436b-bdf2-9ed95a4f444c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:19.370232 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38617455-4a65-436b-bdf2-9ed95a4f444c None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:19.371789 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 448/897] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:19.381426 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbade77-70fe-4eac-b779-594aabf51deb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:19.382081 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbade77-70fe-4eac-b779-594aabf51deb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:19.382561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbade77-70fe-4eac-b779-594aabf51deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:19.402956 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-bcbade77-70fe-4eac-b779-594aabf51deb None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:19.404839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bcbade77-70fe-4eac-b779-594aabf51deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:19.510618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 449/898] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:21:19.525197 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e4bf4-c387-4fd6-bb31-a197823a75d0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:19.529974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbade77-70fe-4eac-b779-594aabf51deb None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:19.548087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:19.582009 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e580b0-6f80-4e54-8e17-3750fa6ac07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:19.585072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e580b0-6f80-4e54-8e17-3750fa6ac07b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:19.585951 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e580b0-6f80-4e54-8e17-3750fa6ac07b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:19.586878 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e580b0-6f80-4e54-8e17-3750fa6ac07b None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:19.588401 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e580b0-6f80-4e54-8e17-3750fa6ac07b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:19.589043 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e580b0-6f80-4e54-8e17-3750fa6ac07b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:19.590972 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e580b0-6f80-4e54-8e17-3750fa6ac07b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:19.600908 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:19.614507 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 450/899] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:19.620944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e580b0-6f80-4e54-8e17-3750fa6ac07b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:19.676973 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbade77-70fe-4eac-b779-594aabf51deb None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:19.715460 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59701e9f-1c68-462d-b429-14f21391aa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:19.716824 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59701e9f-1c68-462d-b429-14f21391aa72 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:19.717330 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59701e9f-1c68-462d-b429-14f21391aa72 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:19.717823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59701e9f-1c68-462d-b429-14f21391aa72 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:19.718729 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59701e9f-1c68-462d-b429-14f21391aa72 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:19.720474 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59701e9f-1c68-462d-b429-14f21391aa72 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:19.734531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-59701e9f-1c68-462d-b429-14f21391aa72 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 16:21:19.734531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:19.734531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:19.734531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:19.734531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:19.734531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:19.734531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:19.734531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:19.734531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 16:21:19.734531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:19.734531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:19.734531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:19.734531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:19.734531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:19.734531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:19.734531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:19.735529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:19.735529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:19.735529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:19.735529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:19.735529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:19.735529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:19.735529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:19.735529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:19.735529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:19.735529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:19.735529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:19.735529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:19.735529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:19.735529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:19.735529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:19.735529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:19.736814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:19.736814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:19.736814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:19.736814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:19.736814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:19.736814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:19.736814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:19.736814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:19.736814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:19.736814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:19.736814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:19.736814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:19.736814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:19.736814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 16:21:19.736814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:19.739381 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e580b0-6f80-4e54-8e17-3750fa6ac07b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:19.740354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 450/900] 10.222.0.41 () {56 vars in 1132 bytes} [Fri May 27 16:21:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:19.746459 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59701e9f-1c68-462d-b429-14f21391aa72 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:19.780117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8319c12-e8ed-456f-b6be-0e5126f06734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:19.780928 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8319c12-e8ed-456f-b6be-0e5126f06734 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:19.781216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8319c12-e8ed-456f-b6be-0e5126f06734 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:19.781480 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8319c12-e8ed-456f-b6be-0e5126f06734 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:19.789619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8319c12-e8ed-456f-b6be-0e5126f06734 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:19.791046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8319c12-e8ed-456f-b6be-0e5126f06734 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:19.806855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-b8319c12-e8ed-456f-b6be-0e5126f06734 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:21:19.806855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:19.806855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:19.806855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:19.806855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:19.806855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:19.806855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:19.806855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:19.806855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:19.806855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:19.806855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:19.806855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:19.806855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:21:19.806855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:21:19.806855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:21:19.806855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:21:19.808096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:19.808096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:19.808096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:21:19.808096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:19.808096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:21:19.808096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:19.808096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:19.808096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:19.808096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:19.808096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:19.808096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:19.808096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:19.808096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:19.808096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:19.808096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:19.808096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:19.808096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:19.808096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:19.809580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:19.809580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:19.809580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:21:19.809580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:21:19.809580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:21:19.809580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:21:19.809580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:21:19.809580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:21:19.809580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:21:19.809580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:19.809580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 451/901] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 16:21:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:19.809580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e81595-58ac-443a-98a3-fac36a159480 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:19.809580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e81595-58ac-443a-98a3-fac36a159480 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:19.810339 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e81595-58ac-443a-98a3-fac36a159480 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:19.811265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 452/902] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:19.815863 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e81595-58ac-443a-98a3-fac36a159480 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:19.848374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:19.877821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59701e9f-1c68-462d-b429-14f21391aa72 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:19.896669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:19.915368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2050b-f1a6-49f2-a93b-1710dd09d50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:19.916213 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2050b-f1a6-49f2-a93b-1710dd09d50c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:19.916505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2050b-f1a6-49f2-a93b-1710dd09d50c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:19.916779 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2050b-f1a6-49f2-a93b-1710dd09d50c None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:19.917490 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2050b-f1a6-49f2-a93b-1710dd09d50c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:19.918340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2050b-f1a6-49f2-a93b-1710dd09d50c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:19.919343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2050b-f1a6-49f2-a93b-1710dd09d50c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:19.929717 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 451/903] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 16:21:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:19.929717 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9746f9b-cfd2-427b-8963-a3c5f6b0f774 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:19.929717 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9746f9b-cfd2-427b-8963-a3c5f6b0f774 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:19.929717 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9746f9b-cfd2-427b-8963-a3c5f6b0f774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:19.934703 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e81595-58ac-443a-98a3-fac36a159480 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:19.946524 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b9746f9b-cfd2-427b-8963-a3c5f6b0f774 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:19.947723 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b9746f9b-cfd2-427b-8963-a3c5f6b0f774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:19.972710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7293bf-6f28-41a1-9169-6e362d4a1a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:19.973415 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7293bf-6f28-41a1-9169-6e362d4a1a17 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:19.973706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7293bf-6f28-41a1-9169-6e362d4a1a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:19.973979 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7293bf-6f28-41a1-9169-6e362d4a1a17 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:19.974826 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7293bf-6f28-41a1-9169-6e362d4a1a17 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:19.975136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7293bf-6f28-41a1-9169-6e362d4a1a17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:19.976629 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7293bf-6f28-41a1-9169-6e362d4a1a17 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:19.999151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 453/904] 10.222.0.41 () {56 vars in 1149 bytes} [Fri May 27 16:21:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:20.000057 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7293bf-6f28-41a1-9169-6e362d4a1a17 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:20.018999 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 452/905] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:20.024467 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9746f9b-cfd2-427b-8963-a3c5f6b0f774 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:20.112266 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:20.127958 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7293bf-6f28-41a1-9169-6e362d4a1a17 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:20.133991 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9746f9b-cfd2-427b-8963-a3c5f6b0f774 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:20.148598 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:20.166908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb2821-7724-485f-a874-25e39e7c0b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:20.167583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb2821-7724-485f-a874-25e39e7c0b8a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:20.167867 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb2821-7724-485f-a874-25e39e7c0b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:20.168336 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb2821-7724-485f-a874-25e39e7c0b8a None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:20.168893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb2821-7724-485f-a874-25e39e7c0b8a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:20.169177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb2821-7724-485f-a874-25e39e7c0b8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:20.170553 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb2821-7724-485f-a874-25e39e7c0b8a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:20.173200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc013d1-7c6d-463c-91af-987c5f0297ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:20.173883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc013d1-7c6d-463c-91af-987c5f0297ed None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:20.173883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc013d1-7c6d-463c-91af-987c5f0297ed None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:20.173883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc013d1-7c6d-463c-91af-987c5f0297ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:20.176320 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 454/906] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 16:21:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:20.177036 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb2821-7724-485f-a874-25e39e7c0b8a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:20.254894 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc013d1-7c6d-463c-91af-987c5f0297ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:20.256867 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc013d1-7c6d-463c-91af-987c5f0297ed None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:20.301087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb2821-7724-485f-a874-25e39e7c0b8a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:20.342930 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d01d5-9a16-4be7-8b38-e507b0eddf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:20.343740 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d01d5-9a16-4be7-8b38-e507b0eddf3a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:20.344269 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d01d5-9a16-4be7-8b38-e507b0eddf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:20.344545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d01d5-9a16-4be7-8b38-e507b0eddf3a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:20.345662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d01d5-9a16-4be7-8b38-e507b0eddf3a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:20.347038 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d01d5-9a16-4be7-8b38-e507b0eddf3a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:20.366131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 453/907] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:21:20 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:21:20.366299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-a96d01d5-9a16-4be7-8b38-e507b0eddf3a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 16:21:20.366299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:20.366299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:20.366299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:20.366299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:20.366299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:20.366299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:20.366299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:20.366299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 16:21:20.366299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:20.366299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:20.366299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:20.366299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:20.366299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:20.366299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:20.366299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:20.366299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:20.367287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:20.367287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:20.367287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:20.367287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:20.367287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:20.367287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:20.367287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:20.367287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:20.367287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:20.367287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:20.367287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:20.367287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:20.367287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:20.367287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:20.367287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:20.367287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:20.368196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:20.368196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:20.368196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:20.368196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:20.368196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:20.368196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:20.368196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:20.368196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:20.368196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:20.368196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:20.368196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:20.368196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:20.368196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 16:21:20.368196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:20.368968 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc013d1-7c6d-463c-91af-987c5f0297ed None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:20.369049 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 455/908] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:21:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:20.369049 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d01d5-9a16-4be7-8b38-e507b0eddf3a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:20.386905 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:20.388254 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:20.471215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d01d5-9a16-4be7-8b38-e507b0eddf3a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:20.479679 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc013d1-7c6d-463c-91af-987c5f0297ed None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:20.505772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d4b74-7425-4095-89dc-4863ded2e879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:20.506570 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d4b74-7425-4095-89dc-4863ded2e879 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:20.506854 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d4b74-7425-4095-89dc-4863ded2e879 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:20.507124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d4b74-7425-4095-89dc-4863ded2e879 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:20.516242 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f9d93-4faa-483b-a1b1-37de0067e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:20.516880 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f9d93-4faa-483b-a1b1-37de0067e443 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:20.517170 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f9d93-4faa-483b-a1b1-37de0067e443 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:20.517441 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f9d93-4faa-483b-a1b1-37de0067e443 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:20.518091 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d4b74-7425-4095-89dc-4863ded2e879 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:20.518343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f9d93-4faa-483b-a1b1-37de0067e443 None admin] RBAC: Adding query filter params (interface=public, service_id=7a71ab7f23da405ca1ff99dbfe101cf6, region_id=RegionOne) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:20.518720 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f9d93-4faa-483b-a1b1-37de0067e443 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:20.519559 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d4b74-7425-4095-89dc-4863ded2e879 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:20.520302 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f9d93-4faa-483b-a1b1-37de0067e443 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:20.530389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 454/909] 10.222.0.41 () {56 vars in 1251 bytes} [Fri May 27 16:21:20 2022] GET /identity/v3/endpoints?service_id=7a71ab7f23da405ca1ff99dbfe101cf6&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:20.530389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f9d93-4faa-483b-a1b1-37de0067e443 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:20.543111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-2d4d4b74-7425-4095-89dc-4863ded2e879 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:20.543111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:20.543111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:20.543111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:20.543111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:20.543111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:20.543111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:20.543111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:20.543111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:20.543111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:20.543111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:20.543111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:20.543111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:20.543111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:20.543111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:20.544116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:20.544116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:20.544116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:20.544116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:20.544116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:20.544116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:20.544116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:20.544116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:20.544116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:20.544116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:20.544116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:20.544116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:20.544116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:20.544116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:20.544116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:20.544116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:20.544116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:20.545126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:20.545126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:20.545126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:20.545126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:20.545126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 456/910] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:21:20.545126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d4b74-7425-4095-89dc-4863ded2e879 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:20.624482 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:20.626744 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:20.655784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f9d93-4faa-483b-a1b1-37de0067e443 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:20.673007 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d4b74-7425-4095-89dc-4863ded2e879 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:20.707753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb3c38-ccdd-416d-ab2d-c5bd0fdf29ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:20.708486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb3c38-ccdd-416d-ab2d-c5bd0fdf29ef None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:20.708838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb3c38-ccdd-416d-ab2d-c5bd0fdf29ef None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:20.709047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb3c38-ccdd-416d-ab2d-c5bd0fdf29ef None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:20.709775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb3c38-ccdd-416d-ab2d-c5bd0fdf29ef None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:20.710079 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb3c38-ccdd-416d-ab2d-c5bd0fdf29ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:20.711524 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb3c38-ccdd-416d-ab2d-c5bd0fdf29ef None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:20.717103 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 455/911] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:21:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:20.717942 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb3c38-ccdd-416d-ab2d-c5bd0fdf29ef None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:20.734818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7d0a9-1e91-4517-9acc-4e8179ee1561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:20.735506 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7d0a9-1e91-4517-9acc-4e8179ee1561 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:20.736484 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7d0a9-1e91-4517-9acc-4e8179ee1561 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:20.736773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7d0a9-1e91-4517-9acc-4e8179ee1561 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:20.737508 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7d0a9-1e91-4517-9acc-4e8179ee1561 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:20.738937 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7d0a9-1e91-4517-9acc-4e8179ee1561 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:20.745576 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 457/912] 10.222.0.41 () {56 vars in 1087 bytes} [Fri May 27 16:21:20 2022] GET /identity/v3/services => generated 1497 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:21:20.746424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7d0a9-1e91-4517-9acc-4e8179ee1561 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:20.879048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb3c38-ccdd-416d-ab2d-c5bd0fdf29ef None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:20.924716 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7d0a9-1e91-4517-9acc-4e8179ee1561 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:20.929073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38638e3b-b192-43cb-9ed4-0b5b71862000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:20.929915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38638e3b-b192-43cb-9ed4-0b5b71862000 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:20.930308 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38638e3b-b192-43cb-9ed4-0b5b71862000 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:20.931791 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38638e3b-b192-43cb-9ed4-0b5b71862000 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:20.932786 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38638e3b-b192-43cb-9ed4-0b5b71862000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:20.933207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38638e3b-b192-43cb-9ed4-0b5b71862000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:20.935019 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38638e3b-b192-43cb-9ed4-0b5b71862000 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:20.946960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:20.956318 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 456/913] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:20.959956 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38638e3b-b192-43cb-9ed4-0b5b71862000 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:21.002224 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d64e5-cb88-4d72-966d-760c38a7e7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:21.002980 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d64e5-cb88-4d72-966d-760c38a7e7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:21.003261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d64e5-cb88-4d72-966d-760c38a7e7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:21.003523 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d64e5-cb88-4d72-966d-760c38a7e7e1 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:21.004276 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d64e5-cb88-4d72-966d-760c38a7e7e1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:21.004576 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d64e5-cb88-4d72-966d-760c38a7e7e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:21.005984 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d64e5-cb88-4d72-966d-760c38a7e7e1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:21.007907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:21.012169 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 458/914] 10.222.0.41 () {56 vars in 1114 bytes} [Fri May 27 16:21:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:21.020128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d64e5-cb88-4d72-966d-760c38a7e7e1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:21.126037 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38638e3b-b192-43cb-9ed4-0b5b71862000 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:21.157886 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d64e5-cb88-4d72-966d-760c38a7e7e1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:21.165665 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ba4d9-56fd-48d6-b83b-682f08d504e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:21.166742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ba4d9-56fd-48d6-b83b-682f08d504e0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:21.167132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ba4d9-56fd-48d6-b83b-682f08d504e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:21.167476 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ba4d9-56fd-48d6-b83b-682f08d504e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:21.175419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ba4d9-56fd-48d6-b83b-682f08d504e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:21.177208 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ba4d9-56fd-48d6-b83b-682f08d504e0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:21.194158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-119ba4d9-56fd-48d6-b83b-682f08d504e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:21.194158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:21.194158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:21.194158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:21.194158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:21.194158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:21.194158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:21.194158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:21.194158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:21.194158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:21.194158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:21.194158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:21.194158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:21:21.194158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:21:21.194158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:21:21.195423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:21:21.195423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:21.195423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:21.195423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:21.195423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:21.195423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:21.195423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:21.195423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:21.195423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:21.195423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:21.195423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:21.195423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:21.195423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:21.195423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:21.195423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:21.195423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:21.195423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:21.196586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:21:21.196586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:21:21.196586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:21:21.196586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:21:21.196586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:21:21.196586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:21:21.196586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:21.196586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:21.196586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 457/915] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:21.200755 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce685bd-49cc-497b-b0dd-91d984ec1d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:21.201493 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce685bd-49cc-497b-b0dd-91d984ec1d9f None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:21.201965 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce685bd-49cc-497b-b0dd-91d984ec1d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:21.202196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce685bd-49cc-497b-b0dd-91d984ec1d9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:21.203047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce685bd-49cc-497b-b0dd-91d984ec1d9f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:21.203255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ba4d9-56fd-48d6-b83b-682f08d504e0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:21.205135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce685bd-49cc-497b-b0dd-91d984ec1d9f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:21.240382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 459/916] 10.222.0.41 () {60 vars in 1144 bytes} [Fri May 27 16:21:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:21:21.300493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:21.351810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ba4d9-56fd-48d6-b83b-682f08d504e0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:21.396417 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaee243-dcae-4f1a-8bb0-f3254518ee11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:21.397147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaee243-dcae-4f1a-8bb0-f3254518ee11 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:21.397433 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaee243-dcae-4f1a-8bb0-f3254518ee11 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:21.397710 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaee243-dcae-4f1a-8bb0-f3254518ee11 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:21.398567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaee243-dcae-4f1a-8bb0-f3254518ee11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:21.398885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaee243-dcae-4f1a-8bb0-f3254518ee11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:21.400411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaee243-dcae-4f1a-8bb0-f3254518ee11 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:21.414286 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 458/917] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:21:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:21.420852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce685bd-49cc-497b-b0dd-91d984ec1d9f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:21.455906 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec8d20-fa48-4a88-800b-009ad4982abd None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:21.456382 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec8d20-fa48-4a88-800b-009ad4982abd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:21.456677 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec8d20-fa48-4a88-800b-009ad4982abd None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:21.459578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 459/918] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:21:21.464171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb0984-fd5a-4748-9f48-45dbf0fc69ac None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:21.464460 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb0984-fd5a-4748-9f48-45dbf0fc69ac None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:21.464742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb0984-fd5a-4748-9f48-45dbf0fc69ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:21.482497 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2ebb0984-fd5a-4748-9f48-45dbf0fc69ac None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:21.483686 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2ebb0984-fd5a-4748-9f48-45dbf0fc69ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:21.490997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:21.546852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce685bd-49cc-497b-b0dd-91d984ec1d9f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:21.561645 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 460/919] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:21:21.585604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb0984-fd5a-4748-9f48-45dbf0fc69ac None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:21.585968 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbc249-abc4-4c92-a82a-d0099fcd48b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:21.586756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbc249-abc4-4c92-a82a-d0099fcd48b8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:21.586985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbc249-abc4-4c92-a82a-d0099fcd48b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:21.587262 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbc249-abc4-4c92-a82a-d0099fcd48b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:21.588307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbc249-abc4-4c92-a82a-d0099fcd48b8 None admin] RBAC: Adding query filter params (role.id=a4f4043359b042a9abe4f0ace9620258, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=2ccee0bc7e2b41f4a2fe2a891a95b318) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:21.588738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbc249-abc4-4c92-a82a-d0099fcd48b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:21.590322 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbc249-abc4-4c92-a82a-d0099fcd48b8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:21.597310 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 460/920] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:21:21 2022] GET /identity/v3/role_assignments?user.id=2ccee0bc7e2b41f4a2fe2a891a95b318&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=a4f4043359b042a9abe4f0ace9620258 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:21.639174 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:21.707214 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb0984-fd5a-4748-9f48-45dbf0fc69ac None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:21.744360 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ddc6a-dfd8-4717-9036-aab6e31ffa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:21.745195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ddc6a-dfd8-4717-9036-aab6e31ffa64 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:21.745474 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ddc6a-dfd8-4717-9036-aab6e31ffa64 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:21.745743 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ddc6a-dfd8-4717-9036-aab6e31ffa64 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:21.746403 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ddc6a-dfd8-4717-9036-aab6e31ffa64 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:21.747822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ddc6a-dfd8-4717-9036-aab6e31ffa64 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:21.761120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-603ddc6a-dfd8-4717-9036-aab6e31ffa64 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:21:21.761120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:21.761120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:21.761120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:21.761120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:21.761120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:21.761120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:21.761120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:21.761120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:21:21.761120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:21.761120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:21.761120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:21.761120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:21.761120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:21.761120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:21.761120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:21.761120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:21.762219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:21.762219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:21.762219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:21.762219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:21.762219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:21.762219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:21.762219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:21.762219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:21.762219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:21.762219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:21.762219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:21.762219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:21.762219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:21.762219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:21.762219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:21.762219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:21.763073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:21.763073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:21.763073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:21.763073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:21.763073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:21.763073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:21.763073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:21.763073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:21.763073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:21.763073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:21.763073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:21.763073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:21.763073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:21:21.763073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:21.763073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 461/921] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 16:21:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:21:21.769596 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbc249-abc4-4c92-a82a-d0099fcd48b8 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:21.889787 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbc249-abc4-4c92-a82a-d0099fcd48b8 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:21.910758 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:21.929859 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405da9cf-fb50-469c-9d8a-5c92473ee279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:21.930539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405da9cf-fb50-469c-9d8a-5c92473ee279 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:21.930879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405da9cf-fb50-469c-9d8a-5c92473ee279 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:21.931149 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405da9cf-fb50-469c-9d8a-5c92473ee279 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:21.931908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405da9cf-fb50-469c-9d8a-5c92473ee279 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:21.932240 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405da9cf-fb50-469c-9d8a-5c92473ee279 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:21.933885 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405da9cf-fb50-469c-9d8a-5c92473ee279 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:21.941591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 461/922] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 16:21:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:21.947220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ddc6a-dfd8-4717-9036-aab6e31ffa64 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:22.053305 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ddc6a-dfd8-4717-9036-aab6e31ffa64 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:22.063830 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:22.088137 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f7ef1-1e60-4ab3-8925-bc3d775cf2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:22.088825 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f7ef1-1e60-4ab3-8925-bc3d775cf2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:22.089101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f7ef1-1e60-4ab3-8925-bc3d775cf2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:22.089371 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f7ef1-1e60-4ab3-8925-bc3d775cf2d6 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:22.090078 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f7ef1-1e60-4ab3-8925-bc3d775cf2d6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:22.090378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f7ef1-1e60-4ab3-8925-bc3d775cf2d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:22.091776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f7ef1-1e60-4ab3-8925-bc3d775cf2d6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:22.097654 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 462/923] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 16:21:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:22.103344 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405da9cf-fb50-469c-9d8a-5c92473ee279 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:22.216724 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405da9cf-fb50-469c-9d8a-5c92473ee279 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:22.254597 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c58a1-2de2-4ce2-b32a-2e2a28aa24e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:22.255273 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c58a1-2de2-4ce2-b32a-2e2a28aa24e4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:22.255558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c58a1-2de2-4ce2-b32a-2e2a28aa24e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:22.255834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c58a1-2de2-4ce2-b32a-2e2a28aa24e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:22.256669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c58a1-2de2-4ce2-b32a-2e2a28aa24e4 None admin] RBAC: Adding query filter params (interface=public, service_id=37de6784d53c40189093f601fce5fa01, region_id=RegionOne) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:22.256985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c58a1-2de2-4ce2-b32a-2e2a28aa24e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:22.258389 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c58a1-2de2-4ce2-b32a-2e2a28aa24e4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:22.266604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 462/924] 10.222.0.41 () {56 vars in 1251 bytes} [Fri May 27 16:21:22 2022] GET /identity/v3/endpoints?service_id=37de6784d53c40189093f601fce5fa01&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:22.272373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f7ef1-1e60-4ab3-8925-bc3d775cf2d6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:22.387893 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f7ef1-1e60-4ab3-8925-bc3d775cf2d6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:22.428406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb79b9-cc5a-4ed5-aadb-d683ab9e4d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:22.429614 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb79b9-cc5a-4ed5-aadb-d683ab9e4d6f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:22.429896 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb79b9-cc5a-4ed5-aadb-d683ab9e4d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:22.430195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb79b9-cc5a-4ed5-aadb-d683ab9e4d6f None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:22.430943 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb79b9-cc5a-4ed5-aadb-d683ab9e4d6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:22.432467 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb79b9-cc5a-4ed5-aadb-d683ab9e4d6f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:22.441027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 463/925] 10.222.0.41 () {56 vars in 1087 bytes} [Fri May 27 16:21:22 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:21:23.166112 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff2be3-c389-4ee4-a80f-d1d7b1980025 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:23.166647 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff2be3-c389-4ee4-a80f-d1d7b1980025 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:23.166764 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff2be3-c389-4ee4-a80f-d1d7b1980025 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:23.168371 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 463/926] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:23.173990 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9de63-ec58-46c9-b57e-49d5936e2e1b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:23.174649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9de63-ec58-46c9-b57e-49d5936e2e1b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:23.174649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9de63-ec58-46c9-b57e-49d5936e2e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:23.194175 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-47f9de63-ec58-46c9-b57e-49d5936e2e1b None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:23.195373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-47f9de63-ec58-46c9-b57e-49d5936e2e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:23.227849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:23.272640 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 464/927] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:23.295469 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff2be3-c389-4ee4-a80f-d1d7b1980025 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:23.350069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:23.422666 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff2be3-c389-4ee4-a80f-d1d7b1980025 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:23.466796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe19724-72ee-461d-87b8-c66da2c95c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:23.467638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe19724-72ee-461d-87b8-c66da2c95c6c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:23.467922 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe19724-72ee-461d-87b8-c66da2c95c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:23.468219 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe19724-72ee-461d-87b8-c66da2c95c6c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:23.468948 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe19724-72ee-461d-87b8-c66da2c95c6c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:23.470434 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe19724-72ee-461d-87b8-c66da2c95c6c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:23.485117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-4fe19724-72ee-461d-87b8-c66da2c95c6c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 16:21:23.485117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:23.485117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:23.485117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:23.485117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:23.485117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:23.485117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:23.485117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:23.485117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 16:21:23.485117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:23.485117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:23.485117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:23.485117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:23.485117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:23.485117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:23.485117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:23.486516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:23.486516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:23.486516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:23.486516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:23.486516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:23.486516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:23.486516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:23.486516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:23.486516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:23.486516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:23.486516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:23.486516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:23.486516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:23.486516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:23.486516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:23.486516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:23.488988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:23.488988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:23.488988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:23.488988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:23.488988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:23.488988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:23.488988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:23.488988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:23.488988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:23.488988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:23.488988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:23.488988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:23.488988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:23.488988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 16:21:23.488988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:23.488988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 464/928] 10.222.0.41 () {56 vars in 1132 bytes} [Fri May 27 16:21:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:23.496035 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9de63-ec58-46c9-b57e-49d5936e2e1b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:23.608998 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9de63-ec58-46c9-b57e-49d5936e2e1b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:23.648781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4772f-a691-4617-b7c2-72b0642ba92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:23.649466 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4772f-a691-4617-b7c2-72b0642ba92e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:23.649749 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4772f-a691-4617-b7c2-72b0642ba92e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:23.650026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4772f-a691-4617-b7c2-72b0642ba92e None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:23.650755 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4772f-a691-4617-b7c2-72b0642ba92e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:23.651060 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4772f-a691-4617-b7c2-72b0642ba92e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:23.652663 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4772f-a691-4617-b7c2-72b0642ba92e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:23.658760 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 465/929] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 16:21:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:23.664858 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe19724-72ee-461d-87b8-c66da2c95c6c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:23.775591 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1d50a-0e40-479f-af6b-3492e86c8516 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:23.775804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1d50a-0e40-479f-af6b-3492e86c8516 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:23.776199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1d50a-0e40-479f-af6b-3492e86c8516 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:23.777769 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 466/930] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:23.787743 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcd9de-6d88-44c7-9598-f75e823fd741 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:23.789067 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcd9de-6d88-44c7-9598-f75e823fd741 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:23.789793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcd9de-6d88-44c7-9598-f75e823fd741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:23.794517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe19724-72ee-461d-87b8-c66da2c95c6c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:23.808404 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:23.820302 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-39dcd9de-6d88-44c7-9598-f75e823fd741 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:23.823010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-39dcd9de-6d88-44c7-9598-f75e823fd741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:23.840717 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b81a06-f460-43cd-ba0e-20ebaa38933d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:23.841402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b81a06-f460-43cd-ba0e-20ebaa38933d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:23.841687 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b81a06-f460-43cd-ba0e-20ebaa38933d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:23.841962 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b81a06-f460-43cd-ba0e-20ebaa38933d None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:23.843168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b81a06-f460-43cd-ba0e-20ebaa38933d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:23.843479 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b81a06-f460-43cd-ba0e-20ebaa38933d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:23.845236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b81a06-f460-43cd-ba0e-20ebaa38933d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:23.852915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 465/931] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 16:21:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:23.858513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b81a06-f460-43cd-ba0e-20ebaa38933d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:23.864716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:23.920171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 467/932] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:23.936420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcd9de-6d88-44c7-9598-f75e823fd741 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:23.974533 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b81a06-f460-43cd-ba0e-20ebaa38933d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:24.014054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a2833-a0d2-4b49-b284-1a88486ed923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:24.014785 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a2833-a0d2-4b49-b284-1a88486ed923 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:24.015071 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a2833-a0d2-4b49-b284-1a88486ed923 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:24.015350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a2833-a0d2-4b49-b284-1a88486ed923 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:24.016171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a2833-a0d2-4b49-b284-1a88486ed923 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:24.017759 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a2833-a0d2-4b49-b284-1a88486ed923 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:24.048132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 466/933] 10.222.0.41 () {60 vars in 1144 bytes} [Fri May 27 16:21:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:21:24.048132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60491be1-35f8-484e-8d65-2c78b611146d None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:24.048132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60491be1-35f8-484e-8d65-2c78b611146d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:24.048132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60491be1-35f8-484e-8d65-2c78b611146d None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:24.048132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 467/934] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:24.050611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ac552-28da-469d-b8c4-1cb88a05b9f2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:24.050920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ac552-28da-469d-b8c4-1cb88a05b9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:24.051187 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ac552-28da-469d-b8c4-1cb88a05b9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:24.061158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcd9de-6d88-44c7-9598-f75e823fd741 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:24.072316 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2a3ac552-28da-469d-b8c4-1cb88a05b9f2 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:24.073854 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2a3ac552-28da-469d-b8c4-1cb88a05b9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:24.107828 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:24.127398 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a5712-dcf0-4ee9-90b5-e43cab338923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:24.128235 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a5712-dcf0-4ee9-90b5-e43cab338923 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:24.128520 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a5712-dcf0-4ee9-90b5-e43cab338923 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:24.128794 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a5712-dcf0-4ee9-90b5-e43cab338923 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:24.129585 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a5712-dcf0-4ee9-90b5-e43cab338923 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:24.131611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a5712-dcf0-4ee9-90b5-e43cab338923 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:24.132697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: WARNING keystone.server.flask.common [None req-970a5712-dcf0-4ee9-90b5-e43cab338923 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 27 16:21:24.159135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.sql.core [None req-970a5712-dcf0-4ee9-90b5-e43cab338923 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 16:21:24.159135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 16:21:24.159135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [parameters: {'id': 'b7246059d9044ef8b268582e7836f4d1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 16:21:24.159135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80264) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 16:21:24.168219 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 468/935] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:21:24.173889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-970a5712-dcf0-4ee9-90b5-e43cab338923 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b7246059d9044ef8b268582e7836f4d1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b7246059d9044ef8b268582e7836f4d1. May 27 16:21:24.173889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:24.173889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 16:21:24.173889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 16:21:24.173889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 16:21:24.173889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 16:21:24.173889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 16:21:24.173889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application result = self._query(query) May 27 16:21:24.173889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 16:21:24.173889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application conn.query(q) May 27 16:21:24.173889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 16:21:24.173889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 16:21:24.173889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 16:21:24.175247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application result.read() May 27 16:21:24.175247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 16:21:24.175247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 16:21:24.175247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 16:21:24.175247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 16:21:24.175247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 16:21:24.175247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 16:21:24.175247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 16:21:24.175247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 16:21:24.175247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 16:21:24.175247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:24.175247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 16:21:24.175247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:24.175247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:24.175247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 16:21:24.175247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 16:21:24.175247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 27 16:21:24.175247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return project_ref.to_dict() May 27 16:21:24.176307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 16:21:24.176307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application next(self.gen) May 27 16:21:24.176307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 16:21:24.176307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application yield resource May 27 16:21:24.176307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 16:21:24.176307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application next(self.gen) May 27 16:21:24.176307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 16:21:24.176307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.session.rollback() May 27 16:21:24.176307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 16:21:24.176307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.force_reraise() May 27 16:21:24.176307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 16:21:24.176307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise self.value May 27 16:21:24.176307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 16:21:24.176307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 16:21:24.176307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 16:21:24.176307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application session.commit() May 27 16:21:24.176307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 16:21:24.177374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 16:21:24.177374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 16:21:24.177374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._prepare_impl() May 27 16:21:24.177374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 16:21:24.177374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.session.flush() May 27 16:21:24.177374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 16:21:24.177374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._flush(objects) May 27 16:21:24.177374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 16:21:24.177374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 16:21:24.177374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 16:21:24.177374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application compat.raise_( May 27 16:21:24.177374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 16:21:24.177374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception May 27 16:21:24.177374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 16:21:24.177374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application flush_context.execute() May 27 16:21:24.177374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 16:21:24.177374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rec.execute(self) May 27 16:21:24.178357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 16:21:24.178357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 16:21:24.178357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 16:21:24.178357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 16:21:24.178357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 16:21:24.178357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 16:21:24.178357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 16:21:24.178357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 16:21:24.178357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 16:21:24.178357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 16:21:24.178357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 16:21:24.178357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 16:21:24.178357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 16:21:24.178357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 16:21:24.178357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 16:21:24.179532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 16:21:24.179532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 16:21:24.179532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception May 27 16:21:24.179532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 16:21:24.179532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 16:21:24.179532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 16:21:24.179532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 16:21:24.179532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 16:21:24.179532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application result = self._query(query) May 27 16:21:24.179532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 16:21:24.179532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application conn.query(q) May 27 16:21:24.179532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 16:21:24.179532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 16:21:24.179532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 16:21:24.179532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application result.read() May 27 16:21:24.179532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 16:21:24.179532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 16:21:24.180642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 16:21:24.180642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 16:21:24.180642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 16:21:24.180642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 16:21:24.180642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 16:21:24.180642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 16:21:24.180642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 16:21:24.180642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 16:21:24.180642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [parameters: {'id': 'b7246059d9044ef8b268582e7836f4d1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 16:21:24.180642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 16:21:24.180642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:24.180642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:24.180642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:24.180642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:24.180642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 27 16:21:24.181533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 27 16:21:24.181533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 16:21:24.181533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 16:21:24.181533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 27 16:21:24.181533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:24.181533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:24.181533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:24.181533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:24.181533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:24.181533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:24.181533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:24.181533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:24.181533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:24.181533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:24.181533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:24.181533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:24.181533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:24.183486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:24.183486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 27 16:21:24.183486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 27 16:21:24.183486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:24.183486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:24.183486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 27 16:21:24.183486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.Conflict( May 27 16:21:24.183486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b7246059d9044ef8b268582e7836f4d1. May 27 16:21:24.183486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:24.185363 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 468/936] 10.222.0.41 () {60 vars in 1140 bytes} [Fri May 27 16:21:23 2022] POST /identity/v3/projects => generated 262 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:24.192182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ac552-28da-469d-b8c4-1cb88a05b9f2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:24.194063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a5712-dcf0-4ee9-90b5-e43cab338923 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:24.216153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:24.322465 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a5712-dcf0-4ee9-90b5-e43cab338923 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:24.325457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ac552-28da-469d-b8c4-1cb88a05b9f2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:24.363609 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae5053-c47e-4e92-a139-2c74c72da88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:24.364496 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae5053-c47e-4e92-a139-2c74c72da88d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:24.364777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae5053-c47e-4e92-a139-2c74c72da88d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:24.365052 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae5053-c47e-4e92-a139-2c74c72da88d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:24.366165 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2350a-360b-473d-b88c-c23adb74f651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:24.367163 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2350a-360b-473d-b88c-c23adb74f651 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:24.367448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2350a-360b-473d-b88c-c23adb74f651 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:24.367780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2350a-360b-473d-b88c-c23adb74f651 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:24.375360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2350a-360b-473d-b88c-c23adb74f651 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:24.377343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2350a-360b-473d-b88c-c23adb74f651 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:24.378505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae5053-c47e-4e92-a139-2c74c72da88d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:21:24.387410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-37ae5053-c47e-4e92-a139-2c74c72da88d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:21:24.387410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:24.387410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:24.387410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:24.387410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:24.387410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:24.387410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:24.387410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:24.387410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:24.387410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:24.387410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:24.387410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:24.387410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:21:24.387410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:21:24.387410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:21:24.387410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:21:24.388522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:21:24.388522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:21:24.388522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:21:24.388522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:21:24.388522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:24.388522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:24.388522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:24.388522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:24.388522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:24.388522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:24.388522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:24.388522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:24.388522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:24.388522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:24.388522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:24.388522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:24.389461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:24.389461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:24.389461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:24.389461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:24.389461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:21:24.389461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:21:24.389461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:21:24.389461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:21:24.389461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:21:24.389461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:21:24.389461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:21:24.389461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:24.393744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 469/937] 10.222.0.41 () {56 vars in 1120 bytes} [Fri May 27 16:21:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:24.395126 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae5053-c47e-4e92-a139-2c74c72da88d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:24.397171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-d9a2350a-360b-473d-b88c-c23adb74f651 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:24.397171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:24.397171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:24.397171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:24.397171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:24.397171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:24.397171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:24.397171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:24.397171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:24.397171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:24.397171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:24.397171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:24.397171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:21:24.397171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:21:24.397171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:21:24.400119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:21:24.400119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:24.400119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:24.400119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:24.400119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:24.400119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:24.400119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:24.400119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:24.400119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:24.400119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:24.400119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:24.400119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:24.400119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:24.400119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:24.400119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:24.400119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:24.400119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:24.402892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:21:24.402892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:21:24.402892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:21:24.402892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:21:24.402892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:21:24.402892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:21:24.402892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:24.402892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:24.402892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 469/938] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:24.408090 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2350a-360b-473d-b88c-c23adb74f651 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:24.460621 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:24.489561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:24.528809 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae5053-c47e-4e92-a139-2c74c72da88d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:24.558334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2350a-360b-473d-b88c-c23adb74f651 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:24.590935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbb4fa-81e8-4714-9aa1-99ce221ae004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:24.591772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbb4fa-81e8-4714-9aa1-99ce221ae004 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:24.592747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbb4fa-81e8-4714-9aa1-99ce221ae004 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:24.592747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cbb4fa-81e8-4714-9aa1-99ce221ae004 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:24.593551 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbb4fa-81e8-4714-9aa1-99ce221ae004 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:24.593932 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbb4fa-81e8-4714-9aa1-99ce221ae004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:24.596576 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cbb4fa-81e8-4714-9aa1-99ce221ae004 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:24.610445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bef57b-9035-4808-9d00-6f296aa21cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:24.611998 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bef57b-9035-4808-9d00-6f296aa21cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:24.612453 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bef57b-9035-4808-9d00-6f296aa21cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:24.612855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bef57b-9035-4808-9d00-6f296aa21cc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:24.613785 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bef57b-9035-4808-9d00-6f296aa21cc8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:24.614222 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bef57b-9035-4808-9d00-6f296aa21cc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:24.614496 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 470/939] 10.222.0.41 () {56 vars in 1115 bytes} [Fri May 27 16:21:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:24.615895 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbb4fa-81e8-4714-9aa1-99ce221ae004 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:24.616259 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bef57b-9035-4808-9d00-6f296aa21cc8 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:24.648168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 470/940] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 16:21:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:24.768438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cbb4fa-81e8-4714-9aa1-99ce221ae004 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:24.771224 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92351f-2027-4e17-8cb0-eff5469719d3 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:24.771545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92351f-2027-4e17-8cb0-eff5469719d3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:24.771791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92351f-2027-4e17-8cb0-eff5469719d3 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:24.773653 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 471/941] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:21:24.779684 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a6d56-6955-4936-81a6-b3318fad513c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:24.780035 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a6d56-6955-4936-81a6-b3318fad513c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:24.780299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a6d56-6955-4936-81a6-b3318fad513c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:24.798572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-070a6d56-6955-4936-81a6-b3318fad513c None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:24.799938 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-070a6d56-6955-4936-81a6-b3318fad513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:24.810787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cced2-6b96-4fa7-9f77-587c8256e292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:24.811754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cced2-6b96-4fa7-9f77-587c8256e292 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:24.812074 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cced2-6b96-4fa7-9f77-587c8256e292 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:24.812357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cced2-6b96-4fa7-9f77-587c8256e292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:24.816801 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:24.829783 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cced2-6b96-4fa7-9f77-587c8256e292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:24.832194 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cced2-6b96-4fa7-9f77-587c8256e292 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:24.862164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-cb2cced2-6b96-4fa7-9f77-587c8256e292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:24.862164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:24.862164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:24.862164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:24.862164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:24.862164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:24.862164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:24.862164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:24.862164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:24.862164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:24.862164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:24.862164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:24.862164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:24.862164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:24.862164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:24.863195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:24.863195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:24.863195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:24.863195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:24.863195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:24.863195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:24.863195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:24.863195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:24.863195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:24.863195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:24.863195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:24.863195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:24.863195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:24.863195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:24.863195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:24.863195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:24.863195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:24.864164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:24.864164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:24.864164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:24.864164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:24.871787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 471/942] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:21:24.874536 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cced2-6b96-4fa7-9f77-587c8256e292 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:24.900693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 472/943] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:21:24.918966 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a6d56-6955-4936-81a6-b3318fad513c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:24.936559 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:25.024818 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cced2-6b96-4fa7-9f77-587c8256e292 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:25.056460 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070a6d56-6955-4936-81a6-b3318fad513c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:25.060616 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e065f-182a-4d00-9c76-5db876241d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:25.061301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e065f-182a-4d00-9c76-5db876241d20 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:25.061586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e065f-182a-4d00-9c76-5db876241d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:25.061858 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e065f-182a-4d00-9c76-5db876241d20 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:25.062593 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e065f-182a-4d00-9c76-5db876241d20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:25.062899 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e065f-182a-4d00-9c76-5db876241d20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:25.064392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e065f-182a-4d00-9c76-5db876241d20 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:25.079701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 472/944] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:25.086120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e065f-182a-4d00-9c76-5db876241d20 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:25.102677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5402e-8cbb-4cd7-9207-26b7ddb9d621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:25.106851 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5402e-8cbb-4cd7-9207-26b7ddb9d621 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:25.106851 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5402e-8cbb-4cd7-9207-26b7ddb9d621 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:25.106851 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5402e-8cbb-4cd7-9207-26b7ddb9d621 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:25.106851 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5402e-8cbb-4cd7-9207-26b7ddb9d621 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:25.106851 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5402e-8cbb-4cd7-9207-26b7ddb9d621 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:25.121971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ccd5402e-8cbb-4cd7-9207-26b7ddb9d621 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:21:25.121971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:25.121971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:25.121971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:25.121971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:25.121971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:25.121971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:25.121971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:25.121971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:21:25.121971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:25.121971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:25.121971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:25.121971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:25.121971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:25.121971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:25.121971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:25.121971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:25.123990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:25.123990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:25.123990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:25.123990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:25.123990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:25.123990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:25.123990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:25.123990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:25.123990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:25.123990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:25.123990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:25.123990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:25.123990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:25.123990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:25.123990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:25.123990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:25.126124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:25.126124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:25.126124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:25.126124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:25.126124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:25.126124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:25.126124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:25.126124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:25.126124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:25.126124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:25.126124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:25.126124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:25.126124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:21:25.126124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:25.131217 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 473/945] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 16:21:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:21:25.133167 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5402e-8cbb-4cd7-9207-26b7ddb9d621 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:25.176229 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:25.232757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:25.255907 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e065f-182a-4d00-9c76-5db876241d20 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:25.266319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5402e-8cbb-4cd7-9207-26b7ddb9d621 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:25.293737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b996566-229b-4668-8a55-b7723bd0ad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:25.294694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b996566-229b-4668-8a55-b7723bd0ad46 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:25.295484 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b996566-229b-4668-8a55-b7723bd0ad46 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:25.295484 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b996566-229b-4668-8a55-b7723bd0ad46 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:25.304158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b996566-229b-4668-8a55-b7723bd0ad46 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:25.306333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b996566-229b-4668-8a55-b7723bd0ad46 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:25.311208 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e4328-ca71-42e7-a19b-0e139bb1f3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:25.312108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e4328-ca71-42e7-a19b-0e139bb1f3df None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:25.312560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e4328-ca71-42e7-a19b-0e139bb1f3df None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:25.312975 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e4328-ca71-42e7-a19b-0e139bb1f3df None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:25.313830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e4328-ca71-42e7-a19b-0e139bb1f3df None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:25.314324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e4328-ca71-42e7-a19b-0e139bb1f3df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:25.315928 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e4328-ca71-42e7-a19b-0e139bb1f3df None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:25.322530 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 474/946] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 16:21:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:25.327809 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e4328-ca71-42e7-a19b-0e139bb1f3df None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:25.328260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-9b996566-229b-4668-8a55-b7723bd0ad46 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:21:25.328260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:25.328260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:25.328260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:25.328260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:25.328260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:25.328260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:25.328260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:25.328260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:25.328260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:25.328260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:25.328260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:25.328260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:21:25.328260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:21:25.328260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:21:25.328260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:21:25.329554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:25.329554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:25.329554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:21:25.329554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:25.329554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:21:25.329554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:25.329554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:25.329554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:25.329554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:25.329554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:25.329554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:25.329554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:25.329554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:25.329554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:25.329554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:25.329554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:25.329554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:25.329554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:25.332521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:25.332521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:25.332521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:21:25.332521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:21:25.332521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:21:25.332521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:21:25.332521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:21:25.332521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:21:25.332521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:21:25.332521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:25.332521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 473/947] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 16:21:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:25.336391 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b996566-229b-4668-8a55-b7723bd0ad46 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:25.453202 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b996566-229b-4668-8a55-b7723bd0ad46 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:25.458562 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e4328-ca71-42e7-a19b-0e139bb1f3df None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:25.465325 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:25.495364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42eb46-329f-410b-9d95-6cdcffc3bca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:25.496506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42eb46-329f-410b-9d95-6cdcffc3bca7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:25.496625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42eb46-329f-410b-9d95-6cdcffc3bca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:25.497002 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42eb46-329f-410b-9d95-6cdcffc3bca7 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:25.497977 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42eb46-329f-410b-9d95-6cdcffc3bca7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:25.498347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42eb46-329f-410b-9d95-6cdcffc3bca7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:25.500119 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42eb46-329f-410b-9d95-6cdcffc3bca7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:25.503667 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a994a-48e7-4a1a-acd9-fb664f46b3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:25.504432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a994a-48e7-4a1a-acd9-fb664f46b3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:25.504715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a994a-48e7-4a1a-acd9-fb664f46b3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:25.504989 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a994a-48e7-4a1a-acd9-fb664f46b3d5 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:25.505734 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a994a-48e7-4a1a-acd9-fb664f46b3d5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:25.506039 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a994a-48e7-4a1a-acd9-fb664f46b3d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:25.507449 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a994a-48e7-4a1a-acd9-fb664f46b3d5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:25.513530 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 475/948] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 16:21:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:25.519078 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a994a-48e7-4a1a-acd9-fb664f46b3d5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:25.522336 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:25.526587 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 474/949] 10.222.0.41 () {56 vars in 1149 bytes} [Fri May 27 16:21:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:25.536051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42eb46-329f-410b-9d95-6cdcffc3bca7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:25.636844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a994a-48e7-4a1a-acd9-fb664f46b3d5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:25.650561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42eb46-329f-410b-9d95-6cdcffc3bca7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:25.672925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec7bce-fc31-45c4-bd41-743fc892ed58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:25.673675 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec7bce-fc31-45c4-bd41-743fc892ed58 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:25.673977 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec7bce-fc31-45c4-bd41-743fc892ed58 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:25.674395 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec7bce-fc31-45c4-bd41-743fc892ed58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:25.675283 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec7bce-fc31-45c4-bd41-743fc892ed58 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:25.676727 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec7bce-fc31-45c4-bd41-743fc892ed58 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:25.704176 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d3537-d3a3-43b9-a2e0-de5b4b2336a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:25.706014 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d3537-d3a3-43b9-a2e0-de5b4b2336a2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:25.706315 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d3537-d3a3-43b9-a2e0-de5b4b2336a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:25.706594 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d3537-d3a3-43b9-a2e0-de5b4b2336a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:25.708176 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 476/950] 10.222.0.41 () {60 vars in 1144 bytes} [Fri May 27 16:21:25 2022] POST /identity/v3/endpoints => generated 349 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:21:25.725129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d3537-d3a3-43b9-a2e0-de5b4b2336a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:25.727066 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d3537-d3a3-43b9-a2e0-de5b4b2336a2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:25.750240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-906d3537-d3a3-43b9-a2e0-de5b4b2336a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:25.750240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:25.750240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:25.750240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:25.750240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:25.750240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:25.750240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:25.750240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:25.750240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:25.750240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:25.750240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:25.750240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:25.750240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:25.750240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:25.750240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:25.751396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:25.751396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:25.751396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:25.751396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:25.751396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:25.751396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:25.751396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:25.751396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:25.751396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:25.751396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:25.751396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:25.751396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:25.751396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:25.751396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:25.751396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:25.751396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:25.751396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:25.753166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:25.753166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:25.753166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:25.753166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:25.753166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 475/951] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:25.757611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec7bce-fc31-45c4-bd41-743fc892ed58 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:25.835667 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:25.897095 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec7bce-fc31-45c4-bd41-743fc892ed58 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:25.941047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab060f-dde8-4f58-a51f-e6e76af52be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:25.941730 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab060f-dde8-4f58-a51f-e6e76af52be6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:25.942014 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab060f-dde8-4f58-a51f-e6e76af52be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:25.942287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab060f-dde8-4f58-a51f-e6e76af52be6 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:25.943023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab060f-dde8-4f58-a51f-e6e76af52be6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:25.943328 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab060f-dde8-4f58-a51f-e6e76af52be6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:25.944766 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab060f-dde8-4f58-a51f-e6e76af52be6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:25.958583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 477/952] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:25.965185 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d3537-d3a3-43b9-a2e0-de5b4b2336a2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:25.987340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:26.072357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d3537-d3a3-43b9-a2e0-de5b4b2336a2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:26.109600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45873c-0f54-40f2-b872-b237cb80cfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:26.110423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45873c-0f54-40f2-b872-b237cb80cfb0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:26.110705 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45873c-0f54-40f2-b872-b237cb80cfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:26.110982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45873c-0f54-40f2-b872-b237cb80cfb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:26.118896 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45873c-0f54-40f2-b872-b237cb80cfb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:26.120470 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45873c-0f54-40f2-b872-b237cb80cfb0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:26.135917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-ea45873c-0f54-40f2-b872-b237cb80cfb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:26.135917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:26.135917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:26.135917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:26.135917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:26.135917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:26.135917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:26.135917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:26.135917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:26.135917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:26.135917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:26.135917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:26.135917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:21:26.135917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:21:26.135917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:21:26.136994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:21:26.136994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:26.136994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:26.136994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:26.136994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:26.136994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:26.136994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:26.136994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:26.136994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:26.136994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:26.136994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:26.136994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:26.136994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:26.136994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:26.136994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:26.136994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:26.136994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:26.137967 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:21:26.137967 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:21:26.137967 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:21:26.137967 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:21:26.137967 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:21:26.137967 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:21:26.137967 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:26.137967 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:26.137967 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 476/953] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:26.143708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab060f-dde8-4f58-a51f-e6e76af52be6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:26.268262 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab060f-dde8-4f58-a51f-e6e76af52be6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:26.282661 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:26.312386 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484b378-68cb-4e12-b93c-6c65d8dd0eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:26.313065 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484b378-68cb-4e12-b93c-6c65d8dd0eca None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:26.313347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484b378-68cb-4e12-b93c-6c65d8dd0eca None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:26.313621 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484b378-68cb-4e12-b93c-6c65d8dd0eca None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:26.314441 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484b378-68cb-4e12-b93c-6c65d8dd0eca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:26.314749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484b378-68cb-4e12-b93c-6c65d8dd0eca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:26.316319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484b378-68cb-4e12-b93c-6c65d8dd0eca None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:26.329050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 478/954] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:21:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:26.335534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45873c-0f54-40f2-b872-b237cb80cfb0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:26.418496 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:26.440975 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45873c-0f54-40f2-b872-b237cb80cfb0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:26.479415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13a8c7-abc9-427e-bcf7-6075e8c9a46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:26.480370 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13a8c7-abc9-427e-bcf7-6075e8c9a46e None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:26.480652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13a8c7-abc9-427e-bcf7-6075e8c9a46e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:26.480927 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13a8c7-abc9-427e-bcf7-6075e8c9a46e None admin] PATH_INFO: `/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/2ccee0bc7e2b41f4a2fe2a891a95b318/roles/a4f4043359b042a9abe4f0ace9620258` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:26.483321 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13a8c7-abc9-427e-bcf7-6075e8c9a46e None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5c551b621342e5a5a6e742d673d525, user_id=2ccee0bc7e2b41f4a2fe2a891a95b318, role_id=a4f4043359b042a9abe4f0ace9620258)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:26.484872 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13a8c7-abc9-427e-bcf7-6075e8c9a46e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:26.508195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 477/955] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:21:26 2022] PUT /identity/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/2ccee0bc7e2b41f4a2fe2a891a95b318/roles/a4f4043359b042a9abe4f0ace9620258 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:21:26.679628 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90dffd-1b38-4c30-99cb-923b8feed825 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:26.680056 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90dffd-1b38-4c30-99cb-923b8feed825 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:26.680248 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90dffd-1b38-4c30-99cb-923b8feed825 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:26.681724 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 479/956] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:26.687700 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312acbff-6fc1-4c4d-aace-b9325ff91b54 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:26.687999 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312acbff-6fc1-4c4d-aace-b9325ff91b54 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:26.688275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312acbff-6fc1-4c4d-aace-b9325ff91b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:26.706818 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-312acbff-6fc1-4c4d-aace-b9325ff91b54 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:26.708425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-312acbff-6fc1-4c4d-aace-b9325ff91b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:26.783821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 478/957] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:26.809990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90dffd-1b38-4c30-99cb-923b8feed825 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:26.922727 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90dffd-1b38-4c30-99cb-923b8feed825 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:26.959940 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545604d-752f-4c6e-abfe-b636b62113a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:26.960690 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545604d-752f-4c6e-abfe-b636b62113a1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:26.960973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545604d-752f-4c6e-abfe-b636b62113a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:26.961245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545604d-752f-4c6e-abfe-b636b62113a1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:26.961900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545604d-752f-4c6e-abfe-b636b62113a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:26.963354 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545604d-752f-4c6e-abfe-b636b62113a1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:26.975788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-8545604d-752f-4c6e-abfe-b636b62113a1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 16:21:26.975788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:26.975788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:26.975788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:26.975788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:26.975788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:26.975788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:26.975788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:26.975788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 16:21:26.975788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:26.975788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:26.975788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:26.975788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:26.975788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:26.975788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:26.975788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:26.975788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:26.977054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:26.977054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:26.977054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:26.977054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:26.977054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:26.977054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:26.977054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:26.977054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:26.977054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:26.977054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:26.977054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:26.977054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:26.977054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:26.977054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:26.977054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:26.977054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:26.977923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:26.977923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:26.977923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:26.977923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:26.977923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:26.977923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:26.977923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:26.977923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:26.977923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:26.977923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:26.977923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:26.977923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:26.977923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 16:21:26.977923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:26.977923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 480/958] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:26.987638 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312acbff-6fc1-4c4d-aace-b9325ff91b54 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:27.056318 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:27.086709 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c2017-1fd1-486f-94e4-8f9beb1393d3 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:27.087054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c2017-1fd1-486f-94e4-8f9beb1393d3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:27.087280 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c2017-1fd1-486f-94e4-8f9beb1393d3 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:27.088976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 481/959] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:27.094352 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e64ccd-328c-49f2-9747-882cad4832b5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:27.094642 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e64ccd-328c-49f2-9747-882cad4832b5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:27.094925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e64ccd-328c-49f2-9747-882cad4832b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:27.097725 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312acbff-6fc1-4c4d-aace-b9325ff91b54 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:27.114106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-35e64ccd-328c-49f2-9747-882cad4832b5 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:27.115490 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-35e64ccd-328c-49f2-9747-882cad4832b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:27.145560 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236eeed2-5d64-49bb-8d5b-f55a2dd6d8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:27.146533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eeed2-5d64-49bb-8d5b-f55a2dd6d8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:27.146841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eeed2-5d64-49bb-8d5b-f55a2dd6d8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:27.147123 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236eeed2-5d64-49bb-8d5b-f55a2dd6d8d1 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:27.148135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236eeed2-5d64-49bb-8d5b-f55a2dd6d8d1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:27.148448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236eeed2-5d64-49bb-8d5b-f55a2dd6d8d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:27.150362 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236eeed2-5d64-49bb-8d5b-f55a2dd6d8d1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:27.153027 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:27.157266 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 479/960] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 16:21:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:27.162976 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236eeed2-5d64-49bb-8d5b-f55a2dd6d8d1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:27.208276 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 482/961] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:21:27.232739 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e64ccd-328c-49f2-9747-882cad4832b5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:27.306378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236eeed2-5d64-49bb-8d5b-f55a2dd6d8d1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:27.338603 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:27.344516 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925ddd8-f845-4e61-a621-bbeeafadb2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:27.345457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925ddd8-f845-4e61-a621-bbeeafadb2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:27.345577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925ddd8-f845-4e61-a621-bbeeafadb2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:27.345874 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925ddd8-f845-4e61-a621-bbeeafadb2e2 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:27.346585 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925ddd8-f845-4e61-a621-bbeeafadb2e2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:27.346898 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925ddd8-f845-4e61-a621-bbeeafadb2e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:27.348374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925ddd8-f845-4e61-a621-bbeeafadb2e2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:27.359563 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 480/962] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 16:21:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:27.370491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e64ccd-328c-49f2-9747-882cad4832b5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:27.411877 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bf1c6-efcf-4826-bd1d-bdf406ff2ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:27.412661 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bf1c6-efcf-4826-bd1d-bdf406ff2ae5 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:27.412950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bf1c6-efcf-4826-bd1d-bdf406ff2ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:27.413226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bf1c6-efcf-4826-bd1d-bdf406ff2ae5 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:27.413964 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8bf1c6-efcf-4826-bd1d-bdf406ff2ae5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:27.415537 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8bf1c6-efcf-4826-bd1d-bdf406ff2ae5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:27.416970 dv-cinder-835553-1-smb devstack@keystone.service[80263]: WARNING keystone.server.flask.common [None req-ef8bf1c6-efcf-4826-bd1d-bdf406ff2ae5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 27 16:21:27.432500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.sql.core [None req-ef8bf1c6-efcf-4826-bd1d-bdf406ff2ae5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 16:21:27.432500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 16:21:27.432500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [parameters: {'user_id': '8bfe188d1515402982bd8a3b0cf28d43', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 16:21:27.432500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80263) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 16:21:27.450089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-ef8bf1c6-efcf-4826-bd1d-bdf406ff2ae5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 16:21:27.450089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:27.450089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 16:21:27.450089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 16:21:27.450089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 16:21:27.450089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 16:21:27.450089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 16:21:27.450089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application result = self._query(query) May 27 16:21:27.450089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 16:21:27.450089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application conn.query(q) May 27 16:21:27.450089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 16:21:27.450089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 16:21:27.450089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 16:21:27.450089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application result.read() May 27 16:21:27.450089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 16:21:27.451075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 16:21:27.451075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 16:21:27.451075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 16:21:27.451075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 16:21:27.451075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 16:21:27.451075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 16:21:27.451075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 16:21:27.451075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 16:21:27.451075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:27.451075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 16:21:27.451075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:27.451075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:27.451075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 16:21:27.451075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 16:21:27.451075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 27 16:21:27.451075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 27 16:21:27.451075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 16:21:27.451075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application next(self.gen) May 27 16:21:27.452121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 16:21:27.452121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application yield resource May 27 16:21:27.452121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 16:21:27.452121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application next(self.gen) May 27 16:21:27.452121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 16:21:27.452121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.session.rollback() May 27 16:21:27.452121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 16:21:27.452121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.force_reraise() May 27 16:21:27.452121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 16:21:27.452121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise self.value May 27 16:21:27.452121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 16:21:27.452121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 16:21:27.452121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 16:21:27.452121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application session.commit() May 27 16:21:27.452121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 16:21:27.452121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 16:21:27.452121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 16:21:27.453050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._prepare_impl() May 27 16:21:27.453050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 16:21:27.453050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.session.flush() May 27 16:21:27.453050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 16:21:27.453050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._flush(objects) May 27 16:21:27.453050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 16:21:27.453050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 16:21:27.453050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 16:21:27.453050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application compat.raise_( May 27 16:21:27.453050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 16:21:27.453050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception May 27 16:21:27.453050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 16:21:27.453050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application flush_context.execute() May 27 16:21:27.453050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 16:21:27.453050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rec.execute(self) May 27 16:21:27.453050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 16:21:27.453050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 16:21:27.453952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 16:21:27.453952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 16:21:27.453952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 27 16:21:27.453952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application result = connection._execute_20( May 27 16:21:27.453952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 16:21:27.453952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 16:21:27.453952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 16:21:27.453952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 16:21:27.453952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 16:21:27.453952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 16:21:27.453952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 16:21:27.453952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 16:21:27.453952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 16:21:27.453952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 16:21:27.453952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 16:21:27.453952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception May 27 16:21:27.455253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 16:21:27.455253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 16:21:27.455253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 16:21:27.455253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 16:21:27.455253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 16:21:27.455253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application result = self._query(query) May 27 16:21:27.455253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 16:21:27.455253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application conn.query(q) May 27 16:21:27.455253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 16:21:27.455253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 16:21:27.455253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 16:21:27.455253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application result.read() May 27 16:21:27.455253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 16:21:27.455253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 16:21:27.455253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 16:21:27.455253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 16:21:27.457263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 16:21:27.457263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 16:21:27.457263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 16:21:27.457263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 16:21:27.457263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 16:21:27.457263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 16:21:27.457263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [parameters: {'user_id': '8bfe188d1515402982bd8a3b0cf28d43', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 16:21:27.457263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 16:21:27.457263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:27.457263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:27.457263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:27.457263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:27.457263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:27.457263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:27.457263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:27.459226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:27.459226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:27.459226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:27.459226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:27.459226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:27.459226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:27.459226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:27.459226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 27 16:21:27.459226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 27 16:21:27.459226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:27.459226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:27.459226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:21:27.459226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:27.459226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:21:27.459226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:27.459226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 27 16:21:27.459226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 27 16:21:27.460606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 27 16:21:27.460606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 27 16:21:27.460606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 16:21:27.460606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 16:21:27.460606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 16:21:27.460606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:27.460606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 483/963] 10.222.0.41 () {60 vars in 1131 bytes} [Fri May 27 16:21:27 2022] POST /identity/v3/users => generated 160 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 27 16:21:27.461093 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925ddd8-f845-4e61-a621-bbeeafadb2e2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:27.580788 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925ddd8-f845-4e61-a621-bbeeafadb2e2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:27.616914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711dab2-edbd-4aaa-b50f-01ee2bcb3ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:27.618095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711dab2-edbd-4aaa-b50f-01ee2bcb3ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:27.618575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711dab2-edbd-4aaa-b50f-01ee2bcb3ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:27.619073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711dab2-edbd-4aaa-b50f-01ee2bcb3ee8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:27.627419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711dab2-edbd-4aaa-b50f-01ee2bcb3ee8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:27.629345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711dab2-edbd-4aaa-b50f-01ee2bcb3ee8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:27.644694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2711dab2-edbd-4aaa-b50f-01ee2bcb3ee8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 16:21:27.644694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:27.644694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:27.644694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:27.644694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:27.644694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:27.644694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:27.644694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:27.644694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:27.644694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:27.644694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:27.644694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:27.644694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:21:27.644694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:21:27.644694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:21:27.644694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:21:27.645718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:27.645718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:27.645718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:21:27.645718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:27.645718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:21:27.645718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:27.645718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:27.645718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:27.645718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:27.645718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:27.645718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:27.645718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:27.645718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:27.645718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:27.645718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:27.645718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:27.645718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:27.645718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:27.646770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:27.646770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:27.646770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:21:27.646770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:21:27.646770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:21:27.646770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:21:27.646770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:21:27.646770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:21:27.646770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 16:21:27.646770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:27.649485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 481/964] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:21:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:27.658064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bf1c6-efcf-4826-bd1d-bdf406ff2ae5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:27.688912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:27.765123 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bf1c6-efcf-4826-bd1d-bdf406ff2ae5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:27.800832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a94d6a-40bb-4330-aaed-5b65605566e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:27.801520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a94d6a-40bb-4330-aaed-5b65605566e0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:27.801804 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a94d6a-40bb-4330-aaed-5b65605566e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:27.802086 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a94d6a-40bb-4330-aaed-5b65605566e0 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:27.802904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a94d6a-40bb-4330-aaed-5b65605566e0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:27.803213 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a94d6a-40bb-4330-aaed-5b65605566e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:27.804925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a94d6a-40bb-4330-aaed-5b65605566e0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:27.846135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 484/965] 10.222.0.41 () {56 vars in 1101 bytes} [Fri May 27 16:21:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:28.167276 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3abd0d-3e4b-4d88-9d6e-c013fb18aab8 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:28.167665 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3abd0d-3e4b-4d88-9d6e-c013fb18aab8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:28.167866 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3abd0d-3e4b-4d88-9d6e-c013fb18aab8 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:28.169528 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 482/966] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:28.174954 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46ba62-ab07-463c-b0fd-8136670fceda None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:28.175246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46ba62-ab07-463c-b0fd-8136670fceda None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:28.175518 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46ba62-ab07-463c-b0fd-8136670fceda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:28.193934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ce46ba62-ab07-463c-b0fd-8136670fceda None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:28.195446 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ce46ba62-ab07-463c-b0fd-8136670fceda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:28.269058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 485/967] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:28.290963 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3abd0d-3e4b-4d88-9d6e-c013fb18aab8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:28.353673 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:28.400727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3abd0d-3e4b-4d88-9d6e-c013fb18aab8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:28.437523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54424903-1886-498e-acf7-d14816c53083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:28.438252 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54424903-1886-498e-acf7-d14816c53083 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:28.438592 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54424903-1886-498e-acf7-d14816c53083 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:28.438845 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54424903-1886-498e-acf7-d14816c53083 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:28.439804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54424903-1886-498e-acf7-d14816c53083 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:28.441224 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54424903-1886-498e-acf7-d14816c53083 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:28.453400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-54424903-1886-498e-acf7-d14816c53083 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:21:28.453400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:28.453400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:28.453400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:28.453400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:28.453400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:28.453400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:28.453400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:28.453400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:21:28.453400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:28.453400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:28.453400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:28.453400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:28.453400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:28.453400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:28.453400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:28.453400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:28.454948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:28.454948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:28.454948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:28.454948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:28.454948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:28.454948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:28.454948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:28.454948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:28.454948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:28.454948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:28.454948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:28.454948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:28.454948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:28.454948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:28.454948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:28.454948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:28.455951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:28.455951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:28.455951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:28.455951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:28.455951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:28.455951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:28.455951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:28.455951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:28.455951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:28.455951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:28.455951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:28.455951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:28.455951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:21:28.455951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:28.457795 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 483/968] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 16:21:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:28.461074 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46ba62-ab07-463c-b0fd-8136670fceda None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:28.481024 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:28.580738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46ba62-ab07-463c-b0fd-8136670fceda None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:28.620781 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ce4c0-4180-4c46-ba2c-88268b5a1a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:28.621482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ce4c0-4180-4c46-ba2c-88268b5a1a5c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:28.621770 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ce4c0-4180-4c46-ba2c-88268b5a1a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:28.622046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ce4c0-4180-4c46-ba2c-88268b5a1a5c None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:28.622798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ce4c0-4180-4c46-ba2c-88268b5a1a5c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:28.623108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ce4c0-4180-4c46-ba2c-88268b5a1a5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:28.624694 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15ce4c0-4180-4c46-ba2c-88268b5a1a5c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:28.635888 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 486/969] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 16:21:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:28.638069 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54424903-1886-498e-acf7-d14816c53083 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:28.747443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54424903-1886-498e-acf7-d14816c53083 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:28.768661 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:28.785213 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e2b7d-2119-4f3a-a7f3-4fb893374597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:28.785213 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e2b7d-2119-4f3a-a7f3-4fb893374597 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:28.785213 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e2b7d-2119-4f3a-a7f3-4fb893374597 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:28.785213 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e2b7d-2119-4f3a-a7f3-4fb893374597 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:28.785888 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e2b7d-2119-4f3a-a7f3-4fb893374597 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:28.786198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e2b7d-2119-4f3a-a7f3-4fb893374597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:28.787681 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e2b7d-2119-4f3a-a7f3-4fb893374597 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:28.797959 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 484/970] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 16:21:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:28.801107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ce4c0-4180-4c46-ba2c-88268b5a1a5c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:28.830070 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b8650-02d8-4f16-99b2-2e34a2a169ee None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:28.830624 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b8650-02d8-4f16-99b2-2e34a2a169ee None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:28.830909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b8650-02d8-4f16-99b2-2e34a2a169ee None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:28.832986 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 485/971] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:28.838830 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517e995-fe4e-4868-9073-e2a7dfbaa05c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:28.839371 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517e995-fe4e-4868-9073-e2a7dfbaa05c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:28.839653 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517e995-fe4e-4868-9073-e2a7dfbaa05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:28.857395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b517e995-fe4e-4868-9073-e2a7dfbaa05c None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:28.858581 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b517e995-fe4e-4868-9073-e2a7dfbaa05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:28.894888 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:28.914381 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ce4c0-4180-4c46-ba2c-88268b5a1a5c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:28.932778 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 486/972] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:28.951164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead300c9-f825-4099-8555-e590438fac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:28.951829 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead300c9-f825-4099-8555-e590438fac10 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:28.952146 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead300c9-f825-4099-8555-e590438fac10 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:28.952423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead300c9-f825-4099-8555-e590438fac10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:28.953309 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead300c9-f825-4099-8555-e590438fac10 None admin] RBAC: Adding query filter params (interface=admin, service_id=37de6784d53c40189093f601fce5fa01, region_id=RegionOne) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:28.953591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead300c9-f825-4099-8555-e590438fac10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:28.955329 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead300c9-f825-4099-8555-e590438fac10 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:28.956951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517e995-fe4e-4868-9073-e2a7dfbaa05c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:28.961141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 487/973] 10.222.0.41 () {56 vars in 1249 bytes} [Fri May 27 16:21:28 2022] GET /identity/v3/endpoints?service_id=37de6784d53c40189093f601fce5fa01&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:28.970151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead300c9-f825-4099-8555-e590438fac10 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:29.056141 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517e995-fe4e-4868-9073-e2a7dfbaa05c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:29.070777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:29.076755 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead300c9-f825-4099-8555-e590438fac10 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:29.091841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a626d1-9611-4432-bbf1-6ccac8006286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:29.092692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a626d1-9611-4432-bbf1-6ccac8006286 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:29.092975 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a626d1-9611-4432-bbf1-6ccac8006286 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:29.093240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a626d1-9611-4432-bbf1-6ccac8006286 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:29.104773 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a626d1-9611-4432-bbf1-6ccac8006286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:21:29.113218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b5a626d1-9611-4432-bbf1-6ccac8006286 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:21:29.113218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:29.113218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:29.113218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:29.113218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:29.113218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:29.113218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:29.113218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:29.113218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:29.113218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:29.113218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:29.113218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:29.113218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:21:29.113218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:21:29.113218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:21:29.113218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:21:29.114231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:21:29.114231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:21:29.114231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:21:29.114231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:21:29.114231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:29.114231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:29.114231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:29.114231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:29.114231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:29.114231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:29.114231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:29.114231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:29.114231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:29.114231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:29.114231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:29.114231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:29.115128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:29.115128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:29.115128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:29.115128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:29.115128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:21:29.115128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:21:29.115128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:21:29.115128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:21:29.115128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:21:29.115128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:21:29.115128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:21:29.115128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:29.115830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fc85d-9acc-4f3b-908d-1e8a2480dc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:29.115830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fc85d-9acc-4f3b-908d-1e8a2480dc3a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:29.116024 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 487/974] 10.222.0.41 () {56 vars in 1120 bytes} [Fri May 27 16:21:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:21:29.119500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fc85d-9acc-4f3b-908d-1e8a2480dc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:29.120462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fc85d-9acc-4f3b-908d-1e8a2480dc3a None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:29.120589 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a626d1-9611-4432-bbf1-6ccac8006286 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:29.120670 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fc85d-9acc-4f3b-908d-1e8a2480dc3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:29.121995 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fc85d-9acc-4f3b-908d-1e8a2480dc3a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:29.129319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 488/975] 10.222.0.41 () {56 vars in 1087 bytes} [Fri May 27 16:21:28 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:21:29.244252 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a626d1-9611-4432-bbf1-6ccac8006286 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:29.282400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876ae37-a5c1-4ab3-958b-d63a085a3f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:29.283161 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876ae37-a5c1-4ab3-958b-d63a085a3f6e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:29.283424 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876ae37-a5c1-4ab3-958b-d63a085a3f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:29.283670 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876ae37-a5c1-4ab3-958b-d63a085a3f6e None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:29.287311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876ae37-a5c1-4ab3-958b-d63a085a3f6e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:29.287311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876ae37-a5c1-4ab3-958b-d63a085a3f6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:29.287311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876ae37-a5c1-4ab3-958b-d63a085a3f6e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:29.296064 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 488/976] 10.222.0.41 () {56 vars in 1115 bytes} [Fri May 27 16:21:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:29.301950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fc85d-9acc-4f3b-908d-1e8a2480dc3a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:29.315755 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:29.419448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fc85d-9acc-4f3b-908d-1e8a2480dc3a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:29.471784 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beadc9-6bef-4b48-8a24-7a7caaaabe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:29.473527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beadc9-6bef-4b48-8a24-7a7caaaabe92 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:29.473825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beadc9-6bef-4b48-8a24-7a7caaaabe92 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:29.474102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beadc9-6bef-4b48-8a24-7a7caaaabe92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:29.485141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0beadc9-6bef-4b48-8a24-7a7caaaabe92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:29.486800 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0beadc9-6bef-4b48-8a24-7a7caaaabe92 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:29.505618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-d0beadc9-6bef-4b48-8a24-7a7caaaabe92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:29.505618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:29.505618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:29.505618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:29.505618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:29.505618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:29.505618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:29.505618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:29.505618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:29.505618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:29.505618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:29.505618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:29.505618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:29.505618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:29.505618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:29.506626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:29.506626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:29.506626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:29.506626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:29.506626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:29.506626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:29.506626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:29.506626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:29.506626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:29.506626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:29.506626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:29.506626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:29.506626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:29.506626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:29.506626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:29.506626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:29.506626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:29.507536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:29.507536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:29.507536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:29.507536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:29.508476 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 489/977] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:29.513094 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876ae37-a5c1-4ab3-958b-d63a085a3f6e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:29.552385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:29.628456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876ae37-a5c1-4ab3-958b-d63a085a3f6e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:29.664627 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d696bd1-f064-4b10-8f0a-aaa559d7c0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:29.665304 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d696bd1-f064-4b10-8f0a-aaa559d7c0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:29.665586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d696bd1-f064-4b10-8f0a-aaa559d7c0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:29.665858 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d696bd1-f064-4b10-8f0a-aaa559d7c0f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:29.666573 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d696bd1-f064-4b10-8f0a-aaa559d7c0f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:29.666877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d696bd1-f064-4b10-8f0a-aaa559d7c0f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:29.668299 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d696bd1-f064-4b10-8f0a-aaa559d7c0f3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:29.681448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 489/978] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:29.687006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beadc9-6bef-4b48-8a24-7a7caaaabe92 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:29.755897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:29.772321 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e6aca-02b3-4a37-8a84-1837965b35c8 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:29.772611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e6aca-02b3-4a37-8a84-1837965b35c8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:29.772889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e6aca-02b3-4a37-8a84-1837965b35c8 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:29.774440 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 490/979] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:21:29.779402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3f468-bfc3-4a44-b03e-f6cc4addb385 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:29.779668 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3f468-bfc3-4a44-b03e-f6cc4addb385 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:29.779943 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3f468-bfc3-4a44-b03e-f6cc4addb385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:29.798119 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4db3f468-bfc3-4a44-b03e-f6cc4addb385 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:29.799586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4db3f468-bfc3-4a44-b03e-f6cc4addb385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:29.802771 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beadc9-6bef-4b48-8a24-7a7caaaabe92 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:29.846545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df738af-4b0a-4dd0-bcc0-80bd7d27f6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:29.847368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df738af-4b0a-4dd0-bcc0-80bd7d27f6fc None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:29.847648 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df738af-4b0a-4dd0-bcc0-80bd7d27f6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:29.847914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df738af-4b0a-4dd0-bcc0-80bd7d27f6fc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:29.863348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df738af-4b0a-4dd0-bcc0-80bd7d27f6fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:29.865280 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df738af-4b0a-4dd0-bcc0-80bd7d27f6fc None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:29.885760 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 491/980] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:21:29.893816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-8df738af-4b0a-4dd0-bcc0-80bd7d27f6fc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:21:29.893816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:29.893816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:29.893816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:29.893816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:29.893816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:29.893816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:29.893816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:29.893816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:29.893816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:29.893816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:29.893816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:29.893816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:21:29.893816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:21:29.893816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:21:29.893816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:21:29.894986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:29.894986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:29.894986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:21:29.894986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:29.894986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:21:29.894986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:29.894986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:29.894986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:29.894986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:29.894986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:29.894986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:29.894986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:29.894986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:29.894986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:29.894986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:29.894986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:29.894986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:29.894986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:29.895995 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:29.895995 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:29.895995 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:21:29.895995 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:21:29.895995 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:21:29.895995 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:21:29.895995 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:21:29.895995 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:21:29.895995 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 16:21:29.895995 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:29.897042 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 490/981] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 16:21:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:29.901849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3f468-bfc3-4a44-b03e-f6cc4addb385 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:29.909413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df738af-4b0a-4dd0-bcc0-80bd7d27f6fc None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:29.931245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:30.012944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3f468-bfc3-4a44-b03e-f6cc4addb385 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:30.026317 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df738af-4b0a-4dd0-bcc0-80bd7d27f6fc None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:30.047277 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785cec2-4896-416c-b1dd-57c8c95693f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:30.047965 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785cec2-4896-416c-b1dd-57c8c95693f3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:30.048281 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785cec2-4896-416c-b1dd-57c8c95693f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:30.048652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785cec2-4896-416c-b1dd-57c8c95693f3 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:30.049718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785cec2-4896-416c-b1dd-57c8c95693f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:30.050032 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785cec2-4896-416c-b1dd-57c8c95693f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:30.051561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785cec2-4896-416c-b1dd-57c8c95693f3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:30.051671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:30.065115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187080b-5d21-4912-9e9f-2f65417fa89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:30.066179 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187080b-5d21-4912-9e9f-2f65417fa89d None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:30.066632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187080b-5d21-4912-9e9f-2f65417fa89d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:30.067096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187080b-5d21-4912-9e9f-2f65417fa89d None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:30.067872 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187080b-5d21-4912-9e9f-2f65417fa89d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:30.073990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187080b-5d21-4912-9e9f-2f65417fa89d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:30.074241 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 492/982] 10.222.0.41 () {56 vars in 1149 bytes} [Fri May 27 16:21:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:30.074892 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785cec2-4896-416c-b1dd-57c8c95693f3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:30.089124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 491/983] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 16:21:29 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:21:30.184625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:30.205829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785cec2-4896-416c-b1dd-57c8c95693f3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:30.262160 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3c4dc-7059-4f64-86db-8d11b7dd77c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:30.262846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3c4dc-7059-4f64-86db-8d11b7dd77c7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:30.263127 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3c4dc-7059-4f64-86db-8d11b7dd77c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:30.263398 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f3c4dc-7059-4f64-86db-8d11b7dd77c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:30.344777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3c4dc-7059-4f64-86db-8d11b7dd77c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:30.346723 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f3c4dc-7059-4f64-86db-8d11b7dd77c7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:30.425777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:30.448082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 493/984] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:21:30 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 16:21:30.453478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187080b-5d21-4912-9e9f-2f65417fa89d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:30.560087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187080b-5d21-4912-9e9f-2f65417fa89d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:30.599193 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7a242-875f-44e4-a1c0-18e52c0279f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:30.600025 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7a242-875f-44e4-a1c0-18e52c0279f0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:30.600304 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7a242-875f-44e4-a1c0-18e52c0279f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:30.600567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7a242-875f-44e4-a1c0-18e52c0279f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:30.612468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7a242-875f-44e4-a1c0-18e52c0279f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:30.613931 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7a242-875f-44e4-a1c0-18e52c0279f0 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:30.631674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-fab7a242-875f-44e4-a1c0-18e52c0279f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:30.631674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:30.631674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:30.631674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:30.631674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:30.631674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:30.631674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:30.631674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:30.631674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:30.631674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:30.631674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:30.631674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:30.631674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:30.631674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:30.631674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:30.632936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:30.632936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:30.632936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:30.632936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:30.632936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:30.632936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:30.632936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:30.632936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:30.632936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:30.632936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:30.632936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:30.632936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:30.632936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:30.632936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:30.632936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:30.632936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:30.632936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:30.633976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:30.633976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:30.633976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:30.633976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:30.636139 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 492/985] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:30.638633 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3c4dc-7059-4f64-86db-8d11b7dd77c7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:30.743200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f3c4dc-7059-4f64-86db-8d11b7dd77c7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:30.777511 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae24cae-7778-4679-b0e0-70ac57fec7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:30.778183 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae24cae-7778-4679-b0e0-70ac57fec7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:30.778468 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae24cae-7778-4679-b0e0-70ac57fec7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:30.778744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae24cae-7778-4679-b0e0-70ac57fec7c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:30.779460 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae24cae-7778-4679-b0e0-70ac57fec7c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:30.779768 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae24cae-7778-4679-b0e0-70ac57fec7c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:30.781193 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae24cae-7778-4679-b0e0-70ac57fec7c8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:30.793467 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 494/986] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:30.799240 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7a242-875f-44e4-a1c0-18e52c0279f0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:30.836311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:30.907501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7a242-875f-44e4-a1c0-18e52c0279f0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:30.945902 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf50fa-cd20-444b-b683-76c9383f499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:30.946716 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf50fa-cd20-444b-b683-76c9383f499d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:30.946999 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf50fa-cd20-444b-b683-76c9383f499d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:30.947273 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf50fa-cd20-444b-b683-76c9383f499d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:30.955154 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf50fa-cd20-444b-b683-76c9383f499d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:30.956781 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf50fa-cd20-444b-b683-76c9383f499d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:30.971798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-93cf50fa-cd20-444b-b683-76c9383f499d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:30.971798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:30.971798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:30.971798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:30.971798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:30.971798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:30.971798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:30.971798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:30.971798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:30.971798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:30.971798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:30.971798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:30.971798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:21:30.971798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:21:30.971798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:21:30.972881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:21:30.972881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:30.972881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:30.972881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:30.972881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:30.972881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:30.972881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:30.972881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:30.972881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:30.972881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:30.972881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:30.972881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:30.972881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:30.972881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:30.972881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:30.972881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:30.972881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:30.973811 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:21:30.973811 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:21:30.973811 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:21:30.973811 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:21:30.973811 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:21:30.973811 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:21:30.973811 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:30.973811 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:30.976239 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 493/987] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:30.979293 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae24cae-7778-4679-b0e0-70ac57fec7c8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:31.029742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:31.113776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae24cae-7778-4679-b0e0-70ac57fec7c8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:31.150618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a89799-be0f-44be-969f-1656e694d6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:31.151295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a89799-be0f-44be-969f-1656e694d6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:31.151580 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a89799-be0f-44be-969f-1656e694d6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:31.151857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a89799-be0f-44be-969f-1656e694d6a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:31.152673 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a89799-be0f-44be-969f-1656e694d6a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:31.152980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a89799-be0f-44be-969f-1656e694d6a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:31.154443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a89799-be0f-44be-969f-1656e694d6a2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:31.172230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 495/988] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:21:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:31.174588 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf50fa-cd20-444b-b683-76c9383f499d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:31.291746 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:31.301081 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf50fa-cd20-444b-b683-76c9383f499d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:31.338364 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56573b0-95f0-4421-aef6-08bbbf61e774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:31.339031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56573b0-95f0-4421-aef6-08bbbf61e774 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:31.339320 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56573b0-95f0-4421-aef6-08bbbf61e774 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:31.339597 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56573b0-95f0-4421-aef6-08bbbf61e774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:31.340452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56573b0-95f0-4421-aef6-08bbbf61e774 None admin] RBAC: Adding query filter params (role.id=a4f4043359b042a9abe4f0ace9620258, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=2ccee0bc7e2b41f4a2fe2a891a95b318) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:31.340763 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56573b0-95f0-4421-aef6-08bbbf61e774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:31.342237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56573b0-95f0-4421-aef6-08bbbf61e774 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:31.349310 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 494/989] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:21:31 2022] GET /identity/v3/role_assignments?user.id=2ccee0bc7e2b41f4a2fe2a891a95b318&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=a4f4043359b042a9abe4f0ace9620258 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:31.387757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4704832-753d-4e7b-88fc-893ecceca0e0 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:31.388198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4704832-753d-4e7b-88fc-893ecceca0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:31.388552 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4704832-753d-4e7b-88fc-893ecceca0e0 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:31.390125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 496/990] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:31.396318 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfae1d9-44da-40ab-ac43-36c2a42b5f65 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:31.396679 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfae1d9-44da-40ab-ac43-36c2a42b5f65 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:31.396852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfae1d9-44da-40ab-ac43-36c2a42b5f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:31.416705 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-edfae1d9-44da-40ab-ac43-36c2a42b5f65 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:31.417963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-edfae1d9-44da-40ab-ac43-36c2a42b5f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:31.500463 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 495/991] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:31.523222 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4704832-753d-4e7b-88fc-893ecceca0e0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:31.644698 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:31.649222 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4704832-753d-4e7b-88fc-893ecceca0e0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:31.685978 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e64e5b-fa19-4fa6-8aca-9fc6749be34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:31.686804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e64e5b-fa19-4fa6-8aca-9fc6749be34e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:31.687083 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e64e5b-fa19-4fa6-8aca-9fc6749be34e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:31.687352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e64e5b-fa19-4fa6-8aca-9fc6749be34e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:31.687988 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e64e5b-fa19-4fa6-8aca-9fc6749be34e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:31.689857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e64e5b-fa19-4fa6-8aca-9fc6749be34e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:31.702793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-72e64e5b-fa19-4fa6-8aca-9fc6749be34e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:21:31.702793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:31.702793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:31.702793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:31.702793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:31.702793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:31.702793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:31.702793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:31.702793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:21:31.702793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:31.702793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:31.702793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:31.702793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:31.702793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:31.702793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:31.702793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:31.702793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:31.703822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:31.703822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:31.703822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:31.703822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:31.703822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:31.703822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:31.703822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:31.703822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:31.703822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:31.703822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:31.703822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:31.703822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:31.703822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:31.703822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:31.703822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:31.703822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:31.710669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:31.710669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:31.710669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:31.710669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:31.710669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:31.710669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:31.710669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:31.710669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:31.710669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:31.710669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:31.710669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:31.710669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:31.710669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 16:21:31.710669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:31.710669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 497/992] 10.222.0.41 () {56 vars in 1126 bytes} [Fri May 27 16:21:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:31.711665 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfae1d9-44da-40ab-ac43-36c2a42b5f65 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:31.806317 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:31.821375 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfae1d9-44da-40ab-ac43-36c2a42b5f65 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:31.859962 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6f61f-0884-4551-9384-8dac1ee83d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:31.860658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6f61f-0884-4551-9384-8dac1ee83d23 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:31.861057 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6f61f-0884-4551-9384-8dac1ee83d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:31.861904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6f61f-0884-4551-9384-8dac1ee83d23 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:31.862632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6f61f-0884-4551-9384-8dac1ee83d23 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:31.862936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6f61f-0884-4551-9384-8dac1ee83d23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:31.864355 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6f61f-0884-4551-9384-8dac1ee83d23 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:31.869792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 496/993] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 16:21:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:31.875536 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e64e5b-fa19-4fa6-8aca-9fc6749be34e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:31.985127 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e64e5b-fa19-4fa6-8aca-9fc6749be34e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:32.021180 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c2efb-3b61-4faf-b44a-97aeb0080f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:32.021846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c2efb-3b61-4faf-b44a-97aeb0080f04 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:32.022127 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c2efb-3b61-4faf-b44a-97aeb0080f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:32.022363 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c2efb-3b61-4faf-b44a-97aeb0080f04 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:32.023096 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c2efb-3b61-4faf-b44a-97aeb0080f04 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:32.023402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c2efb-3b61-4faf-b44a-97aeb0080f04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:32.024879 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c2efb-3b61-4faf-b44a-97aeb0080f04 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:32.030262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 498/994] 10.222.0.41 () {56 vars in 1122 bytes} [Fri May 27 16:21:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:32.035827 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6f61f-0884-4551-9384-8dac1ee83d23 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:32.142790 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6f61f-0884-4551-9384-8dac1ee83d23 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:32.183615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4446c-c5e1-452e-962a-247915847c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:32.184388 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4446c-c5e1-452e-962a-247915847c9b None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:32.184625 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4446c-c5e1-452e-962a-247915847c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:32.184916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4446c-c5e1-452e-962a-247915847c9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:32.185800 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4446c-c5e1-452e-962a-247915847c9b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:32.187256 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4446c-c5e1-452e-962a-247915847c9b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:32.207983 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 497/995] 10.222.0.41 () {60 vars in 1144 bytes} [Fri May 27 16:21:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:21:32.366309 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e993269-2ae3-4711-a6e8-7dd602daf765 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:32.366681 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e993269-2ae3-4711-a6e8-7dd602daf765 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:32.366843 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e993269-2ae3-4711-a6e8-7dd602daf765 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:32.368492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 499/996] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:32.374146 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bc92d-f632-48ba-a46e-555f442608d0 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:32.374446 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bc92d-f632-48ba-a46e-555f442608d0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:32.374721 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bc92d-f632-48ba-a46e-555f442608d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:32.394059 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-908bc92d-f632-48ba-a46e-555f442608d0 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:32.395293 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-908bc92d-f632-48ba-a46e-555f442608d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:32.405038 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:32.479478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 498/997] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:32 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:32.502141 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e993269-2ae3-4711-a6e8-7dd602daf765 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:32.532715 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:32.611383 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e993269-2ae3-4711-a6e8-7dd602daf765 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:32.647777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb7b4c-c19f-4ec7-a5b6-153287452613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:32.648758 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb7b4c-c19f-4ec7-a5b6-153287452613 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:32.648964 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb7b4c-c19f-4ec7-a5b6-153287452613 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:32.649239 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb7b4c-c19f-4ec7-a5b6-153287452613 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:32.649901 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb7b4c-c19f-4ec7-a5b6-153287452613 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:32.651381 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb7b4c-c19f-4ec7-a5b6-153287452613 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:32.664085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-4bbb7b4c-c19f-4ec7-a5b6-153287452613 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 16:21:32.664085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:32.664085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:32.664085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:32.664085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:32.664085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:32.664085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:32.664085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:32.664085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 16:21:32.664085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:32.664085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:32.664085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:32.664085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:32.664085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:32.664085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:32.664085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:32.664085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:32.665225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:32.665225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:32.665225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:32.665225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:32.665225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:32.665225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:32.665225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:32.665225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:32.665225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:32.665225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:32.665225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:32.665225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:32.665225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:32.665225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:32.665225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:32.665225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:32.666810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:32.666810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:32.666810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:32.666810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:32.666810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:32.666810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:32.666810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:32.666810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:32.666810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:32.666810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:32.666810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:32.666810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:32.666810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 16:21:32.666810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:32.667820 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 500/998] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:32.671783 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bc92d-f632-48ba-a46e-555f442608d0 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:32.780752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bc92d-f632-48ba-a46e-555f442608d0 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:32.818417 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e08b8-1d53-4d7f-baa7-ac01e3a59945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:32.819091 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e08b8-1d53-4d7f-baa7-ac01e3a59945 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:32.819366 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e08b8-1d53-4d7f-baa7-ac01e3a59945 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:32.819662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e08b8-1d53-4d7f-baa7-ac01e3a59945 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:32.820382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e08b8-1d53-4d7f-baa7-ac01e3a59945 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:32.820784 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e08b8-1d53-4d7f-baa7-ac01e3a59945 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:32.822067 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e08b8-1d53-4d7f-baa7-ac01e3a59945 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:32.832220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 499/999] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 16:21:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:32.834019 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb7b4c-c19f-4ec7-a5b6-153287452613 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:32.933113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:32.945431 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb7b4c-c19f-4ec7-a5b6-153287452613 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:32.982836 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550af141-35ff-4900-a217-06561bab2679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:32.983952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550af141-35ff-4900-a217-06561bab2679 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:32.984510 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550af141-35ff-4900-a217-06561bab2679 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:32.984979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550af141-35ff-4900-a217-06561bab2679 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:32.986039 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550af141-35ff-4900-a217-06561bab2679 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:32.986603 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550af141-35ff-4900-a217-06561bab2679 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:32.988249 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550af141-35ff-4900-a217-06561bab2679 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:32.993855 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 501/1000] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 16:21:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:33.000091 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e08b8-1d53-4d7f-baa7-ac01e3a59945 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:33.003322 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:33.108790 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e08b8-1d53-4d7f-baa7-ac01e3a59945 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:33.145108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25d759-d455-41d3-981a-9171de67ab59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:33.145803 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25d759-d455-41d3-981a-9171de67ab59 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:33.146081 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25d759-d455-41d3-981a-9171de67ab59 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:33.146350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25d759-d455-41d3-981a-9171de67ab59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:33.147136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25d759-d455-41d3-981a-9171de67ab59 None admin] RBAC: Adding query filter params (interface=public, service_id=2abcb4c5345f49edb27e31b2179ab6ce, region_id=RegionOne) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:33.147503 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25d759-d455-41d3-981a-9171de67ab59 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:33.148938 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25d759-d455-41d3-981a-9171de67ab59 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:33.159263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 500/1001] 10.222.0.41 () {56 vars in 1251 bytes} [Fri May 27 16:21:32 2022] GET /identity/v3/endpoints?service_id=2abcb4c5345f49edb27e31b2179ab6ce&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:33.160834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550af141-35ff-4900-a217-06561bab2679 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:33.271710 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550af141-35ff-4900-a217-06561bab2679 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:33.322371 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8b54c-c362-4366-b31e-f1ea29a691e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:33.323048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8b54c-c362-4366-b31e-f1ea29a691e2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:33.323317 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8b54c-c362-4366-b31e-f1ea29a691e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:33.323576 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8b54c-c362-4366-b31e-f1ea29a691e2 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:33.324293 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8b54c-c362-4366-b31e-f1ea29a691e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:33.325696 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8b54c-c362-4366-b31e-f1ea29a691e2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:33.333589 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 502/1002] 10.222.0.41 () {56 vars in 1087 bytes} [Fri May 27 16:21:33 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:21:33.688249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857d41d-f612-4058-8391-18311df6010b None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:33.688662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857d41d-f612-4058-8391-18311df6010b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:33.688835 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857d41d-f612-4058-8391-18311df6010b None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:33.690702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 501/1003] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:33.696199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946e588-b0dd-4811-8074-bed326aa24b3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:33.696696 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946e588-b0dd-4811-8074-bed326aa24b3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:33.696696 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946e588-b0dd-4811-8074-bed326aa24b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:33.714746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1946e588-b0dd-4811-8074-bed326aa24b3 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:33.715933 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1946e588-b0dd-4811-8074-bed326aa24b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:33.731212 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:33.792363 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 503/1004] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:33.814446 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857d41d-f612-4058-8391-18311df6010b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:33.886906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:33.924916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857d41d-f612-4058-8391-18311df6010b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:33.961146 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccacd6-919e-4d3c-bb5a-09a7514f8733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:33.961865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccacd6-919e-4d3c-bb5a-09a7514f8733 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:33.962142 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccacd6-919e-4d3c-bb5a-09a7514f8733 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:33.962408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccacd6-919e-4d3c-bb5a-09a7514f8733 None admin] PATH_INFO: `/v3/services/image` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:33.963058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccacd6-919e-4d3c-bb5a-09a7514f8733 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:33.964475 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccacd6-919e-4d3c-bb5a-09a7514f8733 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:33.976270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-a5ccacd6-919e-4d3c-bb5a-09a7514f8733 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 16:21:33.976270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:33.976270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:33.976270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:33.976270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:33.976270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:33.976270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:33.976270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:33.976270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 16:21:33.976270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:33.976270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:33.976270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:33.976270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:33.976270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:33.976270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:33.976270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:33.976270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:33.977321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:33.977321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:33.977321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:33.977321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:33.977321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:33.977321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:33.977321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:33.977321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:33.977321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:33.977321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:33.977321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:33.977321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:33.977321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:33.977321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:33.977321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:33.977321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:33.983348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:33.983348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:33.983348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:33.983348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:33.983348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:33.983348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:33.983348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:33.983348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:33.983348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:33.983348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:33.983348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:33.983348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:33.983348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 16:21:33.983348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:33.983348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 502/1005] 10.222.0.41 () {56 vars in 1105 bytes} [Fri May 27 16:21:33 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:33.986304 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946e588-b0dd-4811-8074-bed326aa24b3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:34.093047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946e588-b0dd-4811-8074-bed326aa24b3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:34.130117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1558276-0e20-4723-8675-6e8ef884ba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:34.130790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1558276-0e20-4723-8675-6e8ef884ba10 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:34.131076 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1558276-0e20-4723-8675-6e8ef884ba10 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:34.131351 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1558276-0e20-4723-8675-6e8ef884ba10 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:34.132057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1558276-0e20-4723-8675-6e8ef884ba10 None admin] RBAC: Adding query filter params (name=image) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:34.132399 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1558276-0e20-4723-8675-6e8ef884ba10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:34.133802 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1558276-0e20-4723-8675-6e8ef884ba10 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:34.139657 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 504/1006] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:34.145370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccacd6-919e-4d3c-bb5a-09a7514f8733 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:34.256880 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccacd6-919e-4d3c-bb5a-09a7514f8733 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:34.293863 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:34.300705 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec6166-f5b8-4a87-a7fd-a1cfe6bcd85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:34.301387 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec6166-f5b8-4a87-a7fd-a1cfe6bcd85b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:34.301673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec6166-f5b8-4a87-a7fd-a1cfe6bcd85b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:34.301949 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec6166-f5b8-4a87-a7fd-a1cfe6bcd85b None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:34.302652 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec6166-f5b8-4a87-a7fd-a1cfe6bcd85b None admin] RBAC: Adding query filter params (type=image) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:34.302959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec6166-f5b8-4a87-a7fd-a1cfe6bcd85b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:34.304411 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec6166-f5b8-4a87-a7fd-a1cfe6bcd85b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:34.316339 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 503/1007] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:34.570479 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b829f-9494-4d85-b249-a6b6443bfa25 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:34.570713 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b829f-9494-4d85-b249-a6b6443bfa25 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:34.570917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b829f-9494-4d85-b249-a6b6443bfa25 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:34.572745 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 505/1008] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:34.578690 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5d2d1-7168-4f2c-a4ba-8926b2adc724 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:34.580375 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5d2d1-7168-4f2c-a4ba-8926b2adc724 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:34.580375 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5d2d1-7168-4f2c-a4ba-8926b2adc724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:34.598482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b2f5d2d1-7168-4f2c-a4ba-8926b2adc724 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:34.599906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b2f5d2d1-7168-4f2c-a4ba-8926b2adc724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:34.678669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 504/1009] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:34 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:34.701727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b829f-9494-4d85-b249-a6b6443bfa25 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:34.719505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:34.810605 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b829f-9494-4d85-b249-a6b6443bfa25 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:34.848472 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a020bff-2525-4276-a866-b66dfd8440b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:34.849199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a020bff-2525-4276-a866-b66dfd8440b9 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:34.849481 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a020bff-2525-4276-a866-b66dfd8440b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:34.849753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a020bff-2525-4276-a866-b66dfd8440b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:34.850982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a020bff-2525-4276-a866-b66dfd8440b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:34.852489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a020bff-2525-4276-a866-b66dfd8440b9 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:34.854133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 506/1010] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:34.860187 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5d2d1-7168-4f2c-a4ba-8926b2adc724 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:34.970027 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5d2d1-7168-4f2c-a4ba-8926b2adc724 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:34.994693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:35.007988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13476b95-1d23-4bc2-aafb-afab9e87b91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:35.008999 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13476b95-1d23-4bc2-aafb-afab9e87b91a None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:35.009491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13476b95-1d23-4bc2-aafb-afab9e87b91a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:35.009971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13476b95-1d23-4bc2-aafb-afab9e87b91a None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:35.010967 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13476b95-1d23-4bc2-aafb-afab9e87b91a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:35.013001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13476b95-1d23-4bc2-aafb-afab9e87b91a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:35.043870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 505/1011] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 16:21:34 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:21:35.643717 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790aa9f-60d8-43eb-a89b-62d0eeb2a44e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:35.643916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790aa9f-60d8-43eb-a89b-62d0eeb2a44e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:35.644206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790aa9f-60d8-43eb-a89b-62d0eeb2a44e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:35.645643 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 507/1012] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:35.651606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8202faa-fb1f-46d7-b326-18c7fdd9256a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:35.651900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8202faa-fb1f-46d7-b326-18c7fdd9256a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:35.652214 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8202faa-fb1f-46d7-b326-18c7fdd9256a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:35.670282 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c8202faa-fb1f-46d7-b326-18c7fdd9256a None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:35.671467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c8202faa-fb1f-46d7-b326-18c7fdd9256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:35.748298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 506/1013] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:35 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:35.771982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790aa9f-60d8-43eb-a89b-62d0eeb2a44e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:35.863153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:35.885480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790aa9f-60d8-43eb-a89b-62d0eeb2a44e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:35.922823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2f5b5-a2c5-410c-91f5-0f1dfe422ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:35.923954 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2f5b5-a2c5-410c-91f5-0f1dfe422ffc None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:35.923954 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2f5b5-a2c5-410c-91f5-0f1dfe422ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:35.924259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2f5b5-a2c5-410c-91f5-0f1dfe422ffc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:35.924877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2f5b5-a2c5-410c-91f5-0f1dfe422ffc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:35.926273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2f5b5-a2c5-410c-91f5-0f1dfe422ffc None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:35.938427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-cda2f5b5-a2c5-410c-91f5-0f1dfe422ffc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 16:21:35.938427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:35.938427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:35.938427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:35.938427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:35.938427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:35.938427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:35.938427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:35.938427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 16:21:35.938427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:35.938427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:35.938427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:35.938427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:35.938427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:35.938427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:35.938427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:35.938427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:35.939937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:35.939937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:35.939937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:35.939937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:35.939937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:35.939937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:35.939937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:35.939937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:35.939937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:35.939937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:35.939937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:35.939937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:35.939937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:35.939937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:35.939937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:35.939937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:35.941192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:35.941192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:35.941192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:35.941192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:35.941192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:35.941192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:35.941192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:35.941192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:35.941192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:35.941192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:35.941192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:35.941192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:35.941192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 16:21:35.941192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:35.944812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 508/1014] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:35.946199 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8202faa-fb1f-46d7-b326-18c7fdd9256a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:36.047106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8202faa-fb1f-46d7-b326-18c7fdd9256a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:36.054997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:36.087779 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb2a4d-448a-4dac-ba3f-18311a699312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:36.088484 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2a4d-448a-4dac-ba3f-18311a699312 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:36.088767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2a4d-448a-4dac-ba3f-18311a699312 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:36.089104 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2a4d-448a-4dac-ba3f-18311a699312 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:36.089743 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb2a4d-448a-4dac-ba3f-18311a699312 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:36.090046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb2a4d-448a-4dac-ba3f-18311a699312 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:36.091426 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb2a4d-448a-4dac-ba3f-18311a699312 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:36.096978 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 507/1015] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 16:21:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:36.102650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2f5b5-a2c5-410c-91f5-0f1dfe422ffc None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:36.202898 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2f5b5-a2c5-410c-91f5-0f1dfe422ffc None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:36.243839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b751f-77c5-4a6c-ac28-d579b4a48d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:36.244561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b751f-77c5-4a6c-ac28-d579b4a48d99 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:36.244814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b751f-77c5-4a6c-ac28-d579b4a48d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:36.245116 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b751f-77c5-4a6c-ac28-d579b4a48d99 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:36.245827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b751f-77c5-4a6c-ac28-d579b4a48d99 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:36.246100 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b751f-77c5-4a6c-ac28-d579b4a48d99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:36.247525 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b751f-77c5-4a6c-ac28-d579b4a48d99 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:36.253476 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 509/1016] 10.222.0.41 () {56 vars in 1112 bytes} [Fri May 27 16:21:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:36.259207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb2a4d-448a-4dac-ba3f-18311a699312 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:36.371980 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb2a4d-448a-4dac-ba3f-18311a699312 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:36.413050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece6726-80d6-4226-b602-a905f06ce0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:36.413701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece6726-80d6-4226-b602-a905f06ce0af None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:36.413979 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece6726-80d6-4226-b602-a905f06ce0af None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:36.414246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece6726-80d6-4226-b602-a905f06ce0af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:36.414997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece6726-80d6-4226-b602-a905f06ce0af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:36.416414 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece6726-80d6-4226-b602-a905f06ce0af None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:36.438998 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 508/1017] 10.222.0.41 () {60 vars in 1144 bytes} [Fri May 27 16:21:36 2022] POST /identity/v3/endpoints => generated 334 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:21:36.581414 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2321e5-8788-496e-9127-efdd5ca9add8 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:36.581611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2321e5-8788-496e-9127-efdd5ca9add8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:36.581889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2321e5-8788-496e-9127-efdd5ca9add8 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:36.583557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 510/1018] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:36.589272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74a61f-e795-4e07-b98a-c1a9295e3b28 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:36.589559 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74a61f-e795-4e07-b98a-c1a9295e3b28 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:36.589847 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74a61f-e795-4e07-b98a-c1a9295e3b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:36.608721 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8c74a61f-e795-4e07-b98a-c1a9295e3b28 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:36.609961 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8c74a61f-e795-4e07-b98a-c1a9295e3b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:36.636064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:36.696225 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 509/1019] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:36 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:36.728645 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2321e5-8788-496e-9127-efdd5ca9add8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:36.747271 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:36.850477 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2321e5-8788-496e-9127-efdd5ca9add8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:36.889039 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e5ead-cd66-49e1-9199-a5f4ac80aea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:36.890035 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e5ead-cd66-49e1-9199-a5f4ac80aea3 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:36.890491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e5ead-cd66-49e1-9199-a5f4ac80aea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:36.891052 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e5ead-cd66-49e1-9199-a5f4ac80aea3 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:36.892166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e5ead-cd66-49e1-9199-a5f4ac80aea3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:36.893800 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e5ead-cd66-49e1-9199-a5f4ac80aea3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:36.909985 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 511/1020] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 16:21:36 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:21:37.457092 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b407aa-4aac-4c60-9b3f-705aa1fc4a28 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:37.457679 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b407aa-4aac-4c60-9b3f-705aa1fc4a28 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:37.457679 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b407aa-4aac-4c60-9b3f-705aa1fc4a28 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:37.459130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 510/1021] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:37 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:37.465225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc57474-95bc-4541-b0e4-9967876b5446 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:37.465483 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc57474-95bc-4541-b0e4-9967876b5446 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:37.465796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc57474-95bc-4541-b0e4-9967876b5446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:37.483909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8fc57474-95bc-4541-b0e4-9967876b5446 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:37.485152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8fc57474-95bc-4541-b0e4-9967876b5446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:37.581460 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:37.604061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 512/1022] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:37.636211 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b407aa-4aac-4c60-9b3f-705aa1fc4a28 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:37.788813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b407aa-4aac-4c60-9b3f-705aa1fc4a28 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:37.831354 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b0162-6bfb-434e-9f36-4d408ee7f55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:37.832273 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b0162-6bfb-434e-9f36-4d408ee7f55c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:37.832525 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b0162-6bfb-434e-9f36-4d408ee7f55c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:37.832767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b0162-6bfb-434e-9f36-4d408ee7f55c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:37.834017 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b0162-6bfb-434e-9f36-4d408ee7f55c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:37.835502 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b0162-6bfb-434e-9f36-4d408ee7f55c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:37.842199 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 511/1023] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:37.843504 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc57474-95bc-4541-b0e4-9967876b5446 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:37.956497 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc57474-95bc-4541-b0e4-9967876b5446 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:37.990937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31ab77-99fa-4766-bf3b-8a53e556fb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:37.991622 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31ab77-99fa-4766-bf3b-8a53e556fb11 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:37.991933 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31ab77-99fa-4766-bf3b-8a53e556fb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:37.992201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31ab77-99fa-4766-bf3b-8a53e556fb11 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:37.993033 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31ab77-99fa-4766-bf3b-8a53e556fb11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:37.994401 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31ab77-99fa-4766-bf3b-8a53e556fb11 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:38.016247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 513/1024] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 16:21:37 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:21:38.846861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6029073-0291-45e1-82a4-2fe83920d090 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:38.847414 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6029073-0291-45e1-82a4-2fe83920d090 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:38.847414 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6029073-0291-45e1-82a4-2fe83920d090 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:38.849026 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 512/1025] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:38.854244 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2b8b9-f5a8-4266-8828-807db23e0d3f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:38.854519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2b8b9-f5a8-4266-8828-807db23e0d3f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:38.854819 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2b8b9-f5a8-4266-8828-807db23e0d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:38.871870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-07f2b8b9-f5a8-4266-8828-807db23e0d3f None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:38.873129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-07f2b8b9-f5a8-4266-8828-807db23e0d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:38.925404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:38.949047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 514/1026] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:38.972939 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6029073-0291-45e1-82a4-2fe83920d090 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:38.998025 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:39.085507 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6029073-0291-45e1-82a4-2fe83920d090 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:39.127544 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b682d6c-afee-4dfb-93fe-2fc63bade179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:39.128312 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b682d6c-afee-4dfb-93fe-2fc63bade179 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:39.128599 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b682d6c-afee-4dfb-93fe-2fc63bade179 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:39.128873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b682d6c-afee-4dfb-93fe-2fc63bade179 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:39.140323 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b682d6c-afee-4dfb-93fe-2fc63bade179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:21:39.149452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-7b682d6c-afee-4dfb-93fe-2fc63bade179 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:21:39.149452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:39.149452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:39.149452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:39.149452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:39.149452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:39.149452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:39.149452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:39.149452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:39.149452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:39.149452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:39.149452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:39.149452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:21:39.149452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:21:39.149452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:21:39.149452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:21:39.150491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:21:39.150491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:21:39.150491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:21:39.150491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:21:39.150491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:39.150491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:39.150491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:39.150491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:39.150491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:39.150491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:39.150491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:39.150491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:39.150491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:39.150491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:39.150491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:39.150491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:39.156394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:39.156394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:39.156394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:39.156394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:39.156394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:21:39.156394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:21:39.156394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:21:39.156394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:21:39.156394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:21:39.156394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:21:39.156394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:21:39.156394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:39.156394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 513/1027] 10.222.0.41 () {56 vars in 1120 bytes} [Fri May 27 16:21:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:39.159069 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2b8b9-f5a8-4266-8828-807db23e0d3f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:39.273407 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2b8b9-f5a8-4266-8828-807db23e0d3f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:39.273642 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0754e63-a309-4867-8138-6689c8d6b2fe None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:39.273874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0754e63-a309-4867-8138-6689c8d6b2fe None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:39.274154 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0754e63-a309-4867-8138-6689c8d6b2fe None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:39.275803 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 514/1028] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:21:39.281096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ab403-75ad-418f-a6c2-62c3a5b13f79 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:39.281418 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ab403-75ad-418f-a6c2-62c3a5b13f79 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:39.281666 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ab403-75ad-418f-a6c2-62c3a5b13f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:39.305053 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-966ab403-75ad-418f-a6c2-62c3a5b13f79 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:39.306571 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-966ab403-75ad-418f-a6c2-62c3a5b13f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:39.316493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68104150-dae0-4f5f-ae51-a9df048af30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:39.317268 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68104150-dae0-4f5f-ae51-a9df048af30e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:39.317550 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68104150-dae0-4f5f-ae51-a9df048af30e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:39.317825 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68104150-dae0-4f5f-ae51-a9df048af30e None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:39.318563 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68104150-dae0-4f5f-ae51-a9df048af30e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:39.318877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68104150-dae0-4f5f-ae51-a9df048af30e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:39.320307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68104150-dae0-4f5f-ae51-a9df048af30e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:39.330525 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 515/1029] 10.222.0.41 () {56 vars in 1115 bytes} [Fri May 27 16:21:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:39.335390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68104150-dae0-4f5f-ae51-a9df048af30e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:39.390503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:39.398223 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 515/1030] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:21:39.420357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ab403-75ad-418f-a6c2-62c3a5b13f79 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:39.433207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:39.467091 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68104150-dae0-4f5f-ae51-a9df048af30e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:39.505240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb19181-8089-4858-9cea-a6d65673a2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:39.506420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb19181-8089-4858-9cea-a6d65673a2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:39.506930 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb19181-8089-4858-9cea-a6d65673a2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:39.507396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb19181-8089-4858-9cea-a6d65673a2d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:39.518945 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb19181-8089-4858-9cea-a6d65673a2d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:39.520628 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb19181-8089-4858-9cea-a6d65673a2d8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:39.528340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ab403-75ad-418f-a6c2-62c3a5b13f79 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:39.538287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-5bb19181-8089-4858-9cea-a6d65673a2d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:39.538287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:39.538287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:39.538287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:39.538287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:39.538287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:39.538287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:39.538287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:39.538287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:39.538287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:39.538287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:39.538287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:39.538287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:39.538287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:39.538287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:39.539265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:39.539265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:39.539265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:39.539265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:39.539265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:39.539265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:39.539265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:39.539265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:39.539265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:39.539265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:39.539265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:39.539265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:39.539265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:39.539265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:39.539265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:39.539265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:39.539265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:39.540259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:39.540259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:39.540259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:39.540259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:39.540259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 516/1031] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:39.545128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb19181-8089-4858-9cea-a6d65673a2d8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:39.568468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4a5e7-7cfc-43d7-beec-c5b301193e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:39.569273 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4a5e7-7cfc-43d7-beec-c5b301193e31 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:39.569557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4a5e7-7cfc-43d7-beec-c5b301193e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:39.569831 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4a5e7-7cfc-43d7-beec-c5b301193e31 None admin] PATH_INFO: `/v3/services/image` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:39.570490 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4a5e7-7cfc-43d7-beec-c5b301193e31 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:39.571902 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4a5e7-7cfc-43d7-beec-c5b301193e31 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:39.584876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-73c4a5e7-7cfc-43d7-beec-c5b301193e31 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 16:21:39.584876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:39.584876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:39.584876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:39.584876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:39.584876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:39.584876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:39.584876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:39.584876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 16:21:39.584876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:39.584876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:39.584876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:39.584876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:39.584876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:39.584876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:39.584876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:39.584876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:39.585950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:39.585950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:39.585950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:39.585950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:39.585950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:39.585950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:39.585950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:39.585950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:39.585950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:39.585950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:39.585950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:39.585950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:39.585950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:39.585950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:39.585950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:39.585950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:39.588879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:39.588879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:39.588879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:39.588879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:39.588879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:39.588879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:39.588879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:39.588879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:39.588879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:39.588879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:39.588879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:39.588879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:39.588879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 16:21:39.588879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:39.588879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 516/1032] 10.222.0.41 () {56 vars in 1105 bytes} [Fri May 27 16:21:39 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:21:39.591954 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4a5e7-7cfc-43d7-beec-c5b301193e31 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:39.651220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:39.658072 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb19181-8089-4858-9cea-a6d65673a2d8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:39.677712 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:39.693159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d963f99-f612-4ed5-9e36-ef66bdf06866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:39.693985 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d963f99-f612-4ed5-9e36-ef66bdf06866 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:39.694139 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d963f99-f612-4ed5-9e36-ef66bdf06866 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:39.694386 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d963f99-f612-4ed5-9e36-ef66bdf06866 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:39.695107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d963f99-f612-4ed5-9e36-ef66bdf06866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:39.695414 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d963f99-f612-4ed5-9e36-ef66bdf06866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:39.696942 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d963f99-f612-4ed5-9e36-ef66bdf06866 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:39.707623 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4a5e7-7cfc-43d7-beec-c5b301193e31 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:39.709637 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 517/1033] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:39.714788 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d963f99-f612-4ed5-9e36-ef66bdf06866 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:39.752487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8540f6-b042-45c5-933a-2580f9404ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:39.753552 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8540f6-b042-45c5-933a-2580f9404ddf None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:39.754023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8540f6-b042-45c5-933a-2580f9404ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:39.754472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8540f6-b042-45c5-933a-2580f9404ddf None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:39.755373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8540f6-b042-45c5-933a-2580f9404ddf None admin] RBAC: Adding query filter params (name=image) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:39.755854 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8540f6-b042-45c5-933a-2580f9404ddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:39.757475 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8540f6-b042-45c5-933a-2580f9404ddf None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:39.763276 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 517/1034] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:39.769087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8540f6-b042-45c5-933a-2580f9404ddf None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:39.832532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d963f99-f612-4ed5-9e36-ef66bdf06866 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:39.871174 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee572f7-4a81-44bc-8085-83e3ca999b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:39.872316 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee572f7-4a81-44bc-8085-83e3ca999b2a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:39.872753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee572f7-4a81-44bc-8085-83e3ca999b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:39.873153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee572f7-4a81-44bc-8085-83e3ca999b2a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:39.881483 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee572f7-4a81-44bc-8085-83e3ca999b2a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:39.882658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8540f6-b042-45c5-933a-2580f9404ddf None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:39.883812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee572f7-4a81-44bc-8085-83e3ca999b2a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:39.898982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-9ee572f7-4a81-44bc-8085-83e3ca999b2a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 16:21:39.898982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:39.898982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:39.898982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:39.898982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:39.898982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:39.898982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:39.898982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:39.898982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:39.898982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:39.898982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:39.898982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:39.898982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:21:39.898982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:21:39.898982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:21:39.898982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:21:39.900209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:39.900209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:39.900209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:21:39.900209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:39.900209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:21:39.900209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:39.900209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:39.900209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:39.900209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:39.900209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:39.900209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:39.900209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:39.900209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:39.900209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:39.900209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:39.900209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:39.900209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:39.900209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:39.901452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:39.901452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:39.901452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:21:39.901452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:21:39.901452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:21:39.901452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:21:39.901452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:21:39.901452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:21:39.901452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 16:21:39.901452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:39.908281 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 518/1035] 10.222.0.41 () {56 vars in 1093 bytes} [Fri May 27 16:21:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:21:39.909367 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee572f7-4a81-44bc-8085-83e3ca999b2a None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:39.920237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a42859-816e-4b7f-8467-8a80b61328e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:39.920916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a42859-816e-4b7f-8467-8a80b61328e7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:39.921201 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a42859-816e-4b7f-8467-8a80b61328e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:39.921478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a42859-816e-4b7f-8467-8a80b61328e7 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:39.922189 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a42859-816e-4b7f-8467-8a80b61328e7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:39.922496 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a42859-816e-4b7f-8467-8a80b61328e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:39.923948 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a42859-816e-4b7f-8467-8a80b61328e7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:39.929769 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:39.929930 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 518/1036] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:39.935588 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a42859-816e-4b7f-8467-8a80b61328e7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:39.939722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:40.021011 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee572f7-4a81-44bc-8085-83e3ca999b2a None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:40.049986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a42859-816e-4b7f-8467-8a80b61328e7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:40.057615 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a18d1-90a1-4db4-ae87-15023e6bb270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:40.058546 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a18d1-90a1-4db4-ae87-15023e6bb270 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:40.059114 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a18d1-90a1-4db4-ae87-15023e6bb270 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:40.059634 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a18d1-90a1-4db4-ae87-15023e6bb270 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:40.060809 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a18d1-90a1-4db4-ae87-15023e6bb270 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:40.061325 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a18d1-90a1-4db4-ae87-15023e6bb270 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:40.063126 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a18d1-90a1-4db4-ae87-15023e6bb270 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:40.082956 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 519/1037] 10.222.0.41 () {56 vars in 1133 bytes} [Fri May 27 16:21:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:40.088211 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a18d1-90a1-4db4-ae87-15023e6bb270 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:40.089093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273c0e7-fbdb-414f-bdf0-67cef0fcdd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:40.089769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273c0e7-fbdb-414f-bdf0-67cef0fcdd8b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:40.090051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273c0e7-fbdb-414f-bdf0-67cef0fcdd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:40.090327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4273c0e7-fbdb-414f-bdf0-67cef0fcdd8b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:40.091122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273c0e7-fbdb-414f-bdf0-67cef0fcdd8b None admin] RBAC: Adding query filter params (interface=public, service_id=18bd265af6a44086a427d6ad565fc16e, region_id=RegionOne) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:40.091430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273c0e7-fbdb-414f-bdf0-67cef0fcdd8b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:40.092863 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4273c0e7-fbdb-414f-bdf0-67cef0fcdd8b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:40.099336 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 519/1038] 10.222.0.41 () {56 vars in 1251 bytes} [Fri May 27 16:21:39 2022] GET /identity/v3/endpoints?service_id=18bd265af6a44086a427d6ad565fc16e&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:40.104844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273c0e7-fbdb-414f-bdf0-67cef0fcdd8b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:40.173912 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:40.185809 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:40.203127 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a18d1-90a1-4db4-ae87-15023e6bb270 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:40.227073 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4273c0e7-fbdb-414f-bdf0-67cef0fcdd8b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:40.247428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec215c-4ca0-4176-af78-f463e56c9297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:40.248120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec215c-4ca0-4176-af78-f463e56c9297 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:40.248403 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec215c-4ca0-4176-af78-f463e56c9297 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:40.248679 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec215c-4ca0-4176-af78-f463e56c9297 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:40.262500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81209ba6-3611-4fd7-a750-7d61c31e04b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:40.263177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81209ba6-3611-4fd7-a750-7d61c31e04b2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:40.263456 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81209ba6-3611-4fd7-a750-7d61c31e04b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:40.263761 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81209ba6-3611-4fd7-a750-7d61c31e04b2 None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:40.264552 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81209ba6-3611-4fd7-a750-7d61c31e04b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:40.265939 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81209ba6-3611-4fd7-a750-7d61c31e04b2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:40.273455 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 520/1039] 10.222.0.41 () {56 vars in 1087 bytes} [Fri May 27 16:21:40 2022] GET /identity/v3/services => generated 1957 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:21:40.314152 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7b565-a198-4d6b-afd7-250f086c7b26 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:40.314501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7b565-a198-4d6b-afd7-250f086c7b26 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:40.314722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7b565-a198-4d6b-afd7-250f086c7b26 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:40.317169 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 521/1040] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:21:40.322950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01126a-ddef-4432-8bc1-e378021413f6 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:40.323240 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01126a-ddef-4432-8bc1-e378021413f6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:40.323519 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01126a-ddef-4432-8bc1-e378021413f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:40.343709 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec215c-4ca0-4176-af78-f463e56c9297 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:40.343934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3d01126a-ddef-4432-8bc1-e378021413f6 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:40.345416 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec215c-4ca0-4176-af78-f463e56c9297 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:40.345535 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3d01126a-ddef-4432-8bc1-e378021413f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:40.433715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 522/1041] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:21:40.445683 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:40.457773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01126a-ddef-4432-8bc1-e378021413f6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:40.478848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 520/1042] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:21:40 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:21:40.485075 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec215c-4ca0-4176-af78-f463e56c9297 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:40.530791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:40.582869 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01126a-ddef-4432-8bc1-e378021413f6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:40.611797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec215c-4ca0-4176-af78-f463e56c9297 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:40.619265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521bf59-64af-4c85-831e-624f3182f774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:40.620135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521bf59-64af-4c85-831e-624f3182f774 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:40.620511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521bf59-64af-4c85-831e-624f3182f774 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:40.620793 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521bf59-64af-4c85-831e-624f3182f774 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:40.632490 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521bf59-64af-4c85-831e-624f3182f774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:21:40.640251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-c521bf59-64af-4c85-831e-624f3182f774 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:21:40.640251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:40.640251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:40.640251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:40.640251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:40.640251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:40.640251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:40.640251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:40.640251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:40.640251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:40.640251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:40.640251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:40.640251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:21:40.640251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:21:40.640251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:21:40.640251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:21:40.641454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:21:40.641454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:21:40.641454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:21:40.641454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:21:40.641454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:40.641454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:40.641454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:40.641454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:40.641454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:40.641454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:40.641454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:40.641454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:40.641454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:40.641454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:40.641454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:40.641454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:40.642699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:40.642699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:40.642699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:40.642699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:40.642699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:21:40.642699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:21:40.642699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:21:40.642699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:21:40.642699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:21:40.642699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:21:40.642699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:21:40.642699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:40.642699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 523/1043] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:21:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:21:40.647502 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521bf59-64af-4c85-831e-624f3182f774 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:40.653939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20736984-39e3-4d65-99df-a44f883871e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:40.654770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20736984-39e3-4d65-99df-a44f883871e8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:40.655047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20736984-39e3-4d65-99df-a44f883871e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:40.655313 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20736984-39e3-4d65-99df-a44f883871e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:40.666456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20736984-39e3-4d65-99df-a44f883871e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:40.667935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20736984-39e3-4d65-99df-a44f883871e8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:40.690600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-20736984-39e3-4d65-99df-a44f883871e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:40.690600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:40.690600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:40.690600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:40.690600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:40.690600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:40.690600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:40.690600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:40.690600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:40.690600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:40.690600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:40.690600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:40.690600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:40.690600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:40.690600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:40.692372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:40.692372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:40.692372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:40.692372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:40.692372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:40.692372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:40.692372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:40.692372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:40.692372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:40.692372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:40.692372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:40.692372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:40.692372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:40.692372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:40.692372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:40.692372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:40.692372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:40.694065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:40.694065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:40.694065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:40.694065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:40.694065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 521/1044] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:40.697292 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20736984-39e3-4d65-99df-a44f883871e8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:40.729409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:40.771747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521bf59-64af-4c85-831e-624f3182f774 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:40.794372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:40.807930 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20736984-39e3-4d65-99df-a44f883871e8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:40.809613 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652aac8-5954-4116-beda-860d7e5df353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:40.810315 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652aac8-5954-4116-beda-860d7e5df353 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:40.810631 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652aac8-5954-4116-beda-860d7e5df353 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:40.810857 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652aac8-5954-4116-beda-860d7e5df353 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:40.811534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652aac8-5954-4116-beda-860d7e5df353 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:40.812565 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652aac8-5954-4116-beda-860d7e5df353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:40.813283 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652aac8-5954-4116-beda-860d7e5df353 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:40.827455 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 524/1045] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:21:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:40.828644 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652aac8-5954-4116-beda-860d7e5df353 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:40.862126 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dda15-e878-4d35-84d5-06c66dcd05d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:40.863118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dda15-e878-4d35-84d5-06c66dcd05d3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:40.863540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dda15-e878-4d35-84d5-06c66dcd05d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:40.863817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dda15-e878-4d35-84d5-06c66dcd05d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:40.864682 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dda15-e878-4d35-84d5-06c66dcd05d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:40.864987 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dda15-e878-4d35-84d5-06c66dcd05d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:40.866414 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dda15-e878-4d35-84d5-06c66dcd05d3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:40.883463 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 522/1046] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:40.888882 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dda15-e878-4d35-84d5-06c66dcd05d3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:40.943262 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652aac8-5954-4116-beda-860d7e5df353 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:40.982485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:40.984088 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1484f-de91-4534-9e39-3e09227678bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:40.984977 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1484f-de91-4534-9e39-3e09227678bc None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:40.985619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1484f-de91-4534-9e39-3e09227678bc None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:40.985619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1484f-de91-4534-9e39-3e09227678bc None admin] PATH_INFO: `/v3/users/82c8567075cd4e68873626e92e224bea` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:40.999086 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dda15-e878-4d35-84d5-06c66dcd05d3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:41.003585 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1484f-de91-4534-9e39-3e09227678bc None admin] RBAC: Authorizing `identity:get_user(user_id=82c8567075cd4e68873626e92e224bea)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:41.005116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1484f-de91-4534-9e39-3e09227678bc None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:41.011580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 525/1047] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:21:40 2022] GET /identity/v3/users/82c8567075cd4e68873626e92e224bea => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:41.012621 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1484f-de91-4534-9e39-3e09227678bc None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:41.043578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66719712-f528-46c3-8a46-2139f167be40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:41.044419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66719712-f528-46c3-8a46-2139f167be40 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:41.044704 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66719712-f528-46c3-8a46-2139f167be40 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:41.044970 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66719712-f528-46c3-8a46-2139f167be40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:41.051811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66719712-f528-46c3-8a46-2139f167be40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:41.053309 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66719712-f528-46c3-8a46-2139f167be40 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:41.059758 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:41.068230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-66719712-f528-46c3-8a46-2139f167be40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:41.068230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:41.068230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:41.068230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:41.068230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:41.068230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:41.068230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:41.068230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:41.068230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:41.068230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:41.068230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:41.068230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:41.068230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:21:41.068230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:21:41.068230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:21:41.069210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:21:41.069210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:41.069210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:41.069210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:41.069210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:41.069210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:41.069210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:41.069210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:41.069210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:41.069210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:41.069210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:41.069210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:41.069210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:41.069210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:41.069210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:41.069210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:41.069210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:41.070147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:21:41.070147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:21:41.070147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:21:41.070147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:21:41.070147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:21:41.070147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:21:41.070147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:41.070147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:41.070147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 523/1048] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:21:41.075555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66719712-f528-46c3-8a46-2139f167be40 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:41.132838 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1484f-de91-4534-9e39-3e09227678bc None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:41.179532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a553ab-ca38-4935-9c2b-0d1f30d85793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:41.181090 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a553ab-ca38-4935-9c2b-0d1f30d85793 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:41.181991 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a553ab-ca38-4935-9c2b-0d1f30d85793 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:41.182405 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a553ab-ca38-4935-9c2b-0d1f30d85793 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:41.201247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66719712-f528-46c3-8a46-2139f167be40 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:41.236786 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6d8e9-e8ba-49db-bdd9-4fa0286a1c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:41.237449 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6d8e9-e8ba-49db-bdd9-4fa0286a1c4e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:41.237728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6d8e9-e8ba-49db-bdd9-4fa0286a1c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:41.237998 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6d8e9-e8ba-49db-bdd9-4fa0286a1c4e None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:41.238777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6d8e9-e8ba-49db-bdd9-4fa0286a1c4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:41.239084 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6d8e9-e8ba-49db-bdd9-4fa0286a1c4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:41.240569 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6d8e9-e8ba-49db-bdd9-4fa0286a1c4e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:41.253012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 524/1049] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:21:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:41.258954 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6d8e9-e8ba-49db-bdd9-4fa0286a1c4e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:41.267875 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a553ab-ca38-4935-9c2b-0d1f30d85793 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:41.269364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:41.269488 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a553ab-ca38-4935-9c2b-0d1f30d85793 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:41.318030 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:41.374563 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6d8e9-e8ba-49db-bdd9-4fa0286a1c4e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:41.380608 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 526/1050] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:21:41 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:21:41.386265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a553ab-ca38-4935-9c2b-0d1f30d85793 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:41.423491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d5102-fdbe-40b6-9fa7-62a0a8a90e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:41.424205 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d5102-fdbe-40b6-9fa7-62a0a8a90e87 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:41.424489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d5102-fdbe-40b6-9fa7-62a0a8a90e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:41.424848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d5102-fdbe-40b6-9fa7-62a0a8a90e87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:41.425763 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d5102-fdbe-40b6-9fa7-62a0a8a90e87 None admin] RBAC: Adding query filter params (role.id=a4f4043359b042a9abe4f0ace9620258, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=3caa3dbc7bd24ebba28296a1eba9cefe) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:41.426073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d5102-fdbe-40b6-9fa7-62a0a8a90e87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:41.427555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d5102-fdbe-40b6-9fa7-62a0a8a90e87 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:41.434618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 525/1051] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:21:41 2022] GET /identity/v3/role_assignments?user.id=3caa3dbc7bd24ebba28296a1eba9cefe&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=a4f4043359b042a9abe4f0ace9620258 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:41.511323 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a553ab-ca38-4935-9c2b-0d1f30d85793 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:41.550234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf7200-d7a4-4db2-933a-f66d428c33c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:41.551128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf7200-d7a4-4db2-933a-f66d428c33c9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:41.551408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf7200-d7a4-4db2-933a-f66d428c33c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:41.551685 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf7200-d7a4-4db2-933a-f66d428c33c9 None admin] PATH_INFO: `/v3/projects/ef99706ff3b842eba047e182de96b858` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:41.552986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf7200-d7a4-4db2-933a-f66d428c33c9 None admin] RBAC: Authorizing `identity:get_project(project_id=ef99706ff3b842eba047e182de96b858)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:41.554477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf7200-d7a4-4db2-933a-f66d428c33c9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:41.556282 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 527/1052] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:21:41 2022] GET /identity/v3/projects/ef99706ff3b842eba047e182de96b858 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:41.562650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d5102-fdbe-40b6-9fa7-62a0a8a90e87 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:41.646892 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:41.679680 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d5102-fdbe-40b6-9fa7-62a0a8a90e87 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:41.714154 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e1935-a7af-4a52-ba22-be8bd1ad6b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:41.714816 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e1935-a7af-4a52-ba22-be8bd1ad6b8c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:41.715094 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e1935-a7af-4a52-ba22-be8bd1ad6b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:41.715368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e1935-a7af-4a52-ba22-be8bd1ad6b8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:41.716221 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e1935-a7af-4a52-ba22-be8bd1ad6b8c None admin] RBAC: Adding query filter params (role.id=e1e39192d3af465aa504728e32ab7cd2, scope.project.id=ef99706ff3b842eba047e182de96b858, user.id=82c8567075cd4e68873626e92e224bea) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:41.716525 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e1935-a7af-4a52-ba22-be8bd1ad6b8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:41.717984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e1935-a7af-4a52-ba22-be8bd1ad6b8c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:41.724224 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 526/1053] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:21:41 2022] GET /identity/v3/role_assignments?user.id=82c8567075cd4e68873626e92e224bea&scope.project.id=ef99706ff3b842eba047e182de96b858&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:42.517150 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940c9bc-c7ce-46f4-a2a2-f95868632316 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:42.518227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940c9bc-c7ce-46f4-a2a2-f95868632316 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:42.518227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940c9bc-c7ce-46f4-a2a2-f95868632316 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:42.519234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 528/1054] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:42.524459 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb36148-d856-49c5-919e-acef0208fe82 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:42.524914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb36148-d856-49c5-919e-acef0208fe82 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:42.524999 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb36148-d856-49c5-919e-acef0208fe82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:42.542710 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5cb36148-d856-49c5-919e-acef0208fe82 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:42.543805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5cb36148-d856-49c5-919e-acef0208fe82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:42.615848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 527/1055] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:42.638131 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940c9bc-c7ce-46f4-a2a2-f95868632316 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:42.649689 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:42.748332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940c9bc-c7ce-46f4-a2a2-f95868632316 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:42.783661 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74b0c2-90bf-451a-a8ac-34adbc794138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:42.784529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74b0c2-90bf-451a-a8ac-34adbc794138 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:42.784811 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74b0c2-90bf-451a-a8ac-34adbc794138 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:42.785070 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74b0c2-90bf-451a-a8ac-34adbc794138 None admin] PATH_INFO: `/v3/services/image` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:42.785718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc74b0c2-90bf-451a-a8ac-34adbc794138 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:42.787116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc74b0c2-90bf-451a-a8ac-34adbc794138 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:42.799691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-cc74b0c2-90bf-451a-a8ac-34adbc794138 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 16:21:42.799691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:42.799691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:21:42.799691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:21:42.799691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:21:42.799691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:21:42.799691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:21:42.799691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:42.799691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 16:21:42.799691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:42.799691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:21:42.799691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:42.799691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:42.799691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:42.799691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:42.799691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:42.799691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:42.800866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:42.800866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:42.800866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:42.800866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:42.800866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:42.800866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:42.800866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:21:42.800866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:21:42.800866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:21:42.800866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:21:42.800866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:42.800866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:42.800866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:42.800866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:42.800866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:42.800866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:42.801862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:42.801862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:42.801862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:42.801862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:42.801862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:42.801862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:42.801862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:42.801862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:42.801862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:42.801862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:42.801862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:21:42.801862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:21:42.801862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 16:21:42.801862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:42.801862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 529/1056] 10.222.0.41 () {56 vars in 1105 bytes} [Fri May 27 16:21:42 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:42.809418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb36148-d856-49c5-919e-acef0208fe82 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:42.907725 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:42.968797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb36148-d856-49c5-919e-acef0208fe82 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:43.006708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdba80e-3b32-4605-b8f9-f55473481ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:43.007382 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdba80e-3b32-4605-b8f9-f55473481ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:43.007668 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdba80e-3b32-4605-b8f9-f55473481ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:43.007930 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdba80e-3b32-4605-b8f9-f55473481ce8 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:43.008725 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdba80e-3b32-4605-b8f9-f55473481ce8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:43.009031 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdba80e-3b32-4605-b8f9-f55473481ce8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:43.010470 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdba80e-3b32-4605-b8f9-f55473481ce8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:43.016072 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 528/1057] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:43.021913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74b0c2-90bf-451a-a8ac-34adbc794138 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:43.098895 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:43.134137 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74b0c2-90bf-451a-a8ac-34adbc794138 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:43.167995 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea34b770-87a3-4d6f-be4c-3a3075ca7eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:43.168688 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34b770-87a3-4d6f-be4c-3a3075ca7eda None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:43.168962 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34b770-87a3-4d6f-be4c-3a3075ca7eda None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:43.169248 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea34b770-87a3-4d6f-be4c-3a3075ca7eda None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:43.169959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34b770-87a3-4d6f-be4c-3a3075ca7eda None admin] RBAC: Adding query filter params (type=image) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:43.170252 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34b770-87a3-4d6f-be4c-3a3075ca7eda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:43.171642 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea34b770-87a3-4d6f-be4c-3a3075ca7eda None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:43.177099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 530/1058] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:43.182744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdba80e-3b32-4605-b8f9-f55473481ce8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:43.295860 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdba80e-3b32-4605-b8f9-f55473481ce8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:43.323538 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:43.333230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ca2e8-e301-4c90-a374-57a213bbd968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:43.333907 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ca2e8-e301-4c90-a374-57a213bbd968 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:43.334191 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ca2e8-e301-4c90-a374-57a213bbd968 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:43.334466 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ca2e8-e301-4c90-a374-57a213bbd968 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:43.335221 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ca2e8-e301-4c90-a374-57a213bbd968 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:43.336648 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ca2e8-e301-4c90-a374-57a213bbd968 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:43.357421 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 529/1059] 10.222.0.41 () {60 vars in 1144 bytes} [Fri May 27 16:21:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:21:43.662346 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0ffe2-114a-44e8-ad3c-cc414fbcda4f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:43.662907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0ffe2-114a-44e8-ad3c-cc414fbcda4f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:43.662907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0ffe2-114a-44e8-ad3c-cc414fbcda4f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:43.664315 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 531/1060] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:43.670142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc7062-c60c-4167-9b31-32b483c54a40 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:43.670595 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc7062-c60c-4167-9b31-32b483c54a40 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:43.670695 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc7062-c60c-4167-9b31-32b483c54a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:43.688179 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a8dc7062-c60c-4167-9b31-32b483c54a40 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:43.689514 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a8dc7062-c60c-4167-9b31-32b483c54a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:43.770251 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 530/1061] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:43.793231 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0ffe2-114a-44e8-ad3c-cc414fbcda4f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:43.909334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0ffe2-114a-44e8-ad3c-cc414fbcda4f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:43.937471 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2aa5e-f723-40d5-8714-9230788533b5 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:43.937766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2aa5e-f723-40d5-8714-9230788533b5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:43.938028 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2aa5e-f723-40d5-8714-9230788533b5 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:43.939630 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 531/1062] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:21:43.945586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2305466-0c09-42df-9f55-bf2bc0ef51f1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:43.945902 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2305466-0c09-42df-9f55-bf2bc0ef51f1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:43.946211 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2305466-0c09-42df-9f55-bf2bc0ef51f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:43.946333 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5587a-f488-4365-8232-c909a723db35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:43.947119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5587a-f488-4365-8232-c909a723db35 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:43.947401 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5587a-f488-4365-8232-c909a723db35 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:43.947677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5587a-f488-4365-8232-c909a723db35 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:43.950963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:43.960886 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5587a-f488-4365-8232-c909a723db35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:21:43.965635 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e2305466-0c09-42df-9f55-bf2bc0ef51f1 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:43.966830 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e2305466-0c09-42df-9f55-bf2bc0ef51f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:43.970321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-50a5587a-f488-4365-8232-c909a723db35 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:21:43.970321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:43.970321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:43.970321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:43.970321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:43.970321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:43.970321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:43.970321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:43.970321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:43.970321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:43.970321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:43.970321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:43.970321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:21:43.970321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:21:43.970321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:21:43.970321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:21:43.971347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:21:43.971347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:21:43.971347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:21:43.971347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:21:43.971347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:43.971347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:43.971347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:43.971347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:43.971347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:43.971347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:43.971347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:43.971347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:43.971347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:43.971347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:43.971347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:43.971347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:43.972281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:43.972281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:43.972281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:43.972281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:43.972281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:21:43.972281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:21:43.972281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:21:43.972281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:21:43.972281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:21:43.972281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:21:43.972281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:21:43.972281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:43.972281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 532/1063] 10.222.0.41 () {56 vars in 1120 bytes} [Fri May 27 16:21:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:43.977615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5587a-f488-4365-8232-c909a723db35 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:44.048085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 532/1064] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:44.071009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2305466-0c09-42df-9f55-bf2bc0ef51f1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:44.080734 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5587a-f488-4365-8232-c909a723db35 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:44.127613 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:44.130062 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f753f5-6512-4310-bcca-e64993c4a75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:44.130751 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f753f5-6512-4310-bcca-e64993c4a75b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:44.131034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f753f5-6512-4310-bcca-e64993c4a75b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:44.131308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f753f5-6512-4310-bcca-e64993c4a75b None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:44.132093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f753f5-6512-4310-bcca-e64993c4a75b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:44.132406 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f753f5-6512-4310-bcca-e64993c4a75b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:44.133819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f753f5-6512-4310-bcca-e64993c4a75b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:44.143168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 533/1065] 10.222.0.41 () {56 vars in 1115 bytes} [Fri May 27 16:21:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:44.148870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f753f5-6512-4310-bcca-e64993c4a75b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:44.202354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2305466-0c09-42df-9f55-bf2bc0ef51f1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:44.217630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:44.247583 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640713fd-8b78-4811-b7cb-8a2642b3d3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:44.248648 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640713fd-8b78-4811-b7cb-8a2642b3d3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:44.248836 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640713fd-8b78-4811-b7cb-8a2642b3d3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:44.249099 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640713fd-8b78-4811-b7cb-8a2642b3d3f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:44.261942 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640713fd-8b78-4811-b7cb-8a2642b3d3f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:21:44.270612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-640713fd-8b78-4811-b7cb-8a2642b3d3f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:21:44.270612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:44.270612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:44.270612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:44.270612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:44.270612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:44.270612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:44.270612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:44.270612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:44.270612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:44.270612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:44.270612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:44.270612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:21:44.270612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:21:44.270612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:21:44.270612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:21:44.271777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:21:44.271777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:21:44.271777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:21:44.271777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:21:44.271777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:44.271777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:44.271777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:44.271777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:44.271777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:44.271777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:44.271777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:44.271777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:44.271777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:44.271777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:44.271777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:44.271777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:44.272708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:44.272708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:44.272708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:44.272708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:44.272708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:21:44.272708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:21:44.272708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:21:44.272708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:21:44.272708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:21:44.272708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:21:44.272708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:21:44.272708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:44.272708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 533/1066] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:21:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:21:44.277516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f753f5-6512-4310-bcca-e64993c4a75b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:44.277886 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640713fd-8b78-4811-b7cb-8a2642b3d3f3 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:44.316550 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2d154-19f6-4c57-a29f-5fe021a9cd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:44.317354 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2d154-19f6-4c57-a29f-5fe021a9cd6f None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:44.317632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2d154-19f6-4c57-a29f-5fe021a9cd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:44.317896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2d154-19f6-4c57-a29f-5fe021a9cd6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:44.329920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2d154-19f6-4c57-a29f-5fe021a9cd6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:44.331391 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2d154-19f6-4c57-a29f-5fe021a9cd6f None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:44.349935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f2f2d154-19f6-4c57-a29f-5fe021a9cd6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:44.349935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:44.349935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:44.349935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:44.349935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:44.349935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:44.349935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:44.349935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:44.349935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:44.349935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:44.349935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:44.349935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:44.349935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:44.349935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:44.349935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:44.351003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:44.351003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:44.351003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:44.351003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:44.351003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:44.351003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:44.351003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:44.351003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:44.351003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:44.351003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:44.351003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:44.351003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:44.351003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:44.351003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:44.351003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:44.351003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:44.351003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:44.351915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:44.351915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:44.351915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:44.351915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:44.351915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 534/1067] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:44.356905 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2d154-19f6-4c57-a29f-5fe021a9cd6f None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:44.387116 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:44.390760 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640713fd-8b78-4811-b7cb-8a2642b3d3f3 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:44.428517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee8c52-0920-431f-992f-8b04a0fa6aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:44.429185 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee8c52-0920-431f-992f-8b04a0fa6aff None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:44.429458 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee8c52-0920-431f-992f-8b04a0fa6aff None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:44.429729 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee8c52-0920-431f-992f-8b04a0fa6aff None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:44.430471 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee8c52-0920-431f-992f-8b04a0fa6aff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:44.430769 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee8c52-0920-431f-992f-8b04a0fa6aff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:44.432184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee8c52-0920-431f-992f-8b04a0fa6aff None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:44.445698 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 534/1068] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:21:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:44.446747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee8c52-0920-431f-992f-8b04a0fa6aff None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:44.469213 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2d154-19f6-4c57-a29f-5fe021a9cd6f None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:44.480838 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:44.507688 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49658486-967b-4cbd-b0f2-18b555afcd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:44.508381 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49658486-967b-4cbd-b0f2-18b555afcd44 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:44.508658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49658486-967b-4cbd-b0f2-18b555afcd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:44.508925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49658486-967b-4cbd-b0f2-18b555afcd44 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:44.509640 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49658486-967b-4cbd-b0f2-18b555afcd44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:44.509942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49658486-967b-4cbd-b0f2-18b555afcd44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:44.511330 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49658486-967b-4cbd-b0f2-18b555afcd44 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:44.523629 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 535/1069] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:44.529076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49658486-967b-4cbd-b0f2-18b555afcd44 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:44.569666 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee8c52-0920-431f-992f-8b04a0fa6aff None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:44.607640 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb62889-43cd-4cf5-90cf-ad430a3d5134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:44.608561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb62889-43cd-4cf5-90cf-ad430a3d5134 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:44.608838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb62889-43cd-4cf5-90cf-ad430a3d5134 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:44.609109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb62889-43cd-4cf5-90cf-ad430a3d5134 None admin] PATH_INFO: `/v3/users/82c8567075cd4e68873626e92e224bea` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:44.610676 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb62889-43cd-4cf5-90cf-ad430a3d5134 None admin] RBAC: Authorizing `identity:get_user(user_id=82c8567075cd4e68873626e92e224bea)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:44.611852 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb62889-43cd-4cf5-90cf-ad430a3d5134 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:44.618140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 535/1070] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:21:44 2022] GET /identity/v3/users/82c8567075cd4e68873626e92e224bea => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:44.619186 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb62889-43cd-4cf5-90cf-ad430a3d5134 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:44.640772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49658486-967b-4cbd-b0f2-18b555afcd44 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:44.652941 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:44.679257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fbe13-2af6-408c-a1f5-abc1c9a83473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:44.680097 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fbe13-2af6-408c-a1f5-abc1c9a83473 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:44.680373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fbe13-2af6-408c-a1f5-abc1c9a83473 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:44.680646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fbe13-2af6-408c-a1f5-abc1c9a83473 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:44.687931 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fbe13-2af6-408c-a1f5-abc1c9a83473 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:44.689478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fbe13-2af6-408c-a1f5-abc1c9a83473 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:44.703845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-6e9fbe13-2af6-408c-a1f5-abc1c9a83473 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 16:21:44.703845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:44.703845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:44.703845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:44.703845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:44.703845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:44.703845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:44.703845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:44.703845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:44.703845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:44.703845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:44.703845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:44.703845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:21:44.703845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:21:44.703845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:21:44.703845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:21:44.705243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:44.705243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:44.705243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:21:44.705243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:44.705243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:21:44.705243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:44.705243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:44.705243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:44.705243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:44.705243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:44.705243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:44.705243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:44.705243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:44.705243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:44.705243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:44.705243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:44.705243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:44.705243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:44.706343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:44.706343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:44.706343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:21:44.706343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:21:44.706343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:21:44.706343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:21:44.706343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:21:44.706343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:21:44.706343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 16:21:44.706343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:44.706343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 536/1071] 10.222.0.41 () {56 vars in 1093 bytes} [Fri May 27 16:21:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:44.711411 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fbe13-2af6-408c-a1f5-abc1c9a83473 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:44.732764 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb62889-43cd-4cf5-90cf-ad430a3d5134 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:44.743991 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:44.768560 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610e552-63a3-41e9-a245-170549d2759c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:44.769433 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610e552-63a3-41e9-a245-170549d2759c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:44.769709 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610e552-63a3-41e9-a245-170549d2759c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:44.769975 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610e552-63a3-41e9-a245-170549d2759c None admin] PATH_INFO: `/v3/projects/ef99706ff3b842eba047e182de96b858` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:44.771151 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610e552-63a3-41e9-a245-170549d2759c None admin] RBAC: Authorizing `identity:get_project(project_id=ef99706ff3b842eba047e182de96b858)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:44.772641 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610e552-63a3-41e9-a245-170549d2759c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:44.779321 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 536/1072] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:21:44 2022] GET /identity/v3/projects/ef99706ff3b842eba047e182de96b858 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:44.780234 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610e552-63a3-41e9-a245-170549d2759c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:44.824466 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fbe13-2af6-408c-a1f5-abc1c9a83473 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:44.861626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb601be-8b0c-41ae-bdf9-7d269bbf8a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:44.862316 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb601be-8b0c-41ae-bdf9-7d269bbf8a4e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:44.862604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb601be-8b0c-41ae-bdf9-7d269bbf8a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:44.862879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb601be-8b0c-41ae-bdf9-7d269bbf8a4e None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:44.863721 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb601be-8b0c-41ae-bdf9-7d269bbf8a4e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:44.864058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb601be-8b0c-41ae-bdf9-7d269bbf8a4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:44.865522 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb601be-8b0c-41ae-bdf9-7d269bbf8a4e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:44.880437 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:44.885190 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 537/1073] 10.222.0.41 () {56 vars in 1133 bytes} [Fri May 27 16:21:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:44.886414 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610e552-63a3-41e9-a245-170549d2759c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:44.891061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb601be-8b0c-41ae-bdf9-7d269bbf8a4e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:44.922819 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6663ae-5b16-424d-827f-ff114ed929c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:44.923861 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6663ae-5b16-424d-827f-ff114ed929c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:44.924183 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6663ae-5b16-424d-827f-ff114ed929c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:44.924465 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6663ae-5b16-424d-827f-ff114ed929c8 None admin] PATH_INFO: `/v3/projects/ef99706ff3b842eba047e182de96b858/users/82c8567075cd4e68873626e92e224bea/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:44.927048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6663ae-5b16-424d-827f-ff114ed929c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef99706ff3b842eba047e182de96b858, user_id=82c8567075cd4e68873626e92e224bea, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:44.928554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6663ae-5b16-424d-827f-ff114ed929c8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:44.943259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 537/1074] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:21:44 2022] PUT /identity/v3/projects/ef99706ff3b842eba047e182de96b858/users/82c8567075cd4e68873626e92e224bea/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:21:44.992300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:45.006332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb601be-8b0c-41ae-bdf9-7d269bbf8a4e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:45.044593 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98641edf-0b07-44a9-a096-99d42751807b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:45.045412 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98641edf-0b07-44a9-a096-99d42751807b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:45.045697 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98641edf-0b07-44a9-a096-99d42751807b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:45.045972 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98641edf-0b07-44a9-a096-99d42751807b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:45.057831 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98641edf-0b07-44a9-a096-99d42751807b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:45.059391 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98641edf-0b07-44a9-a096-99d42751807b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:45.078602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-98641edf-0b07-44a9-a096-99d42751807b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:45.078602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:45.078602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:45.078602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:45.078602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:45.078602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:45.078602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:45.078602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:45.078602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:45.078602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:45.078602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:45.078602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:45.078602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:45.078602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:45.078602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:45.080539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:45.080539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:45.080539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:45.080539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:45.080539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:45.080539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:45.080539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:45.080539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:45.080539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:45.080539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:45.080539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:45.080539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:45.080539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:45.080539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:45.080539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:45.080539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:45.080539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:45.081801 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:45.081801 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:45.081801 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:45.081801 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:45.084460 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 538/1075] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:45.086337 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6663ae-5b16-424d-827f-ff114ed929c8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:45.203645 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6663ae-5b16-424d-827f-ff114ed929c8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:45.240663 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a182e-a772-408a-8bbb-8976f33c69bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:45.241345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a182e-a772-408a-8bbb-8976f33c69bd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:45.241623 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a182e-a772-408a-8bbb-8976f33c69bd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:45.241903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a182e-a772-408a-8bbb-8976f33c69bd None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:45.242704 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a182e-a772-408a-8bbb-8976f33c69bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:45.242938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a182e-a772-408a-8bbb-8976f33c69bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:45.244382 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a182e-a772-408a-8bbb-8976f33c69bd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:45.261578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 538/1076] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:45.262807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98641edf-0b07-44a9-a096-99d42751807b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:45.372680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98641edf-0b07-44a9-a096-99d42751807b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:45.411569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5171dc-d1a1-43b8-bf5d-716636b8e7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:45.412448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5171dc-d1a1-43b8-bf5d-716636b8e7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:45.412711 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5171dc-d1a1-43b8-bf5d-716636b8e7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:45.413003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5171dc-d1a1-43b8-bf5d-716636b8e7b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:45.421401 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5171dc-d1a1-43b8-bf5d-716636b8e7b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:45.423028 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5171dc-d1a1-43b8-bf5d-716636b8e7b2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:45.426336 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:45.440203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-7c5171dc-d1a1-43b8-bf5d-716636b8e7b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:45.440203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:45.440203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:45.440203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:45.440203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:45.440203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:45.440203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:45.440203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:45.440203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:45.440203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:45.440203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:45.440203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:45.440203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:21:45.440203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:21:45.440203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:21:45.441369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:21:45.441369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:45.441369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:45.441369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:45.441369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:45.441369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:45.441369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:45.441369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:45.441369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:45.441369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:45.441369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:45.441369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:45.441369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:45.441369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:45.441369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:45.441369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:45.441369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:45.442324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:21:45.442324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:21:45.442324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:21:45.442324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:21:45.442324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:21:45.442324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:21:45.442324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:45.442324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:45.442324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 539/1077] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:21:45.449476 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a182e-a772-408a-8bbb-8976f33c69bd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:45.476374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:45.563037 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a182e-a772-408a-8bbb-8976f33c69bd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:45.601246 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda5c4b-6d18-4274-a93f-7ad6e84a79ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:45.602290 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda5c4b-6d18-4274-a93f-7ad6e84a79ef None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:45.602798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda5c4b-6d18-4274-a93f-7ad6e84a79ef None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:45.603276 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda5c4b-6d18-4274-a93f-7ad6e84a79ef None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:45.604290 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda5c4b-6d18-4274-a93f-7ad6e84a79ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:45.604791 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda5c4b-6d18-4274-a93f-7ad6e84a79ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:45.606449 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda5c4b-6d18-4274-a93f-7ad6e84a79ef None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:45.609901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eefb89-4aa7-41d8-bf5a-a72058a15f6c None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:45.610073 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eefb89-4aa7-41d8-bf5a-a72058a15f6c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:45.610306 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eefb89-4aa7-41d8-bf5a-a72058a15f6c None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:45.612050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 540/1078] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:21:45.617128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d20d0-3865-462b-bdbf-6153ae61fa33 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:45.617413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d20d0-3865-462b-bdbf-6153ae61fa33 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:45.617687 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d20d0-3865-462b-bdbf-6153ae61fa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:45.621465 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 539/1079] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:21:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:45.627341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda5c4b-6d18-4274-a93f-7ad6e84a79ef None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:45.640897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-131d20d0-3865-462b-bdbf-6153ae61fa33 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:45.642270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-131d20d0-3865-462b-bdbf-6153ae61fa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:45.709754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:45.728131 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 541/1080] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:45.732254 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda5c4b-6d18-4274-a93f-7ad6e84a79ef None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:45.744513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d20d0-3865-462b-bdbf-6153ae61fa33 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:45.766641 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7203bfc-b368-4156-ae67-9f64069a0987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:45.767558 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7203bfc-b368-4156-ae67-9f64069a0987 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:45.767836 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7203bfc-b368-4156-ae67-9f64069a0987 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:45.768133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7203bfc-b368-4156-ae67-9f64069a0987 None admin] PATH_INFO: `/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/3caa3dbc7bd24ebba28296a1eba9cefe/roles/a4f4043359b042a9abe4f0ace9620258` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:45.770342 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7203bfc-b368-4156-ae67-9f64069a0987 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5c551b621342e5a5a6e742d673d525, user_id=3caa3dbc7bd24ebba28296a1eba9cefe, role_id=a4f4043359b042a9abe4f0ace9620258)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:45.771798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7203bfc-b368-4156-ae67-9f64069a0987 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:45.788677 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 540/1081] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:21:45 2022] PUT /identity/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/3caa3dbc7bd24ebba28296a1eba9cefe/roles/a4f4043359b042a9abe4f0ace9620258 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:21:45.872770 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d20d0-3865-462b-bdbf-6153ae61fa33 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:45.906632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:45.913945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5526d67-61aa-4695-992a-a9101523751e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:45.914616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5526d67-61aa-4695-992a-a9101523751e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:45.914900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5526d67-61aa-4695-992a-a9101523751e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:45.915174 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5526d67-61aa-4695-992a-a9101523751e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:45.997097 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5526d67-61aa-4695-992a-a9101523751e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:45.998589 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5526d67-61aa-4695-992a-a9101523751e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:46.104114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 542/1082] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:21:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 16:21:46.109848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7203bfc-b368-4156-ae67-9f64069a0987 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:46.277804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7203bfc-b368-4156-ae67-9f64069a0987 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:46.336400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8702508-61d5-4ed0-a8ef-21f75c8a227f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:46.337772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8702508-61d5-4ed0-a8ef-21f75c8a227f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:46.338269 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8702508-61d5-4ed0-a8ef-21f75c8a227f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:46.338757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8702508-61d5-4ed0-a8ef-21f75c8a227f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:46.354022 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:46.360390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8702508-61d5-4ed0-a8ef-21f75c8a227f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:46.363573 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8702508-61d5-4ed0-a8ef-21f75c8a227f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:46.397425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-f8702508-61d5-4ed0-a8ef-21f75c8a227f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:46.397425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:46.397425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:46.397425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:46.397425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:46.397425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:46.397425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:46.397425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:46.397425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:46.397425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:46.397425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:46.397425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:46.397425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:46.397425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:46.397425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:46.398530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:46.398530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:46.398530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:46.398530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:46.398530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:46.398530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:46.398530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:46.398530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:46.398530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:46.398530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:46.398530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:46.398530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:46.398530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:46.398530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:46.398530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:46.398530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:46.398530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:46.399492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:46.399492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:46.399492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:46.399492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:46.404326 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 541/1083] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:46.406348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5526d67-61aa-4695-992a-a9101523751e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:46.439375 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:46.514353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5526d67-61aa-4695-992a-a9101523751e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:46.555865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b840a-4bfd-458b-955e-095248605e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:46.556478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b840a-4bfd-458b-955e-095248605e6d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:46.556757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b840a-4bfd-458b-955e-095248605e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:46.557032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b840a-4bfd-458b-955e-095248605e6d None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:46.557771 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b840a-4bfd-458b-955e-095248605e6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:46.558077 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b840a-4bfd-458b-955e-095248605e6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:46.559476 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b840a-4bfd-458b-955e-095248605e6d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:46.574761 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 543/1084] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:47.289854 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e266b37-9aa2-4493-a1e0-8a5d40b924a2 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:47.290225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e266b37-9aa2-4493-a1e0-8a5d40b924a2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:47.290225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e266b37-9aa2-4493-a1e0-8a5d40b924a2 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:47.291790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 542/1085] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:47.297432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca8b8e-e206-4b53-8f4f-0d2c55a533fe None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:47.297981 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca8b8e-e206-4b53-8f4f-0d2c55a533fe None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:47.298077 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca8b8e-e206-4b53-8f4f-0d2c55a533fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:47.316748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-00ca8b8e-e206-4b53-8f4f-0d2c55a533fe None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:47.317949 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-00ca8b8e-e206-4b53-8f4f-0d2c55a533fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:47.388875 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 544/1086] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:47.412791 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e266b37-9aa2-4493-a1e0-8a5d40b924a2 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:47.527385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e266b37-9aa2-4493-a1e0-8a5d40b924a2 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:47.564270 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ea787-eb85-4480-b49f-b12eee49cba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:47.564668 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ea787-eb85-4480-b49f-b12eee49cba8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:47.564950 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ea787-eb85-4480-b49f-b12eee49cba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:47.565228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ea787-eb85-4480-b49f-b12eee49cba8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:47.575641 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ea787-eb85-4480-b49f-b12eee49cba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:21:47.584359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-963ea787-eb85-4480-b49f-b12eee49cba8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:21:47.584359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:47.584359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:47.584359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:47.584359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:47.584359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:47.584359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:47.584359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:47.584359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:47.584359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:47.584359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:47.584359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:47.584359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:21:47.584359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:21:47.584359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:21:47.584359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:21:47.585364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:21:47.585364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:21:47.585364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:21:47.585364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:21:47.585364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:47.585364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:47.585364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:47.585364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:47.585364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:47.585364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:47.585364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:47.585364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:47.585364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:47.585364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:47.585364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:47.585364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:47.586255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:47.586255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:47.586255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:47.586255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:47.586255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:21:47.586255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:21:47.586255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:21:47.586255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:21:47.586255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:21:47.586255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:21:47.586255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:21:47.586255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:47.586255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 543/1087] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:21:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:47.591673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca8b8e-e206-4b53-8f4f-0d2c55a533fe None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:47.613765 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:47.709596 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca8b8e-e206-4b53-8f4f-0d2c55a533fe None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:47.747203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab745c7b-8f33-4041-8dad-e317db31e157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:47.747880 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab745c7b-8f33-4041-8dad-e317db31e157 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:47.748193 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab745c7b-8f33-4041-8dad-e317db31e157 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:47.748464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab745c7b-8f33-4041-8dad-e317db31e157 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:47.749212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab745c7b-8f33-4041-8dad-e317db31e157 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:47.749516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab745c7b-8f33-4041-8dad-e317db31e157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:47.750932 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab745c7b-8f33-4041-8dad-e317db31e157 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:47.760601 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 545/1088] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:21:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:47.766264 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ea787-eb85-4480-b49f-b12eee49cba8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:47.825393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:47.880409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ea787-eb85-4480-b49f-b12eee49cba8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:47.914865 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f1822-97d1-44fa-9b29-d442689cc14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:47.915747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f1822-97d1-44fa-9b29-d442689cc14b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:47.916037 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f1822-97d1-44fa-9b29-d442689cc14b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:47.916332 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f1822-97d1-44fa-9b29-d442689cc14b None admin] PATH_INFO: `/v3/users/82c8567075cd4e68873626e92e224bea` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:47.917523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f1822-97d1-44fa-9b29-d442689cc14b None admin] RBAC: Authorizing `identity:get_user(user_id=82c8567075cd4e68873626e92e224bea)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:47.918992 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f1822-97d1-44fa-9b29-d442689cc14b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:47.920690 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 544/1089] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:21:47 2022] GET /identity/v3/users/82c8567075cd4e68873626e92e224bea => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:47.926552 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab745c7b-8f33-4041-8dad-e317db31e157 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:48.010795 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:48.011441 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379979-804c-4b78-b846-6b56a6d64da1 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:48.011735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379979-804c-4b78-b846-6b56a6d64da1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:48.012090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379979-804c-4b78-b846-6b56a6d64da1 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:48.013866 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 545/1090] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:48.019925 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415af45-a6b7-4902-a5c6-626da6a4a025 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:48.020464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415af45-a6b7-4902-a5c6-626da6a4a025 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:48.020737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415af45-a6b7-4902-a5c6-626da6a4a025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:48.030608 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab745c7b-8f33-4041-8dad-e317db31e157 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:48.037739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8415af45-a6b7-4902-a5c6-626da6a4a025 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:48.038934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8415af45-a6b7-4902-a5c6-626da6a4a025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:48.065208 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7737324-5c9d-47d4-85e7-ecfad21d0bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:48.065855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7737324-5c9d-47d4-85e7-ecfad21d0bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:48.066132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7737324-5c9d-47d4-85e7-ecfad21d0bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:48.066408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7737324-5c9d-47d4-85e7-ecfad21d0bd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:48.106781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 546/1091] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:21:48.130459 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415af45-a6b7-4902-a5c6-626da6a4a025 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:48.135144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7737324-5c9d-47d4-85e7-ecfad21d0bd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:48.136632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7737324-5c9d-47d4-85e7-ecfad21d0bd2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:48.178728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:48.219603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:48.231919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415af45-a6b7-4902-a5c6-626da6a4a025 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:48.243969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 546/1092] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:21:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:21:48.245223 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7737324-5c9d-47d4-85e7-ecfad21d0bd2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:48.273830 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeab19-952b-4823-a267-9f34edded7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:48.274663 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeab19-952b-4823-a267-9f34edded7fb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:48.274946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeab19-952b-4823-a267-9f34edded7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:48.275224 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeab19-952b-4823-a267-9f34edded7fb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:48.285860 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edeab19-952b-4823-a267-9f34edded7fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:21:48.294146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-4edeab19-952b-4823-a267-9f34edded7fb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:21:48.294146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:48.294146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:48.294146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:48.294146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:48.294146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:48.294146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:48.294146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:48.294146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:48.294146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:48.294146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:48.294146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:48.294146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:21:48.294146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:21:48.294146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:21:48.294146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:21:48.295578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:21:48.295578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:21:48.295578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:21:48.295578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:21:48.295578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:48.295578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:48.295578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:48.295578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:48.295578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:48.295578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:48.295578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:48.295578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:48.295578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:48.295578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:48.295578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:48.295578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:48.296728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:48.296728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:48.296728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:48.296728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:48.296728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:21:48.296728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:21:48.296728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:21:48.296728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:21:48.296728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:21:48.296728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:21:48.296728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 16:21:48.296728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:48.300460 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 547/1093] 10.222.0.41 () {56 vars in 1120 bytes} [Fri May 27 16:21:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:21:48.301528 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeab19-952b-4823-a267-9f34edded7fb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:48.346363 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7737324-5c9d-47d4-85e7-ecfad21d0bd2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:48.382192 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cdc1e-8f80-4a3b-b2a1-d602e1d36806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:48.382979 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cdc1e-8f80-4a3b-b2a1-d602e1d36806 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:48.383335 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cdc1e-8f80-4a3b-b2a1-d602e1d36806 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:48.383611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cdc1e-8f80-4a3b-b2a1-d602e1d36806 None admin] PATH_INFO: `/v3/projects/ef99706ff3b842eba047e182de96b858` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:48.384899 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cdc1e-8f80-4a3b-b2a1-d602e1d36806 None admin] RBAC: Authorizing `identity:get_project(project_id=ef99706ff3b842eba047e182de96b858)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:48.386365 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cdc1e-8f80-4a3b-b2a1-d602e1d36806 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:48.388095 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 547/1094] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:21:48 2022] GET /identity/v3/projects/ef99706ff3b842eba047e182de96b858 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:48.394484 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cdc1e-8f80-4a3b-b2a1-d602e1d36806 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:48.404402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeab19-952b-4823-a267-9f34edded7fb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:48.413372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:48.439633 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0dea0-e4cb-4d73-b6d6-83edc79530c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:48.440888 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0dea0-e4cb-4d73-b6d6-83edc79530c4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:48.440888 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0dea0-e4cb-4d73-b6d6-83edc79530c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:48.440888 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0dea0-e4cb-4d73-b6d6-83edc79530c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:48.441612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0dea0-e4cb-4d73-b6d6-83edc79530c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:48.441981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0dea0-e4cb-4d73-b6d6-83edc79530c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:48.443326 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0dea0-e4cb-4d73-b6d6-83edc79530c4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:48.445873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:48.451720 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 548/1095] 10.222.0.41 () {56 vars in 1115 bytes} [Fri May 27 16:21:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:48.457897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0dea0-e4cb-4d73-b6d6-83edc79530c4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:48.499207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cdc1e-8f80-4a3b-b2a1-d602e1d36806 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:48.535719 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e89e3-2aa6-4cf8-a504-9b443b6b7b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:48.536400 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e89e3-2aa6-4cf8-a504-9b443b6b7b73 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:48.536682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e89e3-2aa6-4cf8-a504-9b443b6b7b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:48.536977 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e89e3-2aa6-4cf8-a504-9b443b6b7b73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:48.537831 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e89e3-2aa6-4cf8-a504-9b443b6b7b73 None admin] RBAC: Adding query filter params (role.id=e1e39192d3af465aa504728e32ab7cd2, scope.project.id=ef99706ff3b842eba047e182de96b858, user.id=82c8567075cd4e68873626e92e224bea) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:48.538130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e89e3-2aa6-4cf8-a504-9b443b6b7b73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:48.539583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e89e3-2aa6-4cf8-a504-9b443b6b7b73 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:48.545798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 548/1096] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:21:48 2022] GET /identity/v3/role_assignments?user.id=82c8567075cd4e68873626e92e224bea&scope.project.id=ef99706ff3b842eba047e182de96b858&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:48.560471 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0dea0-e4cb-4d73-b6d6-83edc79530c4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:48.600733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9482850-7059-454c-87ee-4de6f053e152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:48.601545 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9482850-7059-454c-87ee-4de6f053e152 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:48.601826 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9482850-7059-454c-87ee-4de6f053e152 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:48.602100 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9482850-7059-454c-87ee-4de6f053e152 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:48.615277 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9482850-7059-454c-87ee-4de6f053e152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:48.616840 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9482850-7059-454c-87ee-4de6f053e152 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:48.636553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-d9482850-7059-454c-87ee-4de6f053e152 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:48.636553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:48.636553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:48.636553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:48.636553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:48.636553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:48.636553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:48.636553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:48.636553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:48.636553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:48.636553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:48.636553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:48.636553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:48.636553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:48.636553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:48.637577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:48.637577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:48.637577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:48.637577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:48.637577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:48.637577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:48.637577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:48.637577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:48.637577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:48.637577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:48.637577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:48.637577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:48.637577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:48.637577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:48.637577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:48.637577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:48.637577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:48.638520 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:48.638520 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:48.638520 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:48.638520 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:48.638520 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 549/1097] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:48.644959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e89e3-2aa6-4cf8-a504-9b443b6b7b73 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:48.756333 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e89e3-2aa6-4cf8-a504-9b443b6b7b73 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:48.770837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:48.792638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2fb00-b796-469e-90cc-cdbcad0244a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:48.793313 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2fb00-b796-469e-90cc-cdbcad0244a5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:48.793594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2fb00-b796-469e-90cc-cdbcad0244a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:48.793875 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2fb00-b796-469e-90cc-cdbcad0244a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:48.794601 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2fb00-b796-469e-90cc-cdbcad0244a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:48.794910 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2fb00-b796-469e-90cc-cdbcad0244a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:48.796314 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2fb00-b796-469e-90cc-cdbcad0244a5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:48.808416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 549/1098] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:48.814172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9482850-7059-454c-87ee-4de6f053e152 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:48.840680 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:48.924228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9482850-7059-454c-87ee-4de6f053e152 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:48.964628 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3933ea-dcc6-4bf0-8e33-bb5f14b564ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:48.965435 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3933ea-dcc6-4bf0-8e33-bb5f14b564ca None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:48.965712 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3933ea-dcc6-4bf0-8e33-bb5f14b564ca None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:48.965950 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3933ea-dcc6-4bf0-8e33-bb5f14b564ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:48.975188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3933ea-dcc6-4bf0-8e33-bb5f14b564ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:48.976698 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3933ea-dcc6-4bf0-8e33-bb5f14b564ca None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:48.991505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-7c3933ea-dcc6-4bf0-8e33-bb5f14b564ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 16:21:48.991505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:48.991505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:48.991505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:48.991505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:48.991505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:48.991505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:48.991505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:48.991505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:48.991505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:48.991505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:48.991505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:48.991505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:21:48.991505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:21:48.991505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:21:48.991505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:21:48.992939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:48.992939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:48.992939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:21:48.992939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:48.992939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:21:48.992939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:21:48.992939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:48.992939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:48.992939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:48.992939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:48.992939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:48.992939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:21:48.992939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:48.992939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:48.992939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:48.992939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:48.992939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:48.992939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:48.994918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:48.994918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:48.994918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:21:48.994918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:21:48.994918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:21:48.994918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:21:48.994918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:21:48.994918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:21:48.994918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 16:21:48.994918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:21:48.994918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 550/1099] 10.222.0.41 () {56 vars in 1093 bytes} [Fri May 27 16:21:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:48.998770 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2fb00-b796-469e-90cc-cdbcad0244a5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:49.104793 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2fb00-b796-469e-90cc-cdbcad0244a5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:49.142722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75534487-2b8d-4f8a-9253-e9b2ca268cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:49.143392 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75534487-2b8d-4f8a-9253-e9b2ca268cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:49.143677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75534487-2b8d-4f8a-9253-e9b2ca268cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:49.143952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75534487-2b8d-4f8a-9253-e9b2ca268cf5 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:49.144822 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75534487-2b8d-4f8a-9253-e9b2ca268cf5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:49.145273 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75534487-2b8d-4f8a-9253-e9b2ca268cf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:49.146584 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75534487-2b8d-4f8a-9253-e9b2ca268cf5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:49.164887 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 550/1100] 10.222.0.41 () {56 vars in 1133 bytes} [Fri May 27 16:21:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:21:49.170726 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3933ea-dcc6-4bf0-8e33-bb5f14b564ca None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:49.256774 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:49.276379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3933ea-dcc6-4bf0-8e33-bb5f14b564ca None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:49.313621 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f2bbf-b7d9-4ff8-a696-7747c4a19ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:49.314628 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f2bbf-b7d9-4ff8-a696-7747c4a19ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:49.314628 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f2bbf-b7d9-4ff8-a696-7747c4a19ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:49.314838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f2bbf-b7d9-4ff8-a696-7747c4a19ef5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:49.384997 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f2bbf-b7d9-4ff8-a696-7747c4a19ef5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:49.386491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f2bbf-b7d9-4ff8-a696-7747c4a19ef5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:49.468757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:49.488100 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 551/1101] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:21:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:21:49.494257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75534487-2b8d-4f8a-9253-e9b2ca268cf5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:49.527013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:49.596878 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75534487-2b8d-4f8a-9253-e9b2ca268cf5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:49.631728 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee7dc4-2ade-495d-bd14-9f728c10f34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:49.632553 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee7dc4-2ade-495d-bd14-9f728c10f34a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:49.632836 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee7dc4-2ade-495d-bd14-9f728c10f34a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:49.633109 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee7dc4-2ade-495d-bd14-9f728c10f34a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:49.643524 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee7dc4-2ade-495d-bd14-9f728c10f34a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:49.645006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee7dc4-2ade-495d-bd14-9f728c10f34a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:49.662173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-b3ee7dc4-2ade-495d-bd14-9f728c10f34a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:49.662173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:49.662173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:49.662173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:49.662173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:49.662173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:49.662173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:49.662173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:49.662173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:49.662173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:49.662173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:49.662173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:49.662173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:21:49.662173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:21:49.662173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:21:49.663130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:21:49.663130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:49.663130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:49.663130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:49.663130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:49.663130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:49.663130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:49.663130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:49.663130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:49.663130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:49.663130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:49.663130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:49.663130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:49.663130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:49.663130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:49.663130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:49.663130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:49.664258 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:21:49.664258 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:21:49.664258 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:21:49.664258 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:49.664258 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 551/1102] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:49.669286 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f2bbf-b7d9-4ff8-a696-7747c4a19ef5 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:49.777688 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f2bbf-b7d9-4ff8-a696-7747c4a19ef5 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:49.814288 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de54f25-927c-42a5-a417-5e60b9b11de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:49.814953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de54f25-927c-42a5-a417-5e60b9b11de1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:49.815241 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de54f25-927c-42a5-a417-5e60b9b11de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:49.815516 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de54f25-927c-42a5-a417-5e60b9b11de1 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:49.816260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de54f25-927c-42a5-a417-5e60b9b11de1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:49.816568 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de54f25-927c-42a5-a417-5e60b9b11de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:49.817973 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de54f25-927c-42a5-a417-5e60b9b11de1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:49.831297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 552/1103] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:49.837037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee7dc4-2ade-495d-bd14-9f728c10f34a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:49.926710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:49.944652 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee7dc4-2ade-495d-bd14-9f728c10f34a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:49.979569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42ef2c-872f-40ad-9286-724cf4339eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:49.980402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42ef2c-872f-40ad-9286-724cf4339eed None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:49.980688 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42ef2c-872f-40ad-9286-724cf4339eed None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:49.980963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42ef2c-872f-40ad-9286-724cf4339eed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:49.987987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42ef2c-872f-40ad-9286-724cf4339eed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:49.989486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42ef2c-872f-40ad-9286-724cf4339eed None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:50.003270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-6a42ef2c-872f-40ad-9286-724cf4339eed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:50.003270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:21:50.003270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:21:50.003270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:21:50.003270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:21:50.003270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:21:50.003270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:21:50.003270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:21:50.003270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:21:50.003270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:21:50.003270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:21:50.003270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:21:50.003270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:21:50.003270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:21:50.003270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:21:50.004337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:21:50.004337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:21:50.004337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:21:50.004337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:21:50.004337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:21:50.004337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:21:50.004337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:21:50.004337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:21:50.004337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:21:50.004337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:21:50.004337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:21:50.004337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:21:50.004337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:21:50.004337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:21:50.004337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:21:50.004337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:21:50.004337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:21:50.005265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:21:50.005265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:21:50.005265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:21:50.005265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:21:50.005265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:21:50.005265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:21:50.005265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:21:50.005265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:21:50.005265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 552/1104] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:21:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:21:50.010507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de54f25-927c-42a5-a417-5e60b9b11de1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:50.059659 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:50.119742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de54f25-927c-42a5-a417-5e60b9b11de1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:50.157810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0359f-fef8-4bc4-9389-e9787c57550b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:50.158809 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0359f-fef8-4bc4-9389-e9787c57550b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:50.159300 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0359f-fef8-4bc4-9389-e9787c57550b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:50.159790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0359f-fef8-4bc4-9389-e9787c57550b None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:50.161359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0359f-fef8-4bc4-9389-e9787c57550b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:50.161946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0359f-fef8-4bc4-9389-e9787c57550b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:50.164573 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0359f-fef8-4bc4-9389-e9787c57550b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:50.193274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 553/1105] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:21:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:50.194651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42ef2c-872f-40ad-9286-724cf4339eed None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:50.302476 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42ef2c-872f-40ad-9286-724cf4339eed None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:50.338320 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df145a4-19a1-4a5b-b7a4-c54bf4202484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:50.338879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df145a4-19a1-4a5b-b7a4-c54bf4202484 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:50.339163 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df145a4-19a1-4a5b-b7a4-c54bf4202484 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:50.339435 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df145a4-19a1-4a5b-b7a4-c54bf4202484 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:50.340275 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df145a4-19a1-4a5b-b7a4-c54bf4202484 None admin] RBAC: Adding query filter params (role.id=a4f4043359b042a9abe4f0ace9620258, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=3caa3dbc7bd24ebba28296a1eba9cefe) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:50.340575 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df145a4-19a1-4a5b-b7a4-c54bf4202484 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:50.342032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df145a4-19a1-4a5b-b7a4-c54bf4202484 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:50.349071 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 553/1106] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:21:50 2022] GET /identity/v3/role_assignments?user.id=3caa3dbc7bd24ebba28296a1eba9cefe&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=a4f4043359b042a9abe4f0ace9620258 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:50.792923 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3bc0f-b1d0-43a0-94b4-4c2a1444c25c None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:50.793466 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3bc0f-b1d0-43a0-94b4-4c2a1444c25c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:50.793466 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3bc0f-b1d0-43a0-94b4-4c2a1444c25c None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:50.794818 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 554/1107] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:50.800781 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bec11-6e6d-47fc-9f38-cf07181291ed None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:50.801265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bec11-6e6d-47fc-9f38-cf07181291ed None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:50.801353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bec11-6e6d-47fc-9f38-cf07181291ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:50.823000 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1b9bec11-6e6d-47fc-9f38-cf07181291ed None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:50.824271 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1b9bec11-6e6d-47fc-9f38-cf07181291ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:50.826321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:50.899025 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 554/1108] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:50.924566 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3bc0f-b1d0-43a0-94b4-4c2a1444c25c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:51.035024 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3bc0f-b1d0-43a0-94b4-4c2a1444c25c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:51.036679 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:51.070941 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e08fe-7c37-44a9-8372-484d76a276da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:51.071660 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e08fe-7c37-44a9-8372-484d76a276da None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:51.071933 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e08fe-7c37-44a9-8372-484d76a276da None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:51.072230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e08fe-7c37-44a9-8372-484d76a276da None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:51.073419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e08fe-7c37-44a9-8372-484d76a276da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:51.074869 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e08fe-7c37-44a9-8372-484d76a276da None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:51.076574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 555/1109] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:21:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:51.083202 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bec11-6e6d-47fc-9f38-cf07181291ed None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:51.205544 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bec11-6e6d-47fc-9f38-cf07181291ed None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:51.247732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61787f41-f92d-4746-82db-f6b2895d655b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:51.248467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61787f41-f92d-4746-82db-f6b2895d655b None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:51.248751 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61787f41-f92d-4746-82db-f6b2895d655b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:51.249041 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61787f41-f92d-4746-82db-f6b2895d655b None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:51.249793 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61787f41-f92d-4746-82db-f6b2895d655b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:51.251291 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61787f41-f92d-4746-82db-f6b2895d655b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:51.261044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:51.276193 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 555/1110] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 16:21:51 2022] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:21:53.524601 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50364c0-5f8d-4273-a324-07cf0badc117 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:53.525440 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50364c0-5f8d-4273-a324-07cf0badc117 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:53.525440 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50364c0-5f8d-4273-a324-07cf0badc117 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:53.527493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 556/1111] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:53.533755 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dd806-2465-4271-8102-61d184a3bdbd None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:53.534193 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dd806-2465-4271-8102-61d184a3bdbd None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:53.534333 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958dd806-2465-4271-8102-61d184a3bdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:53.556803 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-958dd806-2465-4271-8102-61d184a3bdbd None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:53.557928 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-958dd806-2465-4271-8102-61d184a3bdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:53.628436 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 556/1112] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:53.658094 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50364c0-5f8d-4273-a324-07cf0badc117 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:53.766584 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50364c0-5f8d-4273-a324-07cf0badc117 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:53.803788 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d5d7d-aff3-4cdb-9167-e4771933c63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:53.804679 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d5d7d-aff3-4cdb-9167-e4771933c63c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:53.804959 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d5d7d-aff3-4cdb-9167-e4771933c63c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:53.805238 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d5d7d-aff3-4cdb-9167-e4771933c63c None admin] PATH_INFO: `/v3/roles/60519d06a8c94e6c82462e5d79d9856b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:53.806901 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d5d7d-aff3-4cdb-9167-e4771933c63c None admin] RBAC: Authorizing `identity:get_role(role_id=60519d06a8c94e6c82462e5d79d9856b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:53.808278 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d5d7d-aff3-4cdb-9167-e4771933c63c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:53.809674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 557/1113] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:21:53 2022] GET /identity/v3/roles/60519d06a8c94e6c82462e5d79d9856b => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:53.816306 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958dd806-2465-4271-8102-61d184a3bdbd None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:53.941598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958dd806-2465-4271-8102-61d184a3bdbd None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:53.969711 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:53.982298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a574690-1e84-4fb2-b4d8-d142b0de1a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:53.983188 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a574690-1e84-4fb2-b4d8-d142b0de1a5b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:53.983470 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a574690-1e84-4fb2-b4d8-d142b0de1a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:53.983747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a574690-1e84-4fb2-b4d8-d142b0de1a5b None admin] PATH_INFO: `/v3/users/56e7faa3a777485c8427412eaa17fed3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:53.997407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a574690-1e84-4fb2-b4d8-d142b0de1a5b None admin] RBAC: Authorizing `identity:get_user(user_id=56e7faa3a777485c8427412eaa17fed3)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:53.998883 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a574690-1e84-4fb2-b4d8-d142b0de1a5b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:54.000603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 557/1114] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:21:53 2022] GET /identity/v3/users/56e7faa3a777485c8427412eaa17fed3 => generated 286 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:54.006888 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d5d7d-aff3-4cdb-9167-e4771933c63c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:54.059474 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:54.123489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d5d7d-aff3-4cdb-9167-e4771933c63c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:54.163481 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbe06a-9d6c-49d3-9d5c-8b36bb4e6e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:54.164155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbe06a-9d6c-49d3-9d5c-8b36bb4e6e78 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:54.164444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbe06a-9d6c-49d3-9d5c-8b36bb4e6e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:54.164711 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfbe06a-9d6c-49d3-9d5c-8b36bb4e6e78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:54.237758 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbe06a-9d6c-49d3-9d5c-8b36bb4e6e78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:54.239244 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfbe06a-9d6c-49d3-9d5c-8b36bb4e6e78 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:54.279298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:54.347724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 558/1115] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:21:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:21:54.353798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a574690-1e84-4fb2-b4d8-d142b0de1a5b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:54.466835 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a574690-1e84-4fb2-b4d8-d142b0de1a5b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:54.509265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e2a09-50a9-4c0f-a81d-c4de4dd53d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:54.510178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e2a09-50a9-4c0f-a81d-c4de4dd53d1b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:54.510475 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e2a09-50a9-4c0f-a81d-c4de4dd53d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:54.510733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e2a09-50a9-4c0f-a81d-c4de4dd53d1b None admin] PATH_INFO: `/v3/projects/ef99706ff3b842eba047e182de96b858` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:54.511972 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e2a09-50a9-4c0f-a81d-c4de4dd53d1b None admin] RBAC: Authorizing `identity:get_project(project_id=ef99706ff3b842eba047e182de96b858)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:54.513458 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e2a09-50a9-4c0f-a81d-c4de4dd53d1b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:54.515213 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 558/1116] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:21:54 2022] GET /identity/v3/projects/ef99706ff3b842eba047e182de96b858 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:54.521883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbe06a-9d6c-49d3-9d5c-8b36bb4e6e78 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:54.633438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfbe06a-9d6c-49d3-9d5c-8b36bb4e6e78 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:54.667160 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74eeb0e-b464-49f6-953c-258ee1712986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:54.667819 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eeb0e-b464-49f6-953c-258ee1712986 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:54.668122 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eeb0e-b464-49f6-953c-258ee1712986 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:54.668402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74eeb0e-b464-49f6-953c-258ee1712986 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:54.669223 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74eeb0e-b464-49f6-953c-258ee1712986 None admin] RBAC: Adding query filter params (role.id=60519d06a8c94e6c82462e5d79d9856b, scope.project.id=ef99706ff3b842eba047e182de96b858, user.id=56e7faa3a777485c8427412eaa17fed3) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:21:54.669536 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74eeb0e-b464-49f6-953c-258ee1712986 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:54.671011 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74eeb0e-b464-49f6-953c-258ee1712986 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:54.676688 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 559/1117] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:21:54 2022] GET /identity/v3/role_assignments?user.id=56e7faa3a777485c8427412eaa17fed3&scope.project.id=ef99706ff3b842eba047e182de96b858&role.id=60519d06a8c94e6c82462e5d79d9856b => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:56.853538 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f97b6-03fc-490a-9b84-fb172776bb59 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:56.854152 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f97b6-03fc-490a-9b84-fb172776bb59 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:56.854152 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f97b6-03fc-490a-9b84-fb172776bb59 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:56.855460 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 559/1118] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:56.861377 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8a62a-568a-4c1e-a376-40ee8bf1244b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:56.862017 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8a62a-568a-4c1e-a376-40ee8bf1244b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:56.862017 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8a62a-568a-4c1e-a376-40ee8bf1244b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:56.867401 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:56.882160 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b0b8a62a-568a-4c1e-a376-40ee8bf1244b None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:56.883375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b0b8a62a-568a-4c1e-a376-40ee8bf1244b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:56.966597 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 560/1119] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:21:56.989780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f97b6-03fc-490a-9b84-fb172776bb59 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:57.050310 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:57.104002 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f97b6-03fc-490a-9b84-fb172776bb59 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:57.141107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8d6a7-8338-47ed-bcaa-d40f7ede446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:57.142208 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8d6a7-8338-47ed-bcaa-d40f7ede446a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:57.142563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8d6a7-8338-47ed-bcaa-d40f7ede446a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:57.142840 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8d6a7-8338-47ed-bcaa-d40f7ede446a None admin] PATH_INFO: `/v3/roles/60519d06a8c94e6c82462e5d79d9856b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:57.144441 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8d6a7-8338-47ed-bcaa-d40f7ede446a None admin] RBAC: Authorizing `identity:get_role(role_id=60519d06a8c94e6c82462e5d79d9856b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:57.145867 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8d6a7-8338-47ed-bcaa-d40f7ede446a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:57.147298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 560/1120] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:21:56 2022] GET /identity/v3/roles/60519d06a8c94e6c82462e5d79d9856b => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:57.153741 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8a62a-568a-4c1e-a376-40ee8bf1244b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:57.263769 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8a62a-568a-4c1e-a376-40ee8bf1244b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:57.295189 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:57.301033 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b785227-de91-4708-b27b-9b60719a67fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:57.301930 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b785227-de91-4708-b27b-9b60719a67fa None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:57.302229 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b785227-de91-4708-b27b-9b60719a67fa None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:57.302499 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b785227-de91-4708-b27b-9b60719a67fa None admin] PATH_INFO: `/v3/users/56e7faa3a777485c8427412eaa17fed3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:57.303771 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b785227-de91-4708-b27b-9b60719a67fa None admin] RBAC: Authorizing `identity:get_user(user_id=56e7faa3a777485c8427412eaa17fed3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:57.305289 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b785227-de91-4708-b27b-9b60719a67fa None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:57.306953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 561/1121] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:21:57 2022] GET /identity/v3/users/56e7faa3a777485c8427412eaa17fed3 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:57.313209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8d6a7-8338-47ed-bcaa-d40f7ede446a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:57.417303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8d6a7-8338-47ed-bcaa-d40f7ede446a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:57.435973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:57.457354 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b07b0-b11a-4584-a017-81eb47db3618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:57.458293 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b07b0-b11a-4584-a017-81eb47db3618 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:57.458576 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b07b0-b11a-4584-a017-81eb47db3618 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:57.458887 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b07b0-b11a-4584-a017-81eb47db3618 None admin] PATH_INFO: `/v3/projects/ef99706ff3b842eba047e182de96b858` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:57.460342 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b07b0-b11a-4584-a017-81eb47db3618 None admin] RBAC: Authorizing `identity:get_project(project_id=ef99706ff3b842eba047e182de96b858)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:57.462006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b07b0-b11a-4584-a017-81eb47db3618 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:57.464068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 561/1122] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:21:57 2022] GET /identity/v3/projects/ef99706ff3b842eba047e182de96b858 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:21:57.470492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b785227-de91-4708-b27b-9b60719a67fa None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:21:57.576669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b785227-de91-4708-b27b-9b60719a67fa None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:21:57.611314 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8a148-0671-4f45-92e4-133ca4e4585f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:21:57.612250 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8a148-0671-4f45-92e4-133ca4e4585f None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:57.612528 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8a148-0671-4f45-92e4-133ca4e4585f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:57.612803 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8a148-0671-4f45-92e4-133ca4e4585f None admin] PATH_INFO: `/v3/projects/ef99706ff3b842eba047e182de96b858/users/56e7faa3a777485c8427412eaa17fed3/roles/60519d06a8c94e6c82462e5d79d9856b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:57.615062 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8a148-0671-4f45-92e4-133ca4e4585f None admin] RBAC: Authorizing `identity:create_grant(project_id=ef99706ff3b842eba047e182de96b858, user_id=56e7faa3a777485c8427412eaa17fed3, role_id=60519d06a8c94e6c82462e5d79d9856b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:21:57.616568 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8a148-0671-4f45-92e4-133ca4e4585f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:21:57.631963 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 562/1123] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:21:57 2022] PUT /identity/v3/projects/ef99706ff3b842eba047e182de96b858/users/56e7faa3a777485c8427412eaa17fed3/roles/60519d06a8c94e6c82462e5d79d9856b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:21:59.830931 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53a824-d525-40fe-a3df-bf7b18120bf0 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:59.831803 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53a824-d525-40fe-a3df-bf7b18120bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:59.831803 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53a824-d525-40fe-a3df-bf7b18120bf0 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:59.834503 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 562/1124] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:21:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:21:59.840274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c70278-5d17-4c1f-89a9-cb9294aa806d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:21:59.840724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c70278-5d17-4c1f-89a9-cb9294aa806d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:21:59.840838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c70278-5d17-4c1f-89a9-cb9294aa806d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:21:59.859847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-80c70278-5d17-4c1f-89a9-cb9294aa806d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:21:59.861209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-80c70278-5d17-4c1f-89a9-cb9294aa806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:21:59.920485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:21:59.932945 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 563/1125] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:21:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:21:59.965241 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53a824-d525-40fe-a3df-bf7b18120bf0 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:00.090768 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53a824-d525-40fe-a3df-bf7b18120bf0 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:00.129742 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68de12-744b-4b5c-907d-edadb12226d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:00.130585 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68de12-744b-4b5c-907d-edadb12226d7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:00.130867 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68de12-744b-4b5c-907d-edadb12226d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:00.131142 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68de12-744b-4b5c-907d-edadb12226d7 None admin] PATH_INFO: `/v3/roles/60519d06a8c94e6c82462e5d79d9856b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:00.132704 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68de12-744b-4b5c-907d-edadb12226d7 None admin] RBAC: Authorizing `identity:get_role(role_id=60519d06a8c94e6c82462e5d79d9856b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:00.134096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68de12-744b-4b5c-907d-edadb12226d7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:00.135592 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 563/1126] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:21:59 2022] GET /identity/v3/roles/60519d06a8c94e6c82462e5d79d9856b => generated 223 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:00.141946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c70278-5d17-4c1f-89a9-cb9294aa806d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:00.254291 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c70278-5d17-4c1f-89a9-cb9294aa806d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:00.293523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b02b69-1901-4500-9ea4-6bb2d1d6ef6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:00.294412 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b02b69-1901-4500-9ea4-6bb2d1d6ef6c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:00.294685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b02b69-1901-4500-9ea4-6bb2d1d6ef6c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:00.294954 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b02b69-1901-4500-9ea4-6bb2d1d6ef6c None admin] PATH_INFO: `/v3/users/56e7faa3a777485c8427412eaa17fed3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:00.296296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b02b69-1901-4500-9ea4-6bb2d1d6ef6c None admin] RBAC: Authorizing `identity:get_user(user_id=56e7faa3a777485c8427412eaa17fed3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:00.297857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b02b69-1901-4500-9ea4-6bb2d1d6ef6c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:00.299506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 564/1127] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:22:00 2022] GET /identity/v3/users/56e7faa3a777485c8427412eaa17fed3 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:00.308760 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68de12-744b-4b5c-907d-edadb12226d7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:00.376464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:00.427688 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68de12-744b-4b5c-907d-edadb12226d7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:00.472408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0632dd2-c9d8-4567-8228-10343e73dca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:00.473529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0632dd2-c9d8-4567-8228-10343e73dca4 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:00.474033 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0632dd2-c9d8-4567-8228-10343e73dca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:00.474538 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0632dd2-c9d8-4567-8228-10343e73dca4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:00.552610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0632dd2-c9d8-4567-8228-10343e73dca4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:00.554111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0632dd2-c9d8-4567-8228-10343e73dca4 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:00.613376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:00.669109 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 564/1128] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:22:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:22:00.675561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b02b69-1901-4500-9ea4-6bb2d1d6ef6c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:00.740152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:00.786588 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b02b69-1901-4500-9ea4-6bb2d1d6ef6c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:00.827303 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7bd3a-b467-414d-86b4-86beb7ccdf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:00.828208 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7bd3a-b467-414d-86b4-86beb7ccdf23 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:00.828517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7bd3a-b467-414d-86b4-86beb7ccdf23 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:00.829447 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7bd3a-b467-414d-86b4-86beb7ccdf23 None admin] PATH_INFO: `/v3/projects/ef99706ff3b842eba047e182de96b858` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:00.830712 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7bd3a-b467-414d-86b4-86beb7ccdf23 None admin] RBAC: Authorizing `identity:get_project(project_id=ef99706ff3b842eba047e182de96b858)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:00.832224 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7bd3a-b467-414d-86b4-86beb7ccdf23 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:00.833941 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 565/1129] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:22:00 2022] GET /identity/v3/projects/ef99706ff3b842eba047e182de96b858 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:00.840354 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0632dd2-c9d8-4567-8228-10343e73dca4 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:00.951158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0632dd2-c9d8-4567-8228-10343e73dca4 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:00.987699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c9ad7-6494-45f8-8c6b-34552990a3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:00.988391 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c9ad7-6494-45f8-8c6b-34552990a3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:00.988647 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c9ad7-6494-45f8-8c6b-34552990a3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:00.988949 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c9ad7-6494-45f8-8c6b-34552990a3e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:00.989775 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c9ad7-6494-45f8-8c6b-34552990a3e2 None admin] RBAC: Adding query filter params (role.id=60519d06a8c94e6c82462e5d79d9856b, scope.project.id=ef99706ff3b842eba047e182de96b858, user.id=56e7faa3a777485c8427412eaa17fed3) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:22:00.990098 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c9ad7-6494-45f8-8c6b-34552990a3e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:00.991563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c9ad7-6494-45f8-8c6b-34552990a3e2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:00.997866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 565/1130] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:22:00 2022] GET /identity/v3/role_assignments?user.id=56e7faa3a777485c8427412eaa17fed3&scope.project.id=ef99706ff3b842eba047e182de96b858&role.id=60519d06a8c94e6c82462e5d79d9856b => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:03.271914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d71dfe-119b-4c5c-8666-bec12c28561c None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:03.272518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d71dfe-119b-4c5c-8666-bec12c28561c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:03.272518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d71dfe-119b-4c5c-8666-bec12c28561c None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:03.273885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 566/1131] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:03.280519 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab70b7-555f-4ce0-8597-4ae41563729b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:03.281062 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab70b7-555f-4ce0-8597-4ae41563729b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:03.281369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab70b7-555f-4ce0-8597-4ae41563729b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:03.305114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-24ab70b7-555f-4ce0-8597-4ae41563729b None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:03.306580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-24ab70b7-555f-4ce0-8597-4ae41563729b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:03.327046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:03.390747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 566/1132] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:22:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:22:03.414451 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d71dfe-119b-4c5c-8666-bec12c28561c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:03.521336 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d71dfe-119b-4c5c-8666-bec12c28561c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:03.549636 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:03.558803 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92524f43-f482-44dc-af48-3421d82ea8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:03.559606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92524f43-f482-44dc-af48-3421d82ea8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:03.559879 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92524f43-f482-44dc-af48-3421d82ea8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:03.560191 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92524f43-f482-44dc-af48-3421d82ea8b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:03.561372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92524f43-f482-44dc-af48-3421d82ea8b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:03.563001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92524f43-f482-44dc-af48-3421d82ea8b2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:03.564660 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 567/1133] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:22:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:03.570893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab70b7-555f-4ce0-8597-4ae41563729b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:03.684293 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab70b7-555f-4ce0-8597-4ae41563729b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:03.722394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b16f50-4154-492e-b416-1ea9bd647cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:03.723060 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b16f50-4154-492e-b416-1ea9bd647cb3 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:03.723345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b16f50-4154-492e-b416-1ea9bd647cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:03.723618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b16f50-4154-492e-b416-1ea9bd647cb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:03.724360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b16f50-4154-492e-b416-1ea9bd647cb3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:03.725809 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b16f50-4154-492e-b416-1ea9bd647cb3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:03.749594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:03.763300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 567/1134] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 16:22:03 2022] POST /identity/v3/projects => generated 311 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:22:06.066269 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716e388-afe2-4049-ab83-ff42499161d0 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:06.066873 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716e388-afe2-4049-ab83-ff42499161d0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:06.066873 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716e388-afe2-4049-ab83-ff42499161d0 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:06.068385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 568/1135] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:06.074192 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f57682-4e9d-4dac-bc3f-16721dba77c7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:06.074680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f57682-4e9d-4dac-bc3f-16721dba77c7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:06.074774 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f57682-4e9d-4dac-bc3f-16721dba77c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:06.092891 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b5f57682-4e9d-4dac-bc3f-16721dba77c7 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:06.094173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b5f57682-4e9d-4dac-bc3f-16721dba77c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:06.171976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 568/1136] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:22:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:22:06.198871 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716e388-afe2-4049-ab83-ff42499161d0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:06.317715 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716e388-afe2-4049-ab83-ff42499161d0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:06.357084 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0121c16-e141-4b05-892a-e2782922ac62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:06.357892 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0121c16-e141-4b05-892a-e2782922ac62 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:06.358176 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0121c16-e141-4b05-892a-e2782922ac62 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:06.358454 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0121c16-e141-4b05-892a-e2782922ac62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:06.359734 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0121c16-e141-4b05-892a-e2782922ac62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:06.361325 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0121c16-e141-4b05-892a-e2782922ac62 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:06.362981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 569/1137] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:22:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:06.369067 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f57682-4e9d-4dac-bc3f-16721dba77c7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:06.474793 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f57682-4e9d-4dac-bc3f-16721dba77c7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:06.509379 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:06.520430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7628845-579c-470a-8fce-b96ca88048b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:06.521489 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7628845-579c-470a-8fce-b96ca88048b2 None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:06.521929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7628845-579c-470a-8fce-b96ca88048b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:06.522373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7628845-579c-470a-8fce-b96ca88048b2 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:06.523535 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7628845-579c-470a-8fce-b96ca88048b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:06.525901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7628845-579c-470a-8fce-b96ca88048b2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:06.553120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 569/1138] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 16:22:06 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:22:08.848970 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a38849-de7a-42f3-8e7c-92ca93c20fe5 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:08.849536 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a38849-de7a-42f3-8e7c-92ca93c20fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:08.849536 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a38849-de7a-42f3-8e7c-92ca93c20fe5 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:08.851156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 570/1139] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:22:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:08.856802 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cf965-9e9a-478e-968e-549688f24b00 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:08.857268 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cf965-9e9a-478e-968e-549688f24b00 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:08.857357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6cf965-9e9a-478e-968e-549688f24b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:08.875818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ea6cf965-9e9a-478e-968e-549688f24b00 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:08.877238 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ea6cf965-9e9a-478e-968e-549688f24b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:08.952647 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 570/1140] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:22:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:22:08.977252 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a38849-de7a-42f3-8e7c-92ca93c20fe5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:09.047624 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:09.102212 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a38849-de7a-42f3-8e7c-92ca93c20fe5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:09.138500 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb648f-6866-4ab1-a834-0e1230de58a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:09.139297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb648f-6866-4ab1-a834-0e1230de58a6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:09.139576 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb648f-6866-4ab1-a834-0e1230de58a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:09.139852 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb648f-6866-4ab1-a834-0e1230de58a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:09.151501 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb648f-6866-4ab1-a834-0e1230de58a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:22:09.159156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-89fb648f-6866-4ab1-a834-0e1230de58a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:22:09.159156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:22:09.159156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:22:09.159156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:22:09.159156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:22:09.159156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:22:09.159156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:22:09.159156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:22:09.159156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:22:09.159156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:22:09.159156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:22:09.159156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:22:09.159156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:22:09.159156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:22:09.159156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:22:09.159156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:22:09.160327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:22:09.160327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:22:09.160327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:22:09.160327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:22:09.160327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:22:09.160327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:22:09.160327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:22:09.160327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:22:09.160327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:22:09.160327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:22:09.160327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:22:09.160327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:22:09.160327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:22:09.160327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:22:09.160327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:22:09.160327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:22:09.161505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:22:09.161505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:22:09.161505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:22:09.161505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:22:09.161505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:22:09.161505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:22:09.161505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:22:09.161505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:22:09.161505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:22:09.161505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:22:09.161505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:22:09.161505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:22:09.161505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 571/1141] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:22:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:22:09.169118 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cf965-9e9a-478e-968e-549688f24b00 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:09.278982 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6cf965-9e9a-478e-968e-549688f24b00 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:09.297272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:09.315815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f503e-8d61-43d6-848a-35f4d09c894e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:09.316523 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f503e-8d61-43d6-848a-35f4d09c894e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:09.316802 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f503e-8d61-43d6-848a-35f4d09c894e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:09.317076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f503e-8d61-43d6-848a-35f4d09c894e None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:09.317827 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f503e-8d61-43d6-848a-35f4d09c894e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:22:09.318136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f503e-8d61-43d6-848a-35f4d09c894e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:09.319525 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f503e-8d61-43d6-848a-35f4d09c894e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:09.327770 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 571/1142] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:22:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:09.334760 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb648f-6866-4ab1-a834-0e1230de58a6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:09.442712 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb648f-6866-4ab1-a834-0e1230de58a6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:09.466577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:09.480557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40011c9b-46e1-4a4c-9299-8052d70513e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:09.481456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40011c9b-46e1-4a4c-9299-8052d70513e4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:09.481745 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40011c9b-46e1-4a4c-9299-8052d70513e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:09.482019 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40011c9b-46e1-4a4c-9299-8052d70513e4 None admin] PATH_INFO: `/v3/users/9bd38ed2762b48c5a383f22d25679fdf` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:09.497589 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40011c9b-46e1-4a4c-9299-8052d70513e4 None admin] RBAC: Authorizing `identity:get_user(user_id=9bd38ed2762b48c5a383f22d25679fdf)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:09.499085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40011c9b-46e1-4a4c-9299-8052d70513e4 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:09.501651 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 572/1143] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:22:09 2022] GET /identity/v3/users/9bd38ed2762b48c5a383f22d25679fdf => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:09.507856 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f503e-8d61-43d6-848a-35f4d09c894e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:09.619105 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f503e-8d61-43d6-848a-35f4d09c894e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:09.654970 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462611-147c-4670-86b0-6363c545f04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:09.655618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462611-147c-4670-86b0-6363c545f04b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:09.655900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462611-147c-4670-86b0-6363c545f04b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:09.656202 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462611-147c-4670-86b0-6363c545f04b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:09.719773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:09.742996 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72462611-147c-4670-86b0-6363c545f04b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:09.744503 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72462611-147c-4670-86b0-6363c545f04b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:09.847060 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 572/1144] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:22:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:22:09.853259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40011c9b-46e1-4a4c-9299-8052d70513e4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:09.962887 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40011c9b-46e1-4a4c-9299-8052d70513e4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:10.008105 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1786aa-1812-40a2-82e6-876f0c9ea820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:10.008913 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1786aa-1812-40a2-82e6-876f0c9ea820 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:10.009196 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1786aa-1812-40a2-82e6-876f0c9ea820 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:10.009475 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1786aa-1812-40a2-82e6-876f0c9ea820 None admin] PATH_INFO: `/v3/projects/1873a2cea9d7426084beb6e4e7857fc2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:10.010720 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1786aa-1812-40a2-82e6-876f0c9ea820 None admin] RBAC: Authorizing `identity:get_project(project_id=1873a2cea9d7426084beb6e4e7857fc2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:10.012230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1786aa-1812-40a2-82e6-876f0c9ea820 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:10.013944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 573/1145] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:22:09 2022] GET /identity/v3/projects/1873a2cea9d7426084beb6e4e7857fc2 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:10.024102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462611-147c-4670-86b0-6363c545f04b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:10.126101 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:10.148734 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462611-147c-4670-86b0-6363c545f04b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:10.186679 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedc422-51ad-4826-a5a0-c84ee51e8399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:10.187328 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedc422-51ad-4826-a5a0-c84ee51e8399 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:10.187712 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedc422-51ad-4826-a5a0-c84ee51e8399 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:10.187973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedc422-51ad-4826-a5a0-c84ee51e8399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:10.188831 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedc422-51ad-4826-a5a0-c84ee51e8399 None admin] RBAC: Adding query filter params (role.id=e1e39192d3af465aa504728e32ab7cd2, scope.project.id=1873a2cea9d7426084beb6e4e7857fc2, user.id=9bd38ed2762b48c5a383f22d25679fdf) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:22:10.189134 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedc422-51ad-4826-a5a0-c84ee51e8399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:10.190582 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedc422-51ad-4826-a5a0-c84ee51e8399 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:10.196325 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 573/1146] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:22:10 2022] GET /identity/v3/role_assignments?user.id=9bd38ed2762b48c5a383f22d25679fdf&scope.project.id=1873a2cea9d7426084beb6e4e7857fc2&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:12.413204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382bf9c-867a-46d7-bbd7-719f8072c894 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:12.413990 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382bf9c-867a-46d7-bbd7-719f8072c894 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:12.413990 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382bf9c-867a-46d7-bbd7-719f8072c894 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:12.416262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 574/1147] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:22:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:12.425343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5d5d4-7b7d-4005-947c-830798cc81e3 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:12.426111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5d5d4-7b7d-4005-947c-830798cc81e3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:12.426271 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5d5d4-7b7d-4005-947c-830798cc81e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:12.448176 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-32c5d5d4-7b7d-4005-947c-830798cc81e3 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:12.449400 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-32c5d5d4-7b7d-4005-947c-830798cc81e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:12.534628 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 574/1148] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:22:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:22:12.568567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382bf9c-867a-46d7-bbd7-719f8072c894 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:12.623526 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:12.685243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382bf9c-867a-46d7-bbd7-719f8072c894 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:12.724227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78ed42-714f-48c6-8a5b-12d504e783f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:12.725030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78ed42-714f-48c6-8a5b-12d504e783f4 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:12.725314 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78ed42-714f-48c6-8a5b-12d504e783f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:12.725591 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78ed42-714f-48c6-8a5b-12d504e783f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:12.736425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78ed42-714f-48c6-8a5b-12d504e783f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:22:12.744111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-3e78ed42-714f-48c6-8a5b-12d504e783f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:22:12.744111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:22:12.744111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:22:12.744111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:22:12.744111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:22:12.744111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:22:12.744111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:22:12.744111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:22:12.744111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:22:12.744111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:22:12.744111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:22:12.744111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:22:12.744111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:22:12.744111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:22:12.744111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:22:12.744111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:22:12.745388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:22:12.745388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:22:12.745388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:22:12.745388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:22:12.745388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:22:12.745388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:22:12.745388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:22:12.745388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:22:12.745388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:22:12.745388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:22:12.745388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:22:12.745388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:22:12.745388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:22:12.745388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:22:12.745388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:22:12.745388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:22:12.746724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:22:12.746724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:22:12.746724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:22:12.746724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:22:12.746724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:22:12.746724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:22:12.746724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:22:12.746724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:22:12.746724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:22:12.746724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:22:12.746724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:22:12.746724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:22:12.746724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 575/1149] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:22:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:22:12.753446 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5d5d4-7b7d-4005-947c-830798cc81e3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:12.837001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:12.874713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5d5d4-7b7d-4005-947c-830798cc81e3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:12.911194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b8fe1-a03e-49eb-9863-707fb444a181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:12.911866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b8fe1-a03e-49eb-9863-707fb444a181 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:12.912177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b8fe1-a03e-49eb-9863-707fb444a181 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:12.912454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b8fe1-a03e-49eb-9863-707fb444a181 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:12.913198 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b8fe1-a03e-49eb-9863-707fb444a181 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:22:12.913507 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b8fe1-a03e-49eb-9863-707fb444a181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:12.914899 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b8fe1-a03e-49eb-9863-707fb444a181 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:12.923650 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 575/1150] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:22:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:12.930800 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78ed42-714f-48c6-8a5b-12d504e783f4 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:13.040122 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78ed42-714f-48c6-8a5b-12d504e783f4 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:13.050600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:13.079281 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5acb2-836c-4623-8158-a8262100f042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:13.080247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5acb2-836c-4623-8158-a8262100f042 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:13.080531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5acb2-836c-4623-8158-a8262100f042 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:13.080805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5acb2-836c-4623-8158-a8262100f042 None admin] PATH_INFO: `/v3/users/9bd38ed2762b48c5a383f22d25679fdf` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:13.082094 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5acb2-836c-4623-8158-a8262100f042 None admin] RBAC: Authorizing `identity:get_user(user_id=9bd38ed2762b48c5a383f22d25679fdf)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:13.083581 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5acb2-836c-4623-8158-a8262100f042 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:13.085300 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 576/1151] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:22:12 2022] GET /identity/v3/users/9bd38ed2762b48c5a383f22d25679fdf => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:13.091546 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b8fe1-a03e-49eb-9863-707fb444a181 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:13.201512 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b8fe1-a03e-49eb-9863-707fb444a181 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:13.238645 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e8818-31c7-4c51-9636-0258b2bc62cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:13.239509 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e8818-31c7-4c51-9636-0258b2bc62cb None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:13.239788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e8818-31c7-4c51-9636-0258b2bc62cb None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:13.240063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e8818-31c7-4c51-9636-0258b2bc62cb None admin] PATH_INFO: `/v3/projects/1873a2cea9d7426084beb6e4e7857fc2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:13.241342 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e8818-31c7-4c51-9636-0258b2bc62cb None admin] RBAC: Authorizing `identity:get_project(project_id=1873a2cea9d7426084beb6e4e7857fc2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:13.242800 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e8818-31c7-4c51-9636-0258b2bc62cb None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:13.244560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 576/1152] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:22:13 2022] GET /identity/v3/projects/1873a2cea9d7426084beb6e4e7857fc2 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:13.252715 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5acb2-836c-4623-8158-a8262100f042 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:13.362910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5acb2-836c-4623-8158-a8262100f042 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:13.399587 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dcfa7-7be8-4c60-af2d-28d0806732ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:13.400484 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dcfa7-7be8-4c60-af2d-28d0806732ff None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:13.400755 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dcfa7-7be8-4c60-af2d-28d0806732ff None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:13.401024 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dcfa7-7be8-4c60-af2d-28d0806732ff None admin] PATH_INFO: `/v3/projects/1873a2cea9d7426084beb6e4e7857fc2/users/9bd38ed2762b48c5a383f22d25679fdf/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:13.403096 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dcfa7-7be8-4c60-af2d-28d0806732ff None admin] RBAC: Authorizing `identity:create_grant(project_id=1873a2cea9d7426084beb6e4e7857fc2, user_id=9bd38ed2762b48c5a383f22d25679fdf, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:13.404574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169dcfa7-7be8-4c60-af2d-28d0806732ff None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:13.422384 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 577/1153] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:22:13 2022] PUT /identity/v3/projects/1873a2cea9d7426084beb6e4e7857fc2/users/9bd38ed2762b48c5a383f22d25679fdf/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:22:15.636779 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccaad3-e2fb-4512-bdd8-a108d4133230 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:15.637327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccaad3-e2fb-4512-bdd8-a108d4133230 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:15.637327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccaad3-e2fb-4512-bdd8-a108d4133230 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:15.638639 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 577/1154] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:15.645325 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3254a8-8741-4b01-9b7e-e3939549e602 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:15.646046 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3254a8-8741-4b01-9b7e-e3939549e602 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:15.646189 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3254a8-8741-4b01-9b7e-e3939549e602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:15.668662 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8d3254a8-8741-4b01-9b7e-e3939549e602 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:15.669854 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8d3254a8-8741-4b01-9b7e-e3939549e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:15.702848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:15.747557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 578/1155] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:22:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:22:15.771527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccaad3-e2fb-4512-bdd8-a108d4133230 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:15.774722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:15.887059 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccaad3-e2fb-4512-bdd8-a108d4133230 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:15.925191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928de3b-f85f-49eb-97de-3291b29f124b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:15.925982 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928de3b-f85f-49eb-97de-3291b29f124b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:15.926264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928de3b-f85f-49eb-97de-3291b29f124b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:15.926539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928de3b-f85f-49eb-97de-3291b29f124b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:15.937249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928de3b-f85f-49eb-97de-3291b29f124b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:22:15.945832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-3928de3b-f85f-49eb-97de-3291b29f124b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:22:15.945832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:22:15.945832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:22:15.945832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:22:15.945832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:22:15.945832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:22:15.945832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:22:15.945832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:22:15.945832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:22:15.945832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:22:15.945832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:22:15.945832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:22:15.945832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:22:15.945832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:22:15.945832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:22:15.945832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:22:15.946825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:22:15.946825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:22:15.946825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:22:15.946825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:22:15.946825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:22:15.946825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:22:15.946825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:22:15.946825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:22:15.946825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:22:15.946825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:22:15.946825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:22:15.946825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:22:15.946825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:22:15.946825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:22:15.946825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:22:15.946825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:22:15.947778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:22:15.947778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:22:15.947778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:22:15.947778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:22:15.947778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:22:15.947778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:22:15.947778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:22:15.947778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:22:15.947778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:22:15.947778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:22:15.947778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:22:15.947778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:22:15.947778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 578/1156] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:22:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:22:15.954430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3254a8-8741-4b01-9b7e-e3939549e602 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:16.071337 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3254a8-8741-4b01-9b7e-e3939549e602 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:16.111197 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90291c6-48a2-448e-9903-e4de00ffcb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:16.111880 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90291c6-48a2-448e-9903-e4de00ffcb5c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:16.112150 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90291c6-48a2-448e-9903-e4de00ffcb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:16.112461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90291c6-48a2-448e-9903-e4de00ffcb5c None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:16.113217 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90291c6-48a2-448e-9903-e4de00ffcb5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:22:16.113523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90291c6-48a2-448e-9903-e4de00ffcb5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:16.115306 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90291c6-48a2-448e-9903-e4de00ffcb5c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:16.126311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 579/1157] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:22:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:16.132650 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928de3b-f85f-49eb-97de-3291b29f124b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:16.198785 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:16.241866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928de3b-f85f-49eb-97de-3291b29f124b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:16.277137 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498abdc-51c4-4288-83d9-1bb93571060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:16.278020 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498abdc-51c4-4288-83d9-1bb93571060b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:16.278303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498abdc-51c4-4288-83d9-1bb93571060b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:16.278577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498abdc-51c4-4288-83d9-1bb93571060b None admin] PATH_INFO: `/v3/users/9bd38ed2762b48c5a383f22d25679fdf` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:16.279922 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498abdc-51c4-4288-83d9-1bb93571060b None admin] RBAC: Authorizing `identity:get_user(user_id=9bd38ed2762b48c5a383f22d25679fdf)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:16.281484 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498abdc-51c4-4288-83d9-1bb93571060b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:16.283294 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 579/1158] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:22:16 2022] GET /identity/v3/users/9bd38ed2762b48c5a383f22d25679fdf => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:16.292103 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90291c6-48a2-448e-9903-e4de00ffcb5c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:16.331879 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:16.419027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90291c6-48a2-448e-9903-e4de00ffcb5c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:16.457394 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf322043-2f00-465f-89bf-754462c8dd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:16.457960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf322043-2f00-465f-89bf-754462c8dd0f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:16.458242 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf322043-2f00-465f-89bf-754462c8dd0f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:16.458514 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf322043-2f00-465f-89bf-754462c8dd0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:16.533139 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf322043-2f00-465f-89bf-754462c8dd0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:16.534642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf322043-2f00-465f-89bf-754462c8dd0f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:16.564436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:16.646936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 580/1159] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:22:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:22:16.654060 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498abdc-51c4-4288-83d9-1bb93571060b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:16.766368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498abdc-51c4-4288-83d9-1bb93571060b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:16.798598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:16.807712 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e9b07-bbb0-4cd6-a2c0-6bbf0aa1d1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:16.808934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e9b07-bbb0-4cd6-a2c0-6bbf0aa1d1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:16.809283 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e9b07-bbb0-4cd6-a2c0-6bbf0aa1d1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:16.809641 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e9b07-bbb0-4cd6-a2c0-6bbf0aa1d1d7 None admin] PATH_INFO: `/v3/projects/1873a2cea9d7426084beb6e4e7857fc2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:16.811415 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e9b07-bbb0-4cd6-a2c0-6bbf0aa1d1d7 None admin] RBAC: Authorizing `identity:get_project(project_id=1873a2cea9d7426084beb6e4e7857fc2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:16.813687 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e9b07-bbb0-4cd6-a2c0-6bbf0aa1d1d7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:16.816336 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 580/1160] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:22:16 2022] GET /identity/v3/projects/1873a2cea9d7426084beb6e4e7857fc2 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:16.824671 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf322043-2f00-465f-89bf-754462c8dd0f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:16.930609 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf322043-2f00-465f-89bf-754462c8dd0f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:16.958563 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:16.966904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b63fb-ddba-4026-83d6-415f6cd7c8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:16.967526 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b63fb-ddba-4026-83d6-415f6cd7c8de None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:16.967830 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b63fb-ddba-4026-83d6-415f6cd7c8de None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:16.968135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b63fb-ddba-4026-83d6-415f6cd7c8de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:16.968972 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b63fb-ddba-4026-83d6-415f6cd7c8de None admin] RBAC: Adding query filter params (role.id=e1e39192d3af465aa504728e32ab7cd2, scope.project.id=1873a2cea9d7426084beb6e4e7857fc2, user.id=9bd38ed2762b48c5a383f22d25679fdf) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:22:16.969337 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b63fb-ddba-4026-83d6-415f6cd7c8de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:16.970922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b63fb-ddba-4026-83d6-415f6cd7c8de None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:16.977454 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 581/1161] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:22:16 2022] GET /identity/v3/role_assignments?user.id=9bd38ed2762b48c5a383f22d25679fdf&scope.project.id=1873a2cea9d7426084beb6e4e7857fc2&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:19.272952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf76a46-2f75-419f-a5b7-bb5502a66a90 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:19.273528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf76a46-2f75-419f-a5b7-bb5502a66a90 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:19.273528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf76a46-2f75-419f-a5b7-bb5502a66a90 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:19.275511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 581/1162] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:22:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:19.283606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510e53b-f5a1-46f0-bea2-7bdf7bfbfc54 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:19.284103 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510e53b-f5a1-46f0-bea2-7bdf7bfbfc54 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:19.284222 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510e53b-f5a1-46f0-bea2-7bdf7bfbfc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:19.302551 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4510e53b-f5a1-46f0-bea2-7bdf7bfbfc54 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:19.304133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4510e53b-f5a1-46f0-bea2-7bdf7bfbfc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:19.385699 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 582/1163] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:22:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:22:19.409460 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf76a46-2f75-419f-a5b7-bb5502a66a90 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:19.523694 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf76a46-2f75-419f-a5b7-bb5502a66a90 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:19.562256 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0be54-737a-464a-90a7-e4fa33708e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:19.562978 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0be54-737a-464a-90a7-e4fa33708e72 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:19.563251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0be54-737a-464a-90a7-e4fa33708e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:19.563519 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0be54-737a-464a-90a7-e4fa33708e72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:19.636483 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:19.640999 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0be54-737a-464a-90a7-e4fa33708e72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:19.642464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0be54-737a-464a-90a7-e4fa33708e72 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:19.746834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 582/1164] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:22:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:22:19.753299 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510e53b-f5a1-46f0-bea2-7bdf7bfbfc54 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:19.864832 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510e53b-f5a1-46f0-bea2-7bdf7bfbfc54 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:19.891154 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:19.903506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e81b9-de4b-4318-baa0-137ac6c8c619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:19.904359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e81b9-de4b-4318-baa0-137ac6c8c619 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:19.904642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e81b9-de4b-4318-baa0-137ac6c8c619 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:19.904911 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e81b9-de4b-4318-baa0-137ac6c8c619 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:19.912799 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e81b9-de4b-4318-baa0-137ac6c8c619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:19.914291 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e81b9-de4b-4318-baa0-137ac6c8c619 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:19.929396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-1b0e81b9-de4b-4318-baa0-137ac6c8c619 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 16:22:19.929396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:22:19.929396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 27 16:22:19.929396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 27 16:22:19.929396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:22:19.929396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:22:19.929396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:22:19.929396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:22:19.929396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 27 16:22:19.929396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:22:19.929396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:22:19.929396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:22:19.929396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:22:19.929396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:22:19.929396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:22:19.929396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:22:19.929396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:22:19.930735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:22:19.930735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:22:19.930735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:22:19.930735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:22:19.930735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:22:19.930735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:22:19.930735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:22:19.930735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:22:19.930735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:22:19.930735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:22:19.930735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:22:19.930735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:22:19.930735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:22:19.930735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:22:19.930735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:22:19.930735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:22:19.931790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:22:19.931790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:22:19.931790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:22:19.931790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:22:19.931790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:22:19.931790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:22:19.931790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:22:19.931790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:22:19.931790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:22:19.931790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:22:19.931790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 27 16:22:19.931790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:22:19.931790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 16:22:19.931790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:22:19.931790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 583/1165] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 16:22:19 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:22:19.940191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0be54-737a-464a-90a7-e4fa33708e72 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:20.043952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:20.048878 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0be54-737a-464a-90a7-e4fa33708e72 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:20.088656 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036dc30-7af3-43ea-a49b-5c4159829ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:20.089319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036dc30-7af3-43ea-a49b-5c4159829ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:20.089602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036dc30-7af3-43ea-a49b-5c4159829ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:20.089873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036dc30-7af3-43ea-a49b-5c4159829ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:20.090588 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036dc30-7af3-43ea-a49b-5c4159829ea9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:22:20.090888 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036dc30-7af3-43ea-a49b-5c4159829ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:20.092296 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036dc30-7af3-43ea-a49b-5c4159829ea9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:20.100066 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 583/1166] 10.222.0.41 () {56 vars in 1115 bytes} [Fri May 27 16:22:19 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:22:22.300828 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2117b-2cb2-4a6d-bc56-2ad69e7e6e89 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:22.301341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2117b-2cb2-4a6d-bc56-2ad69e7e6e89 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:22.301341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2117b-2cb2-4a6d-bc56-2ad69e7e6e89 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:22.302769 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 584/1167] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:22.308710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa44271-eb49-4383-85e1-f72ad7eba344 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:22.309179 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa44271-eb49-4383-85e1-f72ad7eba344 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:22.309271 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa44271-eb49-4383-85e1-f72ad7eba344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:22.330829 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2aa44271-eb49-4383-85e1-f72ad7eba344 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:22.332154 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2aa44271-eb49-4383-85e1-f72ad7eba344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:22.411357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 584/1168] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:22:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:22:22.444607 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2117b-2cb2-4a6d-bc56-2ad69e7e6e89 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:22.557819 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2117b-2cb2-4a6d-bc56-2ad69e7e6e89 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:22.593095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4638b-6288-4613-bad6-d9676be9642c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:22.593753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4638b-6288-4613-bad6-d9676be9642c None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:22.594061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4638b-6288-4613-bad6-d9676be9642c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:22.594341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4638b-6288-4613-bad6-d9676be9642c None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:22.595140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4638b-6288-4613-bad6-d9676be9642c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:22.596574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4638b-6288-4613-bad6-d9676be9642c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:22.616339 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 585/1169] 10.222.0.41 () {60 vars in 1138 bytes} [Fri May 27 16:22:22 2022] POST /identity/v3/domains => generated 267 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:22:24.857641 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5f673-6ec5-4ed3-9fb0-081b55037094 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:24.858244 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5f673-6ec5-4ed3-9fb0-081b55037094 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:24.858244 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5f673-6ec5-4ed3-9fb0-081b55037094 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:24.860476 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 585/1170] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:22:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:24.867064 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6b830-5056-4f6f-94fd-dbf6df1fe764 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:24.867514 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6b830-5056-4f6f-94fd-dbf6df1fe764 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:24.867632 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6b830-5056-4f6f-94fd-dbf6df1fe764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:24.893079 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ccf6b830-5056-4f6f-94fd-dbf6df1fe764 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:24.894287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ccf6b830-5056-4f6f-94fd-dbf6df1fe764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:24.931531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:24.966859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 586/1171] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:22:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:22:24.990927 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5f673-6ec5-4ed3-9fb0-081b55037094 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:25.088250 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:25.099667 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5f673-6ec5-4ed3-9fb0-081b55037094 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:25.140135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9bf92-8289-4365-a894-037365631cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:25.140951 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9bf92-8289-4365-a894-037365631cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:25.141324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9bf92-8289-4365-a894-037365631cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:25.141611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9bf92-8289-4365-a894-037365631cc1 None admin] PATH_INFO: `/v3/domains/38d3cdfd20c14e44943c43ce8f808b62` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:25.153263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9bf92-8289-4365-a894-037365631cc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=38d3cdfd20c14e44943c43ce8f808b62)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:25.154739 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9bf92-8289-4365-a894-037365631cc1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:25.156569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 586/1172] 10.222.0.41 () {56 vars in 1183 bytes} [Fri May 27 16:22:24 2022] GET /identity/v3/domains/38d3cdfd20c14e44943c43ce8f808b62 => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:25.163641 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6b830-5056-4f6f-94fd-dbf6df1fe764 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:25.281721 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6b830-5056-4f6f-94fd-dbf6df1fe764 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:25.319312 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3b6b9-dd92-488a-8761-c4552fab1dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:25.319980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3b6b9-dd92-488a-8761-c4552fab1dfb None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:25.320291 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3b6b9-dd92-488a-8761-c4552fab1dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:25.320560 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3b6b9-dd92-488a-8761-c4552fab1dfb None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:25.321271 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3b6b9-dd92-488a-8761-c4552fab1dfb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:25.322739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3b6b9-dd92-488a-8761-c4552fab1dfb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:25.352919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 587/1173] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 16:22:25 2022] POST /identity/v3/projects => generated 361 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:22:27.587023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967ed01-b8fb-4189-bf67-1566fc40a073 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:27.587831 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967ed01-b8fb-4189-bf67-1566fc40a073 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:27.587831 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967ed01-b8fb-4189-bf67-1566fc40a073 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:27.590075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 587/1174] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:22:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:27.595717 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc38bc-6e47-4f7b-acfd-bbf37b845f49 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:27.596214 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc38bc-6e47-4f7b-acfd-bbf37b845f49 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:27.596318 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc38bc-6e47-4f7b-acfd-bbf37b845f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:27.614062 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-bedc38bc-6e47-4f7b-acfd-bbf37b845f49 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:27.615240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bedc38bc-6e47-4f7b-acfd-bbf37b845f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:27.634453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:27.686099 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 588/1175] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:22:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:22:27.711923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967ed01-b8fb-4189-bf67-1566fc40a073 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:27.829104 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9967ed01-b8fb-4189-bf67-1566fc40a073 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:27.866488 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a44eee-0cf5-4787-9b27-3c962d22fb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:27.867275 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a44eee-0cf5-4787-9b27-3c962d22fb4e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:27.867557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a44eee-0cf5-4787-9b27-3c962d22fb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:27.867832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a44eee-0cf5-4787-9b27-3c962d22fb4e None admin] PATH_INFO: `/v3/domains/38d3cdfd20c14e44943c43ce8f808b62` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:27.869072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a44eee-0cf5-4787-9b27-3c962d22fb4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=38d3cdfd20c14e44943c43ce8f808b62)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:27.870538 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a44eee-0cf5-4787-9b27-3c962d22fb4e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:27.872219 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 588/1176] 10.222.0.41 () {56 vars in 1183 bytes} [Fri May 27 16:22:27 2022] GET /identity/v3/domains/38d3cdfd20c14e44943c43ce8f808b62 => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:27.879442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc38bc-6e47-4f7b-acfd-bbf37b845f49 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:27.991075 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc38bc-6e47-4f7b-acfd-bbf37b845f49 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:28.027659 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d61fe-9738-46b8-b1ae-602b70766ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:28.028355 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d61fe-9738-46b8-b1ae-602b70766ca5 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:28.028637 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d61fe-9738-46b8-b1ae-602b70766ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:28.028911 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d61fe-9738-46b8-b1ae-602b70766ca5 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:28.029624 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d61fe-9738-46b8-b1ae-602b70766ca5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:28.031084 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d61fe-9738-46b8-b1ae-602b70766ca5 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:28.055817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 589/1177] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 16:22:27 2022] POST /identity/v3/users => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:22:30.304517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a48b34-e1e4-4931-bb3c-258b7edeb2f8 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:30.305203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a48b34-e1e4-4931-bb3c-258b7edeb2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:30.305315 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a48b34-e1e4-4931-bb3c-258b7edeb2f8 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:30.307398 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 589/1178] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:22:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:30.316001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c246acc-f984-4314-b9c2-8248df632a67 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:30.316499 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c246acc-f984-4314-b9c2-8248df632a67 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:30.316627 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c246acc-f984-4314-b9c2-8248df632a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:30.338326 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9c246acc-f984-4314-b9c2-8248df632a67 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:30.339528 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9c246acc-f984-4314-b9c2-8248df632a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:30.342369 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:30.414406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 590/1179] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:22:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:22:30.438251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a48b34-e1e4-4931-bb3c-258b7edeb2f8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:30.462493 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:30.547277 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a48b34-e1e4-4931-bb3c-258b7edeb2f8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:30.587592 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84845a1b-4b6b-4c03-9713-6e4cb9e4b072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:30.588421 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84845a1b-4b6b-4c03-9713-6e4cb9e4b072 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:30.588710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84845a1b-4b6b-4c03-9713-6e4cb9e4b072 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:30.588983 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84845a1b-4b6b-4c03-9713-6e4cb9e4b072 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:30.600709 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84845a1b-4b6b-4c03-9713-6e4cb9e4b072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:22:30.608397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-84845a1b-4b6b-4c03-9713-6e4cb9e4b072 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:22:30.608397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:22:30.608397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:22:30.608397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:22:30.608397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:22:30.608397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:22:30.608397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:22:30.608397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:22:30.608397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:22:30.608397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:22:30.608397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:22:30.608397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:22:30.608397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:22:30.608397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:22:30.608397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:22:30.608397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:22:30.609580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:22:30.609580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:22:30.609580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:22:30.609580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:22:30.609580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:22:30.609580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:22:30.609580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:22:30.609580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:22:30.609580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:22:30.609580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:22:30.609580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:22:30.609580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:22:30.609580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:22:30.609580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:22:30.609580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:22:30.609580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:22:30.610720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:22:30.610720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:22:30.610720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:22:30.610720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:22:30.610720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:22:30.610720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:22:30.610720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:22:30.610720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:22:30.610720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:22:30.610720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:22:30.610720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:22:30.610720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:22:30.610720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 590/1180] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:22:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:22:30.615745 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c246acc-f984-4314-b9c2-8248df632a67 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:30.726563 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c246acc-f984-4314-b9c2-8248df632a67 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:30.768867 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc6833-5978-4087-b7e9-09efc4732785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:30.769928 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc6833-5978-4087-b7e9-09efc4732785 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:30.770371 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc6833-5978-4087-b7e9-09efc4732785 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:30.770804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc6833-5978-4087-b7e9-09efc4732785 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:30.772096 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc6833-5978-4087-b7e9-09efc4732785 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:22:30.772574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc6833-5978-4087-b7e9-09efc4732785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:30.774763 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc6833-5978-4087-b7e9-09efc4732785 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:30.788166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 591/1181] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:22:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:30.794574 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84845a1b-4b6b-4c03-9713-6e4cb9e4b072 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:30.897558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:30.918718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84845a1b-4b6b-4c03-9713-6e4cb9e4b072 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:30.954108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583bf5b-c82f-440b-b2fa-d60c49fc08cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:30.954988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583bf5b-c82f-440b-b2fa-d60c49fc08cc None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:30.955273 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583bf5b-c82f-440b-b2fa-d60c49fc08cc None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:30.955554 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583bf5b-c82f-440b-b2fa-d60c49fc08cc None admin] PATH_INFO: `/v3/users/c1e287f1303e4067b4a3975e73880dc6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:30.980658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583bf5b-c82f-440b-b2fa-d60c49fc08cc None admin] RBAC: Authorizing `identity:get_user(user_id=c1e287f1303e4067b4a3975e73880dc6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:30.982917 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583bf5b-c82f-440b-b2fa-d60c49fc08cc None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:30.985311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 591/1182] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:22:30 2022] GET /identity/v3/users/c1e287f1303e4067b4a3975e73880dc6 => generated 311 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:30.991339 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc6833-5978-4087-b7e9-09efc4732785 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:30.994524 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:31.107808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc6833-5978-4087-b7e9-09efc4732785 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:31.153574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b83f6-77ba-4ac0-bd9a-349b20c96f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:31.154403 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b83f6-77ba-4ac0-bd9a-349b20c96f62 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:31.154728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b83f6-77ba-4ac0-bd9a-349b20c96f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:31.155063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b83f6-77ba-4ac0-bd9a-349b20c96f62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:31.228378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b83f6-77ba-4ac0-bd9a-349b20c96f62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:31.229847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b83f6-77ba-4ac0-bd9a-349b20c96f62 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:31.231734 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:31.336449 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 592/1183] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:22:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:22:31.343144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583bf5b-c82f-440b-b2fa-d60c49fc08cc None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:31.461365 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583bf5b-c82f-440b-b2fa-d60c49fc08cc None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:31.500433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4409e-fa8d-4be1-a3a3-449493d14018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:31.501311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4409e-fa8d-4be1-a3a3-449493d14018 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:31.501595 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4409e-fa8d-4be1-a3a3-449493d14018 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:31.501875 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4409e-fa8d-4be1-a3a3-449493d14018 None admin] PATH_INFO: `/v3/projects/8e8a932258004a8181d9f3e44e867e6c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:31.503163 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4409e-fa8d-4be1-a3a3-449493d14018 None admin] RBAC: Authorizing `identity:get_project(project_id=8e8a932258004a8181d9f3e44e867e6c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:31.504668 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4409e-fa8d-4be1-a3a3-449493d14018 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:31.506396 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 592/1184] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:22:31 2022] GET /identity/v3/projects/8e8a932258004a8181d9f3e44e867e6c => generated 361 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:31.513493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b83f6-77ba-4ac0-bd9a-349b20c96f62 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:31.631851 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b83f6-77ba-4ac0-bd9a-349b20c96f62 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:31.633663 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:31.670917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a98a20-329b-4ddb-bf00-ac2429896db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:31.671566 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a98a20-329b-4ddb-bf00-ac2429896db8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:31.672386 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a98a20-329b-4ddb-bf00-ac2429896db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:31.672667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a98a20-329b-4ddb-bf00-ac2429896db8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:31.673490 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a98a20-329b-4ddb-bf00-ac2429896db8 None admin] RBAC: Adding query filter params (role.id=e1e39192d3af465aa504728e32ab7cd2, scope.project.id=8e8a932258004a8181d9f3e44e867e6c, user.id=c1e287f1303e4067b4a3975e73880dc6) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:22:31.673778 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a98a20-329b-4ddb-bf00-ac2429896db8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:31.675264 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a98a20-329b-4ddb-bf00-ac2429896db8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:31.681553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 593/1185] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:22:31 2022] GET /identity/v3/role_assignments?user.id=c1e287f1303e4067b4a3975e73880dc6&scope.project.id=8e8a932258004a8181d9f3e44e867e6c&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:33.911503 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3251a5-a8c0-454b-9f8d-455e5f5c7529 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:33.912458 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3251a5-a8c0-454b-9f8d-455e5f5c7529 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:33.912458 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3251a5-a8c0-454b-9f8d-455e5f5c7529 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:33.914626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 593/1186] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:22:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:33.923173 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0f2b2-bd3f-453f-957e-e3f574fd4546 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:33.923625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0f2b2-bd3f-453f-957e-e3f574fd4546 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:33.923737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0f2b2-bd3f-453f-957e-e3f574fd4546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:33.941806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8fa0f2b2-bd3f-453f-957e-e3f574fd4546 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:33.943032 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8fa0f2b2-bd3f-453f-957e-e3f574fd4546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:34.021920 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 594/1187] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:22:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:22:34.051612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3251a5-a8c0-454b-9f8d-455e5f5c7529 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:34.065825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:34.180712 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3251a5-a8c0-454b-9f8d-455e5f5c7529 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:34.217365 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8de2d-296e-4c5c-9a74-c63147c279e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:34.218170 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8de2d-296e-4c5c-9a74-c63147c279e0 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:34.218500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8de2d-296e-4c5c-9a74-c63147c279e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:34.218930 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8de2d-296e-4c5c-9a74-c63147c279e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:34.229985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8de2d-296e-4c5c-9a74-c63147c279e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:22:34.237906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-2ae8de2d-296e-4c5c-9a74-c63147c279e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:22:34.237906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:22:34.237906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:22:34.237906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:22:34.237906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:22:34.237906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:22:34.237906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:22:34.237906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:22:34.237906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:22:34.237906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:22:34.237906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:22:34.237906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:22:34.237906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:22:34.237906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:22:34.237906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:22:34.237906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:22:34.239102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:22:34.239102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:22:34.239102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:22:34.239102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:22:34.239102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:22:34.239102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:22:34.239102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:22:34.239102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:22:34.239102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:22:34.239102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:22:34.239102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:22:34.239102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:22:34.239102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:22:34.239102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:22:34.239102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:22:34.239102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:22:34.241099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:22:34.241099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:22:34.241099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:22:34.241099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:22:34.241099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:22:34.241099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:22:34.241099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:22:34.241099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:22:34.241099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:22:34.241099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:22:34.241099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:22:34.241099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:22:34.241099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 594/1188] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:22:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:22:34.246228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0f2b2-bd3f-453f-957e-e3f574fd4546 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:34.347051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:34.354252 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa0f2b2-bd3f-453f-957e-e3f574fd4546 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:34.391343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b1fa1-cc84-4a83-b975-7cff430b8506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:34.392089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b1fa1-cc84-4a83-b975-7cff430b8506 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:34.392332 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b1fa1-cc84-4a83-b975-7cff430b8506 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:34.392610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b1fa1-cc84-4a83-b975-7cff430b8506 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:34.393360 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b1fa1-cc84-4a83-b975-7cff430b8506 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:22:34.393672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b1fa1-cc84-4a83-b975-7cff430b8506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:34.395089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b1fa1-cc84-4a83-b975-7cff430b8506 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:34.404284 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 595/1189] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:22:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:34.410805 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8de2d-296e-4c5c-9a74-c63147c279e0 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:34.486651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:34.530920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8de2d-296e-4c5c-9a74-c63147c279e0 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:34.566884 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab2970-e53a-48f0-9a1b-4a300a1b3721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:34.567766 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab2970-e53a-48f0-9a1b-4a300a1b3721 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:34.568042 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab2970-e53a-48f0-9a1b-4a300a1b3721 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:34.568413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab2970-e53a-48f0-9a1b-4a300a1b3721 None admin] PATH_INFO: `/v3/users/c1e287f1303e4067b4a3975e73880dc6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:34.569672 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab2970-e53a-48f0-9a1b-4a300a1b3721 None admin] RBAC: Authorizing `identity:get_user(user_id=c1e287f1303e4067b4a3975e73880dc6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:34.571153 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab2970-e53a-48f0-9a1b-4a300a1b3721 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:34.572857 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 595/1190] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:22:34 2022] GET /identity/v3/users/c1e287f1303e4067b4a3975e73880dc6 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:22:34.579616 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b1fa1-cc84-4a83-b975-7cff430b8506 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:34.691264 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b1fa1-cc84-4a83-b975-7cff430b8506 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:34.727223 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8542114-d7d0-48d6-8898-a2657150d7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:34.728112 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8542114-d7d0-48d6-8898-a2657150d7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:34.728400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8542114-d7d0-48d6-8898-a2657150d7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:34.728666 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8542114-d7d0-48d6-8898-a2657150d7c1 None admin] PATH_INFO: `/v3/projects/8e8a932258004a8181d9f3e44e867e6c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:34.730004 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8542114-d7d0-48d6-8898-a2657150d7c1 None admin] RBAC: Authorizing `identity:get_project(project_id=8e8a932258004a8181d9f3e44e867e6c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:34.731481 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8542114-d7d0-48d6-8898-a2657150d7c1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:34.733226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 596/1191] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:22:34 2022] GET /identity/v3/projects/8e8a932258004a8181d9f3e44e867e6c => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:34.740530 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab2970-e53a-48f0-9a1b-4a300a1b3721 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:34.849107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab2970-e53a-48f0-9a1b-4a300a1b3721 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:34.884943 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5894e-331f-48d9-a5e4-20f111e96ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:34.885832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5894e-331f-48d9-a5e4-20f111e96ca1 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:34.886111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5894e-331f-48d9-a5e4-20f111e96ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:34.886386 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5894e-331f-48d9-a5e4-20f111e96ca1 None admin] PATH_INFO: `/v3/projects/8e8a932258004a8181d9f3e44e867e6c/users/c1e287f1303e4067b4a3975e73880dc6/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:34.888390 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5894e-331f-48d9-a5e4-20f111e96ca1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e8a932258004a8181d9f3e44e867e6c, user_id=c1e287f1303e4067b4a3975e73880dc6, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:34.889951 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5894e-331f-48d9-a5e4-20f111e96ca1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:34.892797 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:34.908130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 596/1192] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:22:34 2022] PUT /identity/v3/projects/8e8a932258004a8181d9f3e44e867e6c/users/c1e287f1303e4067b4a3975e73880dc6/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:22:37.154270 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54f1b8-fe27-4458-8a87-fec2d733fcdc None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:37.154808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54f1b8-fe27-4458-8a87-fec2d733fcdc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:37.154808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54f1b8-fe27-4458-8a87-fec2d733fcdc None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:37.156638 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 597/1193] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:22:37.162881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d79419-7d8b-4675-bd94-6dc1c057f962 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:37.163294 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d79419-7d8b-4675-bd94-6dc1c057f962 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:37.163571 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d79419-7d8b-4675-bd94-6dc1c057f962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:37.185549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e9d79419-7d8b-4675-bd94-6dc1c057f962 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:22:37.186741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e9d79419-7d8b-4675-bd94-6dc1c057f962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:22:37.257802 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 597/1194] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:22:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:22:37.282266 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54f1b8-fe27-4458-8a87-fec2d733fcdc None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:37.315607 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:37.394940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54f1b8-fe27-4458-8a87-fec2d733fcdc None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:37.431216 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5adced-28df-4e9b-a0cc-d023fafad47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:37.431928 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5adced-28df-4e9b-a0cc-d023fafad47e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:37.432232 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5adced-28df-4e9b-a0cc-d023fafad47e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:37.432508 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5adced-28df-4e9b-a0cc-d023fafad47e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:37.443377 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5adced-28df-4e9b-a0cc-d023fafad47e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:22:37.450918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-be5adced-28df-4e9b-a0cc-d023fafad47e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:22:37.450918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:22:37.450918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:22:37.450918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:22:37.450918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:22:37.450918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:22:37.450918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:22:37.450918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:22:37.450918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:22:37.450918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:22:37.450918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:22:37.450918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:22:37.450918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:22:37.450918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:22:37.450918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:22:37.450918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:22:37.452065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:22:37.452065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:22:37.452065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:22:37.452065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:22:37.452065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:22:37.452065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:22:37.452065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:22:37.452065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:22:37.452065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:22:37.452065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:22:37.452065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:22:37.452065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:22:37.452065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:22:37.452065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:22:37.452065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:22:37.452065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:22:37.453849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:22:37.453849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:22:37.453849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:22:37.453849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:22:37.453849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:22:37.453849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:22:37.453849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:22:37.453849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:22:37.453849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:22:37.453849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:22:37.453849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:22:37.453849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:22:37.453849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 598/1195] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:22:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:22:37.460257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d79419-7d8b-4675-bd94-6dc1c057f962 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:37.572618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d79419-7d8b-4675-bd94-6dc1c057f962 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:37.596790 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:37.612387 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c453f6a-a868-46bb-9692-3377caca4f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:37.613066 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c453f6a-a868-46bb-9692-3377caca4f2e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:37.613353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c453f6a-a868-46bb-9692-3377caca4f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:37.613629 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c453f6a-a868-46bb-9692-3377caca4f2e None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:37.614384 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c453f6a-a868-46bb-9692-3377caca4f2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:22:37.614697 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c453f6a-a868-46bb-9692-3377caca4f2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:37.616241 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c453f6a-a868-46bb-9692-3377caca4f2e None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:37.624825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 598/1196] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:22:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:37.631394 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5adced-28df-4e9b-a0cc-d023fafad47e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:37.717207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:37.733559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5adced-28df-4e9b-a0cc-d023fafad47e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:37.773063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed520d82-7f8c-4752-af84-410c337e5afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:37.773931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed520d82-7f8c-4752-af84-410c337e5afb None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:37.774210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed520d82-7f8c-4752-af84-410c337e5afb None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:37.774463 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed520d82-7f8c-4752-af84-410c337e5afb None admin] PATH_INFO: `/v3/users/c1e287f1303e4067b4a3975e73880dc6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:37.775784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed520d82-7f8c-4752-af84-410c337e5afb None admin] RBAC: Authorizing `identity:get_user(user_id=c1e287f1303e4067b4a3975e73880dc6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:37.777281 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed520d82-7f8c-4752-af84-410c337e5afb None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:37.778904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 599/1197] 10.222.0.41 () {56 vars in 1177 bytes} [Fri May 27 16:22:37 2022] GET /identity/v3/users/c1e287f1303e4067b4a3975e73880dc6 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:37.785831 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c453f6a-a868-46bb-9692-3377caca4f2e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:37.903376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c453f6a-a868-46bb-9692-3377caca4f2e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:37.943582 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e5649-5419-47cf-b952-b481cc7b9263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:37.944280 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e5649-5419-47cf-b952-b481cc7b9263 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:37.944565 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e5649-5419-47cf-b952-b481cc7b9263 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:37.944830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e5649-5419-47cf-b952-b481cc7b9263 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:38.003554 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:38.019062 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e5649-5419-47cf-b952-b481cc7b9263 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:38.020589 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e5649-5419-47cf-b952-b481cc7b9263 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:38.128366 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 599/1198] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:22:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:22:38.137520 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed520d82-7f8c-4752-af84-410c337e5afb None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:38.252429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed520d82-7f8c-4752-af84-410c337e5afb None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:38.296089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77f507-efec-42e1-b052-a7c3da382aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:38.297153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77f507-efec-42e1-b052-a7c3da382aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:38.297435 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77f507-efec-42e1-b052-a7c3da382aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:38.297706 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77f507-efec-42e1-b052-a7c3da382aa7 None admin] PATH_INFO: `/v3/projects/8e8a932258004a8181d9f3e44e867e6c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:38.299035 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77f507-efec-42e1-b052-a7c3da382aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=8e8a932258004a8181d9f3e44e867e6c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:38.300562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77f507-efec-42e1-b052-a7c3da382aa7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:38.302298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 600/1199] 10.222.0.41 () {56 vars in 1186 bytes} [Fri May 27 16:22:38 2022] GET /identity/v3/projects/8e8a932258004a8181d9f3e44e867e6c => generated 361 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:38.309430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e5649-5419-47cf-b952-b481cc7b9263 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:22:38.431548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:38.448912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e5649-5419-47cf-b952-b481cc7b9263 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:22:38.487654 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602a57e-674d-40d3-b10b-1ab400ce77e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:22:38.488351 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602a57e-674d-40d3-b10b-1ab400ce77e2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:22:38.488636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602a57e-674d-40d3-b10b-1ab400ce77e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:22:38.488912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602a57e-674d-40d3-b10b-1ab400ce77e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:22:38.489746 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602a57e-674d-40d3-b10b-1ab400ce77e2 None admin] RBAC: Adding query filter params (role.id=e1e39192d3af465aa504728e32ab7cd2, scope.project.id=8e8a932258004a8181d9f3e44e867e6c, user.id=c1e287f1303e4067b4a3975e73880dc6) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:22:38.490059 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602a57e-674d-40d3-b10b-1ab400ce77e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:22:38.491539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602a57e-674d-40d3-b10b-1ab400ce77e2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:22:38.498019 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 600/1200] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:22:38 2022] GET /identity/v3/role_assignments?user.id=c1e287f1303e4067b4a3975e73880dc6&scope.project.id=8e8a932258004a8181d9f3e44e867e6c&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:22:48.289964 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:22:48.494936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=25 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:40.505553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb732f4-5aa1-46b9-8c0f-b3a8e6615809 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:40.505553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb732f4-5aa1-46b9-8c0f-b3a8e6615809 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:40.505553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb732f4-5aa1-46b9-8c0f-b3a8e6615809 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:40.506725 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 601/1201] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:23:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:23:40.514382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef6682-4750-4656-b0e6-f1a9ce4e8fa1 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:40.515501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef6682-4750-4656-b0e6-f1a9ce4e8fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:40.515964 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef6682-4750-4656-b0e6-f1a9ce4e8fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:40.534062 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-35ef6682-4750-4656-b0e6-f1a9ce4e8fa1 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:23:40.535589 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-35ef6682-4750-4656-b0e6-f1a9ce4e8fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:23:40.628119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 601/1202] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:23:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:23:40.647736 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb732f4-5aa1-46b9-8c0f-b3a8e6615809 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:40.798948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb732f4-5aa1-46b9-8c0f-b3a8e6615809 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:40.866027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2f094-24a1-4afd-a2fa-977ef2b68645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:40.866919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2f094-24a1-4afd-a2fa-977ef2b68645 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:40.867188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2f094-24a1-4afd-a2fa-977ef2b68645 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:40.867519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2f094-24a1-4afd-a2fa-977ef2b68645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:40.887582 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2f094-24a1-4afd-a2fa-977ef2b68645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:40.889097 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2f094-24a1-4afd-a2fa-977ef2b68645 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:40.910639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-dee2f094-24a1-4afd-a2fa-977ef2b68645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:23:40.910639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:23:40.910639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:23:40.910639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:23:40.910639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:23:40.910639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:23:40.910639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:23:40.910639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:23:40.910639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:23:40.910639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:23:40.910639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:23:40.910639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:23:40.910639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:23:40.910639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:23:40.910639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:23:40.912375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:23:40.912375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:23:40.912375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:23:40.912375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:23:40.912375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:23:40.912375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:23:40.912375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:23:40.912375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:23:40.912375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:23:40.912375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:23:40.912375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:23:40.912375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:23:40.912375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:23:40.912375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:23:40.912375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:23:40.912375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:23:40.912375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:23:40.913404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:23:40.913404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:23:40.913404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:23:40.913404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:23:40.913404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 602/1203] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:23:40.919372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef6682-4750-4656-b0e6-f1a9ce4e8fa1 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:41.080085 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef6682-4750-4656-b0e6-f1a9ce4e8fa1 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:41.121734 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:41.129841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a6d8e-15a0-499a-8a66-5b44d98d2bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:41.131013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a6d8e-15a0-499a-8a66-5b44d98d2bcf None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:41.132656 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a6d8e-15a0-499a-8a66-5b44d98d2bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:41.132656 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a6d8e-15a0-499a-8a66-5b44d98d2bcf None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:41.132656 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a6d8e-15a0-499a-8a66-5b44d98d2bcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:23:41.133296 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a6d8e-15a0-499a-8a66-5b44d98d2bcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:41.135374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a6d8e-15a0-499a-8a66-5b44d98d2bcf None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:41.152147 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 602/1204] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:23:41.156052 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2f094-24a1-4afd-a2fa-977ef2b68645 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:41.229512 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:41.291696 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2f094-24a1-4afd-a2fa-977ef2b68645 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:41.345620 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c859c-871f-4efa-b63c-ffc50815a073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:41.346327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c859c-871f-4efa-b63c-ffc50815a073 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:41.346611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c859c-871f-4efa-b63c-ffc50815a073 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:41.346957 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c859c-871f-4efa-b63c-ffc50815a073 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:41.347619 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c859c-871f-4efa-b63c-ffc50815a073 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:41.349161 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c859c-871f-4efa-b63c-ffc50815a073 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:41.377971 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 603/1205] 10.222.0.41 () {60 vars in 1132 bytes} [Fri May 27 16:23:41 2022] POST /identity/v3/users => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:23:43.829485 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc107eb-33fe-4ccf-930c-8e7cb11c4c25 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:43.830300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc107eb-33fe-4ccf-930c-8e7cb11c4c25 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:43.830300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc107eb-33fe-4ccf-930c-8e7cb11c4c25 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:43.833954 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 603/1206] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:23:43.837495 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089c01e-0e57-4d92-a4b0-4b2e18641dcf None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:43.838175 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089c01e-0e57-4d92-a4b0-4b2e18641dcf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:43.838175 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089c01e-0e57-4d92-a4b0-4b2e18641dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:43.856813 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4089c01e-0e57-4d92-a4b0-4b2e18641dcf None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:23:43.858142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4089c01e-0e57-4d92-a4b0-4b2e18641dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:23:43.945261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 604/1207] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:23:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:23:43.974653 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc107eb-33fe-4ccf-930c-8e7cb11c4c25 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:44.109006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc107eb-33fe-4ccf-930c-8e7cb11c4c25 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:44.158288 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67945c-dcae-4376-bd75-fb69ff961e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:44.159268 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67945c-dcae-4376-bd75-fb69ff961e46 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:44.159461 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67945c-dcae-4376-bd75-fb69ff961e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:44.159760 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67945c-dcae-4376-bd75-fb69ff961e46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:44.173433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67945c-dcae-4376-bd75-fb69ff961e46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:23:44.182194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-6b67945c-dcae-4376-bd75-fb69ff961e46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:23:44.182194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:23:44.182194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:23:44.182194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:23:44.182194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:23:44.182194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:23:44.182194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:23:44.182194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:23:44.182194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:23:44.182194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:23:44.182194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:23:44.182194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:23:44.182194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:23:44.182194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:23:44.182194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:23:44.182194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:23:44.183448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:23:44.183448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:23:44.183448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:23:44.183448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:23:44.183448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:23:44.183448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:23:44.183448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:23:44.183448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:23:44.183448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:23:44.183448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:23:44.183448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:23:44.183448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:23:44.183448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:23:44.183448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:23:44.183448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:23:44.183448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:23:44.190815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:23:44.190815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:23:44.190815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:23:44.190815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:23:44.190815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:23:44.190815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:23:44.190815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:23:44.190815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:23:44.190815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:23:44.190815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:23:44.190815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:23:44.190815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:23:44.190815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 604/1208] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:23:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:23:44.191662 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089c01e-0e57-4d92-a4b0-4b2e18641dcf None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:44.252967 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:44.341808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089c01e-0e57-4d92-a4b0-4b2e18641dcf None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:44.407123 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf146aa-3239-4561-9705-6c27a539665f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:44.407909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf146aa-3239-4561-9705-6c27a539665f None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:44.408268 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf146aa-3239-4561-9705-6c27a539665f None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:44.408568 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf146aa-3239-4561-9705-6c27a539665f None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:44.409551 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf146aa-3239-4561-9705-6c27a539665f None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:23:44.409931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf146aa-3239-4561-9705-6c27a539665f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:44.411459 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf146aa-3239-4561-9705-6c27a539665f None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:44.421723 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 605/1209] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:23:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:23:44.427867 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67945c-dcae-4376-bd75-fb69ff961e46 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:44.491711 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:44.559052 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67945c-dcae-4376-bd75-fb69ff961e46 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:44.612433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62bb93-c945-4dbb-953a-e8748d2e0cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:44.613259 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62bb93-c945-4dbb-953a-e8748d2e0cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:44.613580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62bb93-c945-4dbb-953a-e8748d2e0cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:44.613937 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62bb93-c945-4dbb-953a-e8748d2e0cb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:44.625913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62bb93-c945-4dbb-953a-e8748d2e0cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:44.627453 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62bb93-c945-4dbb-953a-e8748d2e0cb5 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:44.649813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-fc62bb93-c945-4dbb-953a-e8748d2e0cb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:23:44.649813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:23:44.649813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:23:44.649813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:23:44.649813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:23:44.649813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:23:44.649813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:23:44.649813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:23:44.649813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:23:44.649813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:23:44.649813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:23:44.649813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:23:44.649813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:23:44.649813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:23:44.649813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:23:44.651164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:23:44.651164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:23:44.651164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:23:44.651164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:23:44.651164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:23:44.651164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:23:44.651164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:23:44.651164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:23:44.651164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:23:44.651164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:23:44.651164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:23:44.651164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:23:44.651164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:23:44.651164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:23:44.651164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:23:44.651164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:23:44.651164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:23:44.652224 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:23:44.652224 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:23:44.652224 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:23:44.652224 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:23:44.652224 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 605/1210] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:23:44.658057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf146aa-3239-4561-9705-6c27a539665f None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:44.779771 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:44.784922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf146aa-3239-4561-9705-6c27a539665f None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:44.828533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecd593-2b74-45ee-bb32-6e1552b7e431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:44.829453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecd593-2b74-45ee-bb32-6e1552b7e431 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:44.829811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecd593-2b74-45ee-bb32-6e1552b7e431 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:44.830183 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecd593-2b74-45ee-bb32-6e1552b7e431 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:44.831198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecd593-2b74-45ee-bb32-6e1552b7e431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:23:44.831565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecd593-2b74-45ee-bb32-6e1552b7e431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:44.833241 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecd593-2b74-45ee-bb32-6e1552b7e431 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:44.851276 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 606/1211] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:23:44.859047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62bb93-c945-4dbb-953a-e8748d2e0cb5 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:44.983544 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62bb93-c945-4dbb-953a-e8748d2e0cb5 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:44.985743 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:45.026133 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7766bc-db09-4dda-8e96-0bd3c3287b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:45.027313 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7766bc-db09-4dda-8e96-0bd3c3287b5c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:45.027770 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7766bc-db09-4dda-8e96-0bd3c3287b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:45.028260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7766bc-db09-4dda-8e96-0bd3c3287b5c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:45.038514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7766bc-db09-4dda-8e96-0bd3c3287b5c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:45.039991 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7766bc-db09-4dda-8e96-0bd3c3287b5c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:45.057636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-8a7766bc-db09-4dda-8e96-0bd3c3287b5c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 16:23:45.057636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:23:45.057636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:23:45.057636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:23:45.057636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:23:45.057636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:23:45.057636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:23:45.057636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:23:45.057636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:23:45.057636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:23:45.057636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:23:45.057636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:23:45.057636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:23:45.057636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:23:45.057636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:23:45.057636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:23:45.058915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:23:45.058915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:23:45.058915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:23:45.058915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:23:45.058915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:23:45.058915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:23:45.058915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:23:45.058915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:23:45.058915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:23:45.058915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:23:45.058915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:23:45.058915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:23:45.058915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:23:45.058915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:23:45.058915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:23:45.058915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:23:45.058915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:23:45.058915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:23:45.059929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:23:45.059929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:23:45.059929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:23:45.059929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:23:45.059929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:23:45.059929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:23:45.059929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:23:45.059929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:23:45.059929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 16:23:45.059929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:23:45.059929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 606/1212] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:23:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:23:45.066290 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecd593-2b74-45ee-bb32-6e1552b7e431 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:45.195586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecd593-2b74-45ee-bb32-6e1552b7e431 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:45.236492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dbe7f-a52d-42be-b724-1e0f9a99fa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:45.237130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dbe7f-a52d-42be-b724-1e0f9a99fa0c None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:45.237424 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dbe7f-a52d-42be-b724-1e0f9a99fa0c None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:45.237652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dbe7f-a52d-42be-b724-1e0f9a99fa0c None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:45.238617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5dbe7f-a52d-42be-b724-1e0f9a99fa0c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:23:45.238981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5dbe7f-a52d-42be-b724-1e0f9a99fa0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:45.240721 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5dbe7f-a52d-42be-b724-1e0f9a99fa0c None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:45.265898 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 607/1213] 10.222.0.41 () {56 vars in 1143 bytes} [Fri May 27 16:23:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:23:45.272404 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7766bc-db09-4dda-8e96-0bd3c3287b5c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:45.403079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7766bc-db09-4dda-8e96-0bd3c3287b5c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:45.444811 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061db99-daba-447c-997d-6fc3d64c0b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:45.445636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061db99-daba-447c-997d-6fc3d64c0b24 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:45.446044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061db99-daba-447c-997d-6fc3d64c0b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:45.446322 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061db99-daba-447c-997d-6fc3d64c0b24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:45.502774 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:45.554659 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061db99-daba-447c-997d-6fc3d64c0b24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:45.556232 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061db99-daba-447c-997d-6fc3d64c0b24 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:45.681344 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 607/1214] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:23:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:23:45.688046 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dbe7f-a52d-42be-b724-1e0f9a99fa0c None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:45.721043 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:45.837403 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dbe7f-a52d-42be-b724-1e0f9a99fa0c None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:45.881137 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622d0b8-bf84-4577-9fd9-b03b14a170db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:45.883092 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622d0b8-bf84-4577-9fd9-b03b14a170db None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:45.883468 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622d0b8-bf84-4577-9fd9-b03b14a170db None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:45.883892 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622d0b8-bf84-4577-9fd9-b03b14a170db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:45.903479 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622d0b8-bf84-4577-9fd9-b03b14a170db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:45.905015 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622d0b8-bf84-4577-9fd9-b03b14a170db None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:45.924134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-9622d0b8-bf84-4577-9fd9-b03b14a170db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:23:45.924134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:23:45.924134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:23:45.924134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:23:45.924134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:23:45.924134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:23:45.924134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:23:45.924134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:23:45.924134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:23:45.924134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:23:45.924134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:23:45.924134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:23:45.924134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:23:45.924134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:23:45.924134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:23:45.926171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:23:45.926171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:23:45.926171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:23:45.926171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:23:45.926171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:23:45.926171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:23:45.926171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:23:45.926171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:23:45.926171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:23:45.926171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:23:45.926171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:23:45.926171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:23:45.926171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:23:45.926171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:23:45.926171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:23:45.926171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:23:45.926171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:23:45.927438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:23:45.927438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:23:45.927438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:23:45.927438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:23:45.930177 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 608/1215] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:23:45.931173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061db99-daba-447c-997d-6fc3d64c0b24 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:46.011569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:46.071598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061db99-daba-447c-997d-6fc3d64c0b24 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:46.111643 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe37892-ab95-44d9-b4d1-e4e5e3465744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:46.112234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe37892-ab95-44d9-b4d1-e4e5e3465744 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:46.112514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe37892-ab95-44d9-b4d1-e4e5e3465744 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:46.112787 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe37892-ab95-44d9-b4d1-e4e5e3465744 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:46.113613 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe37892-ab95-44d9-b4d1-e4e5e3465744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:23:46.113923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe37892-ab95-44d9-b4d1-e4e5e3465744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:46.115395 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe37892-ab95-44d9-b4d1-e4e5e3465744 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:46.129706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 608/1216] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:23:46.135812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622d0b8-bf84-4577-9fd9-b03b14a170db None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:46.215272 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:46.253864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622d0b8-bf84-4577-9fd9-b03b14a170db None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:46.293567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb36220-8c12-407e-9466-e60fb07994c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:46.294547 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb36220-8c12-407e-9466-e60fb07994c6 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:46.294872 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb36220-8c12-407e-9466-e60fb07994c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:46.295254 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb36220-8c12-407e-9466-e60fb07994c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:46.303542 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb36220-8c12-407e-9466-e60fb07994c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:46.305105 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb36220-8c12-407e-9466-e60fb07994c6 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:46.321311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-deb36220-8c12-407e-9466-e60fb07994c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:23:46.321311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:23:46.321311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:23:46.321311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:23:46.321311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:23:46.321311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:23:46.321311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:23:46.321311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:23:46.321311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:23:46.321311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:23:46.321311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:23:46.321311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:23:46.321311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:23:46.321311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:23:46.321311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:23:46.322839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:23:46.322839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:23:46.322839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:23:46.322839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:23:46.322839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:23:46.322839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:23:46.322839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:23:46.322839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:23:46.322839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:23:46.322839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:23:46.322839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:23:46.322839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:23:46.322839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:23:46.322839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:23:46.322839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:23:46.322839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:23:46.322839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:23:46.323798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:23:46.323798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:23:46.323798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:23:46.323798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:23:46.323798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:23:46.323798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:23:46.323798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:23:46.323798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:23:46.328461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 609/1217] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:23:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:23:46.329617 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe37892-ab95-44d9-b4d1-e4e5e3465744 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:46.450705 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe37892-ab95-44d9-b4d1-e4e5e3465744 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:46.482378 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:46.498334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0dca8b-6aa4-4995-b28f-350587b168a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:46.499027 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dca8b-6aa4-4995-b28f-350587b168a3 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:46.499290 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dca8b-6aa4-4995-b28f-350587b168a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:46.499612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0dca8b-6aa4-4995-b28f-350587b168a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:46.500789 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0dca8b-6aa4-4995-b28f-350587b168a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:23:46.501104 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0dca8b-6aa4-4995-b28f-350587b168a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:46.502590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0dca8b-6aa4-4995-b28f-350587b168a3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:46.517061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 609/1218] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:23:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:23:46.523511 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb36220-8c12-407e-9466-e60fb07994c6 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:46.653083 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb36220-8c12-407e-9466-e60fb07994c6 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:46.688886 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:46.706509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eaae55-14b6-4439-b57e-9fd46126f4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:46.707119 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaae55-14b6-4439-b57e-9fd46126f4ea None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:46.707396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaae55-14b6-4439-b57e-9fd46126f4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:46.707664 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eaae55-14b6-4439-b57e-9fd46126f4ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:46.708525 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eaae55-14b6-4439-b57e-9fd46126f4ea None admin] RBAC: Adding query filter params (role.id=acbb2252c9f54cf8b789aa80f0a1fe85, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=1266a87d93da4f8d9a1ccafa03067169) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:23:46.708832 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eaae55-14b6-4439-b57e-9fd46126f4ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:46.710336 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eaae55-14b6-4439-b57e-9fd46126f4ea None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:46.717119 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 610/1219] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:23:46 2022] GET /identity/v3/role_assignments?user.id=1266a87d93da4f8d9a1ccafa03067169&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=acbb2252c9f54cf8b789aa80f0a1fe85 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:23:49.097706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d61c9-d99b-47b0-ab4c-004c93f2f36f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:49.098302 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d61c9-d99b-47b0-ab4c-004c93f2f36f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:49.098302 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d61c9-d99b-47b0-ab4c-004c93f2f36f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:49.099660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 610/1220] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:23:49.107799 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ab323-c50f-44c3-9ca0-5febf785805d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:49.108425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ab323-c50f-44c3-9ca0-5febf785805d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:49.109436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ab323-c50f-44c3-9ca0-5febf785805d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:49.130426 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-aa9ab323-c50f-44c3-9ca0-5febf785805d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:23:49.131792 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-aa9ab323-c50f-44c3-9ca0-5febf785805d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:23:49.212231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 611/1221] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:23:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:23:49.237374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d61c9-d99b-47b0-ab4c-004c93f2f36f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:49.371175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d61c9-d99b-47b0-ab4c-004c93f2f36f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:49.417725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79b740-6e7b-4ba1-bd1f-f3e41f59be2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:49.418647 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79b740-6e7b-4ba1-bd1f-f3e41f59be2b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:49.418967 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79b740-6e7b-4ba1-bd1f-f3e41f59be2b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:49.419237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79b740-6e7b-4ba1-bd1f-f3e41f59be2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:49.432219 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79b740-6e7b-4ba1-bd1f-f3e41f59be2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:23:49.441715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-0b79b740-6e7b-4ba1-bd1f-f3e41f59be2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:23:49.441715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:23:49.441715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:23:49.441715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:23:49.441715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:23:49.441715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:23:49.441715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:23:49.441715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:23:49.441715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:23:49.441715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:23:49.441715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:23:49.441715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:23:49.441715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:23:49.441715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:23:49.441715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:23:49.441715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:23:49.443630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:23:49.443630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:23:49.443630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:23:49.443630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:23:49.443630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:23:49.443630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:23:49.443630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:23:49.443630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:23:49.443630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:23:49.443630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:23:49.443630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:23:49.443630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:23:49.443630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:23:49.443630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:23:49.443630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:23:49.443630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:23:49.445567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:23:49.445567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:23:49.445567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:23:49.445567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:23:49.445567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:23:49.445567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:23:49.445567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:23:49.445567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:23:49.445567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:23:49.445567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:23:49.445567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:23:49.445567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:23:49.445567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 611/1222] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:23:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:23:49.451078 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ab323-c50f-44c3-9ca0-5febf785805d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:49.579487 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ab323-c50f-44c3-9ca0-5febf785805d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:49.607512 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:49.619880 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2c163-8932-4f4b-8e20-57b26d01bd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:49.620634 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2c163-8932-4f4b-8e20-57b26d01bd28 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:49.620926 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2c163-8932-4f4b-8e20-57b26d01bd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:49.621255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2c163-8932-4f4b-8e20-57b26d01bd28 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:49.621951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2c163-8932-4f4b-8e20-57b26d01bd28 None admin] RBAC: Adding query filter params (name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:23:49.622279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2c163-8932-4f4b-8e20-57b26d01bd28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:49.623774 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2c163-8932-4f4b-8e20-57b26d01bd28 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:49.633345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 612/1223] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:23:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:23:49.639826 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79b740-6e7b-4ba1-bd1f-f3e41f59be2b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:49.698880 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:49.776446 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79b740-6e7b-4ba1-bd1f-f3e41f59be2b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:49.818211 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d25e6-aca9-41ff-b594-15cfaa6e35cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:49.819178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d25e6-aca9-41ff-b594-15cfaa6e35cc None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:49.819467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d25e6-aca9-41ff-b594-15cfaa6e35cc None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:49.819762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d25e6-aca9-41ff-b594-15cfaa6e35cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:49.839189 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d25e6-aca9-41ff-b594-15cfaa6e35cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:49.840749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d25e6-aca9-41ff-b594-15cfaa6e35cc None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:49.860438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-310d25e6-aca9-41ff-b594-15cfaa6e35cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:23:49.860438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:23:49.860438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:23:49.860438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:23:49.860438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:23:49.860438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:23:49.860438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:23:49.860438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:23:49.860438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:23:49.860438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:23:49.860438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:23:49.860438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:23:49.860438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:23:49.860438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:23:49.860438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:23:49.861536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:23:49.861536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:23:49.861536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:23:49.861536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:23:49.861536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:23:49.861536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:23:49.861536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:23:49.861536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:23:49.861536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:23:49.861536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:23:49.861536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:23:49.861536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:23:49.861536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:23:49.861536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:23:49.861536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:23:49.861536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:23:49.861536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:23:49.862464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:23:49.862464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:23:49.862464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:23:49.862464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:23:49.862464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 612/1224] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:23:49.867992 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2c163-8932-4f4b-8e20-57b26d01bd28 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:49.987880 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2c163-8932-4f4b-8e20-57b26d01bd28 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:50.027240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6854b5-2ef2-4ca6-a946-6b35be001da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:50.028102 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6854b5-2ef2-4ca6-a946-6b35be001da2 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:50.028406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6854b5-2ef2-4ca6-a946-6b35be001da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:50.028754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6854b5-2ef2-4ca6-a946-6b35be001da2 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:50.029556 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6854b5-2ef2-4ca6-a946-6b35be001da2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:23:50.029978 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6854b5-2ef2-4ca6-a946-6b35be001da2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:50.031812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6854b5-2ef2-4ca6-a946-6b35be001da2 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:50.046974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 613/1225] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:23:50.053014 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d25e6-aca9-41ff-b594-15cfaa6e35cc None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:50.171415 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:50.183766 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d25e6-aca9-41ff-b594-15cfaa6e35cc None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:50.224322 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6a588-bd26-4f83-8468-0b9157fd17cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:50.225144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6a588-bd26-4f83-8468-0b9157fd17cc None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:50.225425 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6a588-bd26-4f83-8468-0b9157fd17cc None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:50.225702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6a588-bd26-4f83-8468-0b9157fd17cc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:50.234234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6a588-bd26-4f83-8468-0b9157fd17cc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:50.238594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6a588-bd26-4f83-8468-0b9157fd17cc None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:50.252792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-1ce6a588-bd26-4f83-8468-0b9157fd17cc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 16:23:50.252792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:23:50.252792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:23:50.252792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:23:50.252792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:23:50.252792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:23:50.252792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:23:50.252792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:23:50.252792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:23:50.252792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:23:50.252792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:23:50.252792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:23:50.252792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:23:50.252792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:23:50.252792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:23:50.252792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:23:50.254677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:23:50.254677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:23:50.254677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:23:50.254677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:23:50.254677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:23:50.254677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:23:50.254677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:23:50.254677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:23:50.254677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:23:50.254677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:23:50.254677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:23:50.254677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:23:50.254677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:23:50.254677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:23:50.254677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:23:50.254677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:23:50.254677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:23:50.254677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:23:50.255773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:23:50.255773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:23:50.255773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:23:50.255773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:23:50.255773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:23:50.255773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:23:50.255773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:23:50.255773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:23:50.255773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 16:23:50.255773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:23:50.255773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 613/1226] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:23:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:23:50.261804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6854b5-2ef2-4ca6-a946-6b35be001da2 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:50.318468 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:50.387402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6854b5-2ef2-4ca6-a946-6b35be001da2 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:50.427253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19787d-aa5d-484a-869e-a52481545b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:50.427937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19787d-aa5d-484a-869e-a52481545b3b None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:50.428241 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19787d-aa5d-484a-869e-a52481545b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:50.428510 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19787d-aa5d-484a-869e-a52481545b3b None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:50.429345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19787d-aa5d-484a-869e-a52481545b3b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:23:50.429653 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19787d-aa5d-484a-869e-a52481545b3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:50.431126 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19787d-aa5d-484a-869e-a52481545b3b None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:50.452710 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 614/1227] 10.222.0.41 () {56 vars in 1143 bytes} [Fri May 27 16:23:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:23:50.458488 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6a588-bd26-4f83-8468-0b9157fd17cc None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:50.579334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6a588-bd26-4f83-8468-0b9157fd17cc None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:50.633459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9af8cc-dc54-4c92-9251-b9dd193714e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:50.634578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9af8cc-dc54-4c92-9251-b9dd193714e6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:50.634932 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9af8cc-dc54-4c92-9251-b9dd193714e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:50.635367 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9af8cc-dc54-4c92-9251-b9dd193714e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:50.652651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9af8cc-dc54-4c92-9251-b9dd193714e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:50.655367 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9af8cc-dc54-4c92-9251-b9dd193714e6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:50.678532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-8c9af8cc-dc54-4c92-9251-b9dd193714e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:23:50.678532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:23:50.678532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:23:50.678532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:23:50.678532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:23:50.678532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:23:50.678532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:23:50.678532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:23:50.678532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:23:50.678532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:23:50.678532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:23:50.678532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:23:50.678532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:23:50.678532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:23:50.678532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:23:50.679810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:23:50.679810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:23:50.679810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:23:50.679810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:23:50.679810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:23:50.679810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:23:50.679810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:23:50.679810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:23:50.679810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:23:50.679810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:23:50.679810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:23:50.679810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:23:50.679810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:23:50.679810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:23:50.679810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:23:50.679810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:23:50.679810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:23:50.687866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:23:50.687866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:23:50.687866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:23:50.687866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:23:50.687866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 614/1228] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:23:50.688253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19787d-aa5d-484a-869e-a52481545b3b None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:50.808224 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19787d-aa5d-484a-869e-a52481545b3b None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:50.811117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:50.852430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc598a9-b5a5-49a0-b060-0fa53a9bc0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:50.853199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc598a9-b5a5-49a0-b060-0fa53a9bc0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:50.853558 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc598a9-b5a5-49a0-b060-0fa53a9bc0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:50.853913 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc598a9-b5a5-49a0-b060-0fa53a9bc0a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:50.854970 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc598a9-b5a5-49a0-b060-0fa53a9bc0a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:23:50.855354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc598a9-b5a5-49a0-b060-0fa53a9bc0a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:50.857649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc598a9-b5a5-49a0-b060-0fa53a9bc0a1 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:50.876842 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 615/1229] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:23:50.883988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9af8cc-dc54-4c92-9251-b9dd193714e6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:50.897282 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:51.025391 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9af8cc-dc54-4c92-9251-b9dd193714e6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:51.067869 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08116e63-ddcc-411f-9429-b18049af1ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:51.069362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08116e63-ddcc-411f-9429-b18049af1ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:51.069869 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08116e63-ddcc-411f-9429-b18049af1ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:51.070369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08116e63-ddcc-411f-9429-b18049af1ff1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:51.080259 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08116e63-ddcc-411f-9429-b18049af1ff1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:51.081998 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08116e63-ddcc-411f-9429-b18049af1ff1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:51.102376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-08116e63-ddcc-411f-9429-b18049af1ff1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:23:51.102376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:23:51.102376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:23:51.102376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:23:51.102376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:23:51.102376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:23:51.102376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:23:51.102376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:23:51.102376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:23:51.102376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:23:51.102376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:23:51.102376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:23:51.102376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:23:51.102376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:23:51.102376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:23:51.104368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:23:51.104368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:23:51.104368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:23:51.104368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:23:51.104368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:23:51.104368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:23:51.104368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:23:51.104368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:23:51.104368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:23:51.104368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:23:51.104368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:23:51.104368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:23:51.104368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:23:51.104368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:23:51.104368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:23:51.104368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:23:51.104368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:23:51.105896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:23:51.105896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:23:51.105896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:23:51.105896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:23:51.105896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:23:51.105896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:23:51.105896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:23:51.105896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:23:51.105896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 615/1230] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:23:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:23:51.110342 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc598a9-b5a5-49a0-b060-0fa53a9bc0a1 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:51.235038 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc598a9-b5a5-49a0-b060-0fa53a9bc0a1 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:51.282943 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fb827-972b-4228-8faa-8b468556ce03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:51.284001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fb827-972b-4228-8faa-8b468556ce03 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:51.284471 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fb827-972b-4228-8faa-8b468556ce03 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:51.284853 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fb827-972b-4228-8faa-8b468556ce03 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:51.286132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fb827-972b-4228-8faa-8b468556ce03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:23:51.286451 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fb827-972b-4228-8faa-8b468556ce03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:51.288862 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fb827-972b-4228-8faa-8b468556ce03 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:51.306714 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 616/1231] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:23:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:23:51.314441 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08116e63-ddcc-411f-9429-b18049af1ff1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:51.396973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:51.444387 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08116e63-ddcc-411f-9429-b18049af1ff1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:51.501669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6f431-5f2b-44f3-9c0b-efdbdcc638f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:51.502604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6f431-5f2b-44f3-9c0b-efdbdcc638f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:51.502865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6f431-5f2b-44f3-9c0b-efdbdcc638f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:51.503180 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6f431-5f2b-44f3-9c0b-efdbdcc638f3 None admin] PATH_INFO: `/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/1266a87d93da4f8d9a1ccafa03067169/roles/acbb2252c9f54cf8b789aa80f0a1fe85` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:51.524853 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6f431-5f2b-44f3-9c0b-efdbdcc638f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5c551b621342e5a5a6e742d673d525, user_id=1266a87d93da4f8d9a1ccafa03067169, role_id=acbb2252c9f54cf8b789aa80f0a1fe85)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:51.526352 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6f431-5f2b-44f3-9c0b-efdbdcc638f3 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:51.543494 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 616/1232] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:23:51 2022] PUT /identity/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/1266a87d93da4f8d9a1ccafa03067169/roles/acbb2252c9f54cf8b789aa80f0a1fe85 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:23:53.955155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b1ac-82e2-4648-add3-77f1729454a4 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:53.955728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b1ac-82e2-4648-add3-77f1729454a4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:53.955728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b1ac-82e2-4648-add3-77f1729454a4 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:53.957139 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 617/1233] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:23:53.964453 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c99a6-c761-455e-aac9-8452754ac0ae None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:53.965079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c99a6-c761-455e-aac9-8452754ac0ae None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:53.965079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c99a6-c761-455e-aac9-8452754ac0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:53.987495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9a4c99a6-c761-455e-aac9-8452754ac0ae None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:23:53.988792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9a4c99a6-c761-455e-aac9-8452754ac0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:23:54.083467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 617/1234] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:23:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:23:54.108621 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80b1ac-82e2-4648-add3-77f1729454a4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:54.146352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:54.245959 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80b1ac-82e2-4648-add3-77f1729454a4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:54.290651 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488503e-bb63-40cc-885e-3585bbd6ea79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:54.291589 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488503e-bb63-40cc-885e-3585bbd6ea79 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:54.291880 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488503e-bb63-40cc-885e-3585bbd6ea79 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:54.292234 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488503e-bb63-40cc-885e-3585bbd6ea79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:54.304896 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488503e-bb63-40cc-885e-3585bbd6ea79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:23:54.313457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a488503e-bb63-40cc-885e-3585bbd6ea79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 16:23:54.313457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:23:54.313457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:23:54.313457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:23:54.313457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:23:54.313457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:23:54.313457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:23:54.313457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:23:54.313457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:23:54.313457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:23:54.313457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:23:54.313457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:23:54.313457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:23:54.313457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:23:54.313457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:23:54.313457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:23:54.315444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:23:54.315444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:23:54.315444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:23:54.315444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:23:54.315444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:23:54.315444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:23:54.315444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:23:54.315444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:23:54.315444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:23:54.315444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:23:54.315444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:23:54.315444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:23:54.315444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:23:54.315444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:23:54.315444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:23:54.315444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:23:54.317452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:23:54.317452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:23:54.317452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:23:54.317452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:23:54.317452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:23:54.317452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:23:54.317452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:23:54.317452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:23:54.317452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:23:54.317452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:23:54.317452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 16:23:54.317452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:23:54.317452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 618/1235] 10.222.0.41 () {56 vars in 1102 bytes} [Fri May 27 16:23:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:23:54.321390 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c99a6-c761-455e-aac9-8452754ac0ae None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:54.378095 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:54.466877 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c99a6-c761-455e-aac9-8452754ac0ae None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:54.507168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d604e3b-5b6d-4751-bf21-d176128de2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:54.507782 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d604e3b-5b6d-4751-bf21-d176128de2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:54.508128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d604e3b-5b6d-4751-bf21-d176128de2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:54.508377 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d604e3b-5b6d-4751-bf21-d176128de2e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:54.509144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d604e3b-5b6d-4751-bf21-d176128de2e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:23:54.509452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d604e3b-5b6d-4751-bf21-d176128de2e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:54.510883 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d604e3b-5b6d-4751-bf21-d176128de2e7 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:54.520444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 618/1236] 10.222.0.41 () {56 vars in 1103 bytes} [Fri May 27 16:23:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:23:54.529572 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488503e-bb63-40cc-885e-3585bbd6ea79 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:54.682574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:54.711718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488503e-bb63-40cc-885e-3585bbd6ea79 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:54.772824 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864e8cf-9f94-48a9-abe7-6ea155a8c957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:54.774063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864e8cf-9f94-48a9-abe7-6ea155a8c957 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:54.774533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864e8cf-9f94-48a9-abe7-6ea155a8c957 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:54.774998 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864e8cf-9f94-48a9-abe7-6ea155a8c957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:54.791767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864e8cf-9f94-48a9-abe7-6ea155a8c957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:54.794007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864e8cf-9f94-48a9-abe7-6ea155a8c957 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:54.816834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-b864e8cf-9f94-48a9-abe7-6ea155a8c957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:23:54.816834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:23:54.816834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:23:54.816834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:23:54.816834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:23:54.816834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:23:54.816834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:23:54.816834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:23:54.816834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:23:54.816834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:23:54.816834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:23:54.816834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:23:54.816834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:23:54.816834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:23:54.816834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:23:54.818744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:23:54.818744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:23:54.818744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:23:54.818744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:23:54.818744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:23:54.818744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:23:54.818744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:23:54.818744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:23:54.818744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:23:54.818744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:23:54.818744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:23:54.818744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:23:54.818744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:23:54.818744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:23:54.818744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:23:54.818744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:23:54.818744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:23:54.820536 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:23:54.820536 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:23:54.820536 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:23:54.820536 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:23:54.820536 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 619/1237] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:23:54.824732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d604e3b-5b6d-4751-bf21-d176128de2e7 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:54.948952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d604e3b-5b6d-4751-bf21-d176128de2e7 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:54.965655 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:55.002390 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00d86d-d3e8-466a-8cb2-8883354dfd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:55.003086 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00d86d-d3e8-466a-8cb2-8883354dfd9b None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:55.003371 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00d86d-d3e8-466a-8cb2-8883354dfd9b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:55.003684 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00d86d-d3e8-466a-8cb2-8883354dfd9b None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:55.004425 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00d86d-d3e8-466a-8cb2-8883354dfd9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:23:55.004734 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00d86d-d3e8-466a-8cb2-8883354dfd9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:55.006255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00d86d-d3e8-466a-8cb2-8883354dfd9b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:55.023407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 619/1238] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:23:55.029498 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864e8cf-9f94-48a9-abe7-6ea155a8c957 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:55.155592 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864e8cf-9f94-48a9-abe7-6ea155a8c957 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:55.199345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33477ecb-6425-4eb2-b566-70461853501d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:55.200214 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33477ecb-6425-4eb2-b566-70461853501d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:55.200495 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33477ecb-6425-4eb2-b566-70461853501d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:55.200764 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33477ecb-6425-4eb2-b566-70461853501d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:55.204790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:55.211571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33477ecb-6425-4eb2-b566-70461853501d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:55.213798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33477ecb-6425-4eb2-b566-70461853501d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:55.237220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-33477ecb-6425-4eb2-b566-70461853501d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 16:23:55.237220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:23:55.237220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:23:55.237220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:23:55.237220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:23:55.237220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:23:55.237220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:23:55.237220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:23:55.237220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:23:55.237220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:23:55.237220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:23:55.237220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:23:55.237220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:23:55.237220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:23:55.237220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:23:55.237220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:23:55.240540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:23:55.240540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:23:55.240540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:23:55.240540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:23:55.240540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:23:55.240540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:23:55.240540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:23:55.240540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:23:55.240540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:23:55.240540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:23:55.240540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:23:55.240540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:23:55.240540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:23:55.240540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:23:55.240540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:23:55.240540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:23:55.240540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:23:55.240540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:23:55.241575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:23:55.241575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:23:55.241575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:23:55.241575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:23:55.241575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:23:55.241575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:23:55.241575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:23:55.241575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:23:55.241575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 16:23:55.241575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:23:55.241575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 620/1239] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:23:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:23:55.246356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00d86d-d3e8-466a-8cb2-8883354dfd9b None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:55.366178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00d86d-d3e8-466a-8cb2-8883354dfd9b None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:55.403968 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d7d13-bd0c-4e4e-b95d-29c74cc0ff41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:55.404704 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d7d13-bd0c-4e4e-b95d-29c74cc0ff41 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:55.404954 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d7d13-bd0c-4e4e-b95d-29c74cc0ff41 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:55.405224 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d7d13-bd0c-4e4e-b95d-29c74cc0ff41 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:55.406145 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d7d13-bd0c-4e4e-b95d-29c74cc0ff41 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:23:55.406449 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d7d13-bd0c-4e4e-b95d-29c74cc0ff41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:55.407940 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d7d13-bd0c-4e4e-b95d-29c74cc0ff41 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:55.426894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 620/1240] 10.222.0.41 () {56 vars in 1143 bytes} [Fri May 27 16:23:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:23:55.432814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33477ecb-6425-4eb2-b566-70461853501d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:55.546220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33477ecb-6425-4eb2-b566-70461853501d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:55.583173 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bd8a9-7e3f-4301-9fd4-ea2b62f39eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:55.583855 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bd8a9-7e3f-4301-9fd4-ea2b62f39eee None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:55.584158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bd8a9-7e3f-4301-9fd4-ea2b62f39eee None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:55.584442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bd8a9-7e3f-4301-9fd4-ea2b62f39eee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:55.668904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:55.677201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bd8a9-7e3f-4301-9fd4-ea2b62f39eee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:55.678972 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bd8a9-7e3f-4301-9fd4-ea2b62f39eee None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:55.784901 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 621/1241] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:23:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:23:55.791470 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d7d13-bd0c-4e4e-b95d-29c74cc0ff41 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:55.824025 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:55.919915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d7d13-bd0c-4e4e-b95d-29c74cc0ff41 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:55.970618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f8c35-3069-4347-8987-286150c988ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:55.971621 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f8c35-3069-4347-8987-286150c988ab None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:55.971987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f8c35-3069-4347-8987-286150c988ab None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:55.972382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f8c35-3069-4347-8987-286150c988ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:55.996135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f8c35-3069-4347-8987-286150c988ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:56.000127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f8c35-3069-4347-8987-286150c988ab None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:56.040611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-563f8c35-3069-4347-8987-286150c988ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:23:56.040611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:23:56.040611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:23:56.040611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:23:56.040611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:23:56.040611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:23:56.040611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:23:56.040611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:23:56.040611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:23:56.040611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:23:56.040611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:23:56.040611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:23:56.040611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:23:56.040611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:23:56.040611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:23:56.042037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:23:56.042037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:23:56.042037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:23:56.042037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:23:56.042037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:23:56.042037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:23:56.042037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:23:56.042037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:23:56.042037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:23:56.042037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:23:56.042037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:23:56.042037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:23:56.042037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:23:56.042037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:23:56.042037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:23:56.042037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:23:56.042037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:23:56.048128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:23:56.048128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:23:56.048128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:23:56.048128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:23:56.048128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 621/1242] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:23:56.049722 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bd8a9-7e3f-4301-9fd4-ea2b62f39eee None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:56.185117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:56.194880 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bd8a9-7e3f-4301-9fd4-ea2b62f39eee None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:56.251198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2471f36-3bd0-414b-afdc-989758f4c8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:56.251894 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2471f36-3bd0-414b-afdc-989758f4c8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:56.252206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2471f36-3bd0-414b-afdc-989758f4c8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:56.252485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2471f36-3bd0-414b-afdc-989758f4c8d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:56.253374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2471f36-3bd0-414b-afdc-989758f4c8d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:23:56.253689 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2471f36-3bd0-414b-afdc-989758f4c8d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:56.255279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2471f36-3bd0-414b-afdc-989758f4c8d7 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:56.270023 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 622/1243] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:23:56.276253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f8c35-3069-4347-8987-286150c988ab None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:56.375243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:56.399570 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f8c35-3069-4347-8987-286150c988ab None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:56.446638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f2b12-76b6-46d6-9cbf-5668d017b0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:56.447381 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f2b12-76b6-46d6-9cbf-5668d017b0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:56.447662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f2b12-76b6-46d6-9cbf-5668d017b0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:56.447934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f2b12-76b6-46d6-9cbf-5668d017b0c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:56.456289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f2b12-76b6-46d6-9cbf-5668d017b0c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:56.457815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f2b12-76b6-46d6-9cbf-5668d017b0c1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:56.473319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-1b6f2b12-76b6-46d6-9cbf-5668d017b0c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:23:56.473319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:23:56.473319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:23:56.473319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:23:56.473319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:23:56.473319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:23:56.473319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:23:56.473319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:23:56.473319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:23:56.473319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:23:56.473319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:23:56.473319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:23:56.473319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:23:56.473319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:23:56.473319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:23:56.474834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:23:56.474834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:23:56.474834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:23:56.474834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:23:56.474834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:23:56.474834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:23:56.474834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:23:56.474834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:23:56.474834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:23:56.474834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:23:56.474834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:23:56.474834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:23:56.474834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:23:56.474834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:23:56.474834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:23:56.474834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:23:56.474834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:23:56.475745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:23:56.475745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:23:56.475745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:23:56.475745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:23:56.475745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:23:56.475745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:23:56.475745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:23:56.475745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:23:56.475745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 622/1244] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:23:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:23:56.484575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2471f36-3bd0-414b-afdc-989758f4c8d7 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:56.636614 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2471f36-3bd0-414b-afdc-989758f4c8d7 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:56.685479 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa358f56-4b16-477d-92b9-4a7ad8f24b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:56.687267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa358f56-4b16-477d-92b9-4a7ad8f24b01 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:56.687713 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa358f56-4b16-477d-92b9-4a7ad8f24b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:56.688237 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa358f56-4b16-477d-92b9-4a7ad8f24b01 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:56.689350 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa358f56-4b16-477d-92b9-4a7ad8f24b01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:23:56.689987 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa358f56-4b16-477d-92b9-4a7ad8f24b01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:56.692912 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa358f56-4b16-477d-92b9-4a7ad8f24b01 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:56.715428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 623/1245] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:23:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:23:56.722785 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f2b12-76b6-46d6-9cbf-5668d017b0c1 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:56.850696 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f2b12-76b6-46d6-9cbf-5668d017b0c1 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:56.903881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ae693-8bdb-49e3-9754-def7c9a47630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:56.908696 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ae693-8bdb-49e3-9754-def7c9a47630 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:56.909285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ae693-8bdb-49e3-9754-def7c9a47630 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:56.909769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ae693-8bdb-49e3-9754-def7c9a47630 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:56.910964 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ae693-8bdb-49e3-9754-def7c9a47630 None admin] RBAC: Adding query filter params (role.id=acbb2252c9f54cf8b789aa80f0a1fe85, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=1266a87d93da4f8d9a1ccafa03067169) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:23:56.911533 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ae693-8bdb-49e3-9754-def7c9a47630 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:23:56.913833 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ae693-8bdb-49e3-9754-def7c9a47630 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:23:56.925168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 623/1246] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:23:56 2022] GET /identity/v3/role_assignments?user.id=1266a87d93da4f8d9a1ccafa03067169&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=acbb2252c9f54cf8b789aa80f0a1fe85 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:23:59.510265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ec2f9-c377-41aa-a546-89b6021337c1 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:59.510949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ec2f9-c377-41aa-a546-89b6021337c1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:59.511484 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ec2f9-c377-41aa-a546-89b6021337c1 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:59.514095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 624/1247] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:23:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:23:59.521934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26002ef2-adad-45f0-9900-1d0aa34b3d6c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:59.522482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26002ef2-adad-45f0-9900-1d0aa34b3d6c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:59.522482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26002ef2-adad-45f0-9900-1d0aa34b3d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:59.528225 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:59.542177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-26002ef2-adad-45f0-9900-1d0aa34b3d6c None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:23:59.543277 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-26002ef2-adad-45f0-9900-1d0aa34b3d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:23:59.628918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 624/1248] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:23:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:23:59.654228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ec2f9-c377-41aa-a546-89b6021337c1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:23:59.686804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:23:59.808083 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ec2f9-c377-41aa-a546-89b6021337c1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:23:59.851953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de80fc1-871a-4dc3-b275-09300448d894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:23:59.852992 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de80fc1-871a-4dc3-b275-09300448d894 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:23:59.853387 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de80fc1-871a-4dc3-b275-09300448d894 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:23:59.853718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de80fc1-871a-4dc3-b275-09300448d894 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:23:59.868663 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de80fc1-871a-4dc3-b275-09300448d894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:23:59.876672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8de80fc1-871a-4dc3-b275-09300448d894 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:23:59.876672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:23:59.876672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:23:59.876672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:23:59.876672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:23:59.876672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:23:59.876672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:23:59.876672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:23:59.876672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:23:59.876672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:23:59.876672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:23:59.876672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:23:59.876672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:23:59.876672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:23:59.876672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:23:59.876672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:23:59.877922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:23:59.877922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:23:59.877922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:23:59.877922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:23:59.877922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:23:59.877922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:23:59.877922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:23:59.877922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:23:59.877922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:23:59.877922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:23:59.877922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:23:59.877922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:23:59.877922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:23:59.877922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:23:59.877922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:23:59.877922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:23:59.878838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:23:59.878838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:23:59.878838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:23:59.878838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:23:59.878838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:23:59.878838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:23:59.878838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:23:59.878838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:23:59.878838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:23:59.878838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:23:59.878838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:23:59.878838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:23:59.878838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 625/1249] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:23:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:23:59.887194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26002ef2-adad-45f0-9900-1d0aa34b3d6c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:00.033883 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26002ef2-adad-45f0-9900-1d0aa34b3d6c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:00.069869 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:00.076178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6753a5-5e52-49a7-acf1-1ded2af594a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:00.077576 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6753a5-5e52-49a7-acf1-1ded2af594a6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:00.077985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6753a5-5e52-49a7-acf1-1ded2af594a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:00.078264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6753a5-5e52-49a7-acf1-1ded2af594a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:00.079126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6753a5-5e52-49a7-acf1-1ded2af594a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:00.079433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6753a5-5e52-49a7-acf1-1ded2af594a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:00.080878 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6753a5-5e52-49a7-acf1-1ded2af594a6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:00.090651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 625/1250] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:23:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:00.097047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de80fc1-871a-4dc3-b275-09300448d894 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:00.183327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:00.211166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de80fc1-871a-4dc3-b275-09300448d894 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:00.253351 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4cf2d-2041-4307-963f-e55b376910cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:00.258745 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4cf2d-2041-4307-963f-e55b376910cf None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:00.258745 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4cf2d-2041-4307-963f-e55b376910cf None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:00.258745 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4cf2d-2041-4307-963f-e55b376910cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:00.269965 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4cf2d-2041-4307-963f-e55b376910cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:00.272091 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4cf2d-2041-4307-963f-e55b376910cf None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:00.301567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-4bc4cf2d-2041-4307-963f-e55b376910cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:24:00.301567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:00.301567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:24:00.301567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:24:00.301567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:24:00.301567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:24:00.301567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:24:00.301567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:24:00.301567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:24:00.301567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:24:00.301567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:24:00.301567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:24:00.301567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:24:00.301567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:24:00.301567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:24:00.303517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:24:00.303517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:24:00.303517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:24:00.303517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:24:00.303517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:24:00.303517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:24:00.303517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:24:00.303517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:24:00.303517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:24:00.303517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:24:00.303517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:24:00.303517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:24:00.303517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:24:00.303517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:24:00.303517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:24:00.303517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:24:00.303517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:24:00.305498 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:24:00.305498 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:24:00.305498 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:24:00.305498 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:24:00.305498 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 626/1251] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 16:24:00.314598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6753a5-5e52-49a7-acf1-1ded2af594a6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:00.448563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6753a5-5e52-49a7-acf1-1ded2af594a6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:00.500684 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560fe48-3f29-42a0-ae50-43027a888497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:00.501545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560fe48-3f29-42a0-ae50-43027a888497 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:00.501993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560fe48-3f29-42a0-ae50-43027a888497 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:00.502425 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560fe48-3f29-42a0-ae50-43027a888497 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:00.503422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560fe48-3f29-42a0-ae50-43027a888497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:00.503820 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560fe48-3f29-42a0-ae50-43027a888497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:00.505711 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560fe48-3f29-42a0-ae50-43027a888497 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:00.524336 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 626/1252] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:00.529061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4cf2d-2041-4307-963f-e55b376910cf None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:00.651934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4cf2d-2041-4307-963f-e55b376910cf None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:00.683346 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:00.695926 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9f509-90dc-4b82-b8f9-9794ad78a2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:00.696792 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9f509-90dc-4b82-b8f9-9794ad78a2fd None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:00.697076 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9f509-90dc-4b82-b8f9-9794ad78a2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:00.697348 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9f509-90dc-4b82-b8f9-9794ad78a2fd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:00.706484 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9f509-90dc-4b82-b8f9-9794ad78a2fd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:00.707853 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9f509-90dc-4b82-b8f9-9794ad78a2fd None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:00.725172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-2aa9f509-90dc-4b82-b8f9-9794ad78a2fd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 16:24:00.725172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:00.725172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:24:00.725172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:24:00.725172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:24:00.725172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:24:00.725172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:24:00.725172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:24:00.725172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:24:00.725172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:24:00.725172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:24:00.725172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:24:00.725172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:24:00.725172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:24:00.725172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:24:00.725172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:24:00.726450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:24:00.726450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:24:00.726450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:24:00.726450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:24:00.726450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:24:00.726450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:24:00.726450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:24:00.726450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:24:00.726450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:24:00.726450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:24:00.726450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:24:00.726450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:24:00.726450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:24:00.726450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:24:00.726450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:24:00.726450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:24:00.726450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:24:00.726450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:24:00.727631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:24:00.727631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:24:00.727631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:24:00.727631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:24:00.727631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:24:00.727631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:24:00.727631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:24:00.727631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:24:00.727631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 16:24:00.727631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:24:00.727631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 627/1253] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:24:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:24:00.733155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560fe48-3f29-42a0-ae50-43027a888497 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:00.817688 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:00.884993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560fe48-3f29-42a0-ae50-43027a888497 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:00.928335 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82148b44-6926-482d-b731-b094904dd63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:00.929167 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82148b44-6926-482d-b731-b094904dd63a None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:00.929498 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82148b44-6926-482d-b731-b094904dd63a None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:00.929847 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82148b44-6926-482d-b731-b094904dd63a None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:00.930786 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82148b44-6926-482d-b731-b094904dd63a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:00.931168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82148b44-6926-482d-b731-b094904dd63a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:00.932903 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82148b44-6926-482d-b731-b094904dd63a None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:00.956422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 627/1254] 10.222.0.41 () {56 vars in 1143 bytes} [Fri May 27 16:24:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:00.963463 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9f509-90dc-4b82-b8f9-9794ad78a2fd None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:01.088646 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9f509-90dc-4b82-b8f9-9794ad78a2fd None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:01.131332 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef22ad-cfa5-4fe4-a4d7-d768170047d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:01.132073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef22ad-cfa5-4fe4-a4d7-d768170047d0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:01.132361 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef22ad-cfa5-4fe4-a4d7-d768170047d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:01.132629 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef22ad-cfa5-4fe4-a4d7-d768170047d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:01.203118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:01.220283 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef22ad-cfa5-4fe4-a4d7-d768170047d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:01.220711 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef22ad-cfa5-4fe4-a4d7-d768170047d0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:01.345079 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 628/1255] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:24:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 16:24:01.352045 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82148b44-6926-482d-b731-b094904dd63a None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:01.508129 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82148b44-6926-482d-b731-b094904dd63a None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:01.524718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:01.564294 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cda38c-fdf4-4abf-a8ab-9e4499c28d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:01.565214 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cda38c-fdf4-4abf-a8ab-9e4499c28d4c None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:01.565487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cda38c-fdf4-4abf-a8ab-9e4499c28d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:01.566040 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cda38c-fdf4-4abf-a8ab-9e4499c28d4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:01.582269 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cda38c-fdf4-4abf-a8ab-9e4499c28d4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:01.585223 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cda38c-fdf4-4abf-a8ab-9e4499c28d4c None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:01.604693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-d9cda38c-fdf4-4abf-a8ab-9e4499c28d4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:24:01.604693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:01.604693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:24:01.604693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:24:01.604693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:24:01.604693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:24:01.604693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:24:01.604693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:24:01.604693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:24:01.604693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:24:01.604693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:24:01.604693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:24:01.604693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:24:01.604693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:24:01.604693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:24:01.606292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:24:01.606292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:24:01.606292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:24:01.606292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:24:01.606292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:24:01.606292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:24:01.606292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:24:01.606292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:24:01.606292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:24:01.606292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:24:01.606292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:24:01.606292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:24:01.606292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:24:01.606292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:24:01.606292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:24:01.606292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:24:01.606292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:24:01.607624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:24:01.607624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:24:01.607624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:24:01.607624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:24:01.607624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 628/1256] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:24:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:24:01.612654 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef22ad-cfa5-4fe4-a4d7-d768170047d0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:01.730610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:01.745402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef22ad-cfa5-4fe4-a4d7-d768170047d0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:01.782064 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61b376-daf1-4392-a82d-1ae4cce42c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:01.782652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b376-daf1-4392-a82d-1ae4cce42c50 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:01.782986 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b376-daf1-4392-a82d-1ae4cce42c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:01.783261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61b376-daf1-4392-a82d-1ae4cce42c50 None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:01.783937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61b376-daf1-4392-a82d-1ae4cce42c50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:01.784319 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61b376-daf1-4392-a82d-1ae4cce42c50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:01.785708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61b376-daf1-4392-a82d-1ae4cce42c50 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:01.797980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 629/1257] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:01.804335 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cda38c-fdf4-4abf-a8ab-9e4499c28d4c None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:01.943284 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cda38c-fdf4-4abf-a8ab-9e4499c28d4c None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:01.984205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc5f6e-e433-4af5-b849-0037c42a08ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:01.986182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc5f6e-e433-4af5-b849-0037c42a08ad None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:01.986182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc5f6e-e433-4af5-b849-0037c42a08ad None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:01.986182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc5f6e-e433-4af5-b849-0037c42a08ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:01.994702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc5f6e-e433-4af5-b849-0037c42a08ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:01.996252 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc5f6e-e433-4af5-b849-0037c42a08ad None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:02.013341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-05fc5f6e-e433-4af5-b849-0037c42a08ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:24:02.013341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:02.013341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:24:02.013341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:24:02.013341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:24:02.013341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:24:02.013341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:24:02.013341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:24:02.013341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:24:02.013341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:24:02.013341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:24:02.013341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:24:02.013341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:24:02.013341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:24:02.013341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:24:02.014682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:24:02.014682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:24:02.014682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:24:02.014682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:24:02.014682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:24:02.014682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:24:02.014682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:24:02.014682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:24:02.014682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:24:02.014682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:24:02.014682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:24:02.014682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:24:02.014682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:24:02.014682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:24:02.014682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:24:02.014682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:24:02.014682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:24:02.015994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:24:02.015994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:24:02.015994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:24:02.015994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:24:02.015994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:24:02.015994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:24:02.015994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:24:02.015994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:24:02.015994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 629/1258] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:24:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:24:02.022701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61b376-daf1-4392-a82d-1ae4cce42c50 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:02.151309 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61b376-daf1-4392-a82d-1ae4cce42c50 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:02.192390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a5737-2b4a-4cb7-b5c7-8d865f4151e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:02.193061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a5737-2b4a-4cb7-b5c7-8d865f4151e3 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:02.193389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a5737-2b4a-4cb7-b5c7-8d865f4151e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:02.193768 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a5737-2b4a-4cb7-b5c7-8d865f4151e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:02.194674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a5737-2b4a-4cb7-b5c7-8d865f4151e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:02.195117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a5737-2b4a-4cb7-b5c7-8d865f4151e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:02.197312 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a5737-2b4a-4cb7-b5c7-8d865f4151e3 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:02.212208 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 630/1259] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:24:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:02.219550 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc5f6e-e433-4af5-b849-0037c42a08ad None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:02.252161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:02.344356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc5f6e-e433-4af5-b849-0037c42a08ad None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:02.386885 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a551697-6401-4e78-9d01-3a1764ea4775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:02.387796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a551697-6401-4e78-9d01-3a1764ea4775 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:02.388331 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a551697-6401-4e78-9d01-3a1764ea4775 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:02.388747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a551697-6401-4e78-9d01-3a1764ea4775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:02.389892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a551697-6401-4e78-9d01-3a1764ea4775 None admin] RBAC: Adding query filter params (role.id=e1e39192d3af465aa504728e32ab7cd2, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=1266a87d93da4f8d9a1ccafa03067169) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:02.390212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a551697-6401-4e78-9d01-3a1764ea4775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:02.392187 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a551697-6401-4e78-9d01-3a1764ea4775 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:02.399238 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 630/1260] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:24:02 2022] GET /identity/v3/role_assignments?user.id=1266a87d93da4f8d9a1ccafa03067169&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:04.658919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9657c-79bf-48af-b602-0c37fda193de None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:04.659498 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9657c-79bf-48af-b602-0c37fda193de None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:04.659498 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9657c-79bf-48af-b602-0c37fda193de None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:04.660909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 631/1261] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:24:04.666747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad03891-5466-41ed-95de-01ac6bf0c147 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:04.667167 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad03891-5466-41ed-95de-01ac6bf0c147 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:04.667284 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad03891-5466-41ed-95de-01ac6bf0c147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:04.685098 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8ad03891-5466-41ed-95de-01ac6bf0c147 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:24:04.686546 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8ad03891-5466-41ed-95de-01ac6bf0c147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:24:04.755713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 631/1262] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:24:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:24:04.778784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9657c-79bf-48af-b602-0c37fda193de None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:04.790197 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:04.885287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9657c-79bf-48af-b602-0c37fda193de None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:04.920918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ba1f3-6bbd-411e-8294-49d6469c1d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:04.921654 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ba1f3-6bbd-411e-8294-49d6469c1d73 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:04.921907 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ba1f3-6bbd-411e-8294-49d6469c1d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:04.922179 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ba1f3-6bbd-411e-8294-49d6469c1d73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:04.933927 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ba1f3-6bbd-411e-8294-49d6469c1d73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:24:04.943009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-f14ba1f3-6bbd-411e-8294-49d6469c1d73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:24:04.943009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:04.943009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:24:04.943009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:24:04.943009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:24:04.943009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:24:04.943009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:24:04.943009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:24:04.943009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:24:04.943009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:24:04.943009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:24:04.943009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:24:04.943009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:24:04.943009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:24:04.943009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:24:04.943009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:24:04.944617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:24:04.944617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:24:04.944617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:24:04.944617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:24:04.944617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:24:04.944617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:24:04.944617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:24:04.944617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:24:04.944617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:24:04.944617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:24:04.944617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:24:04.944617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:24:04.944617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:24:04.944617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:24:04.944617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:24:04.944617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:24:04.945604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:24:04.945604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:24:04.945604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:24:04.945604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:24:04.945604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:24:04.945604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:24:04.945604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:24:04.945604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:24:04.945604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:24:04.945604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:24:04.945604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:24:04.945604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:24:04.945604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 632/1263] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:24:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:24:04.950698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad03891-5466-41ed-95de-01ac6bf0c147 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:04.973578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:05.067278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad03891-5466-41ed-95de-01ac6bf0c147 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:05.107353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11a19e-d302-430f-a087-ed92e7a40915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:05.108426 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11a19e-d302-430f-a087-ed92e7a40915 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:05.108878 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11a19e-d302-430f-a087-ed92e7a40915 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:05.109295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11a19e-d302-430f-a087-ed92e7a40915 None admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:05.110463 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11a19e-d302-430f-a087-ed92e7a40915 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:05.110927 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11a19e-d302-430f-a087-ed92e7a40915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:05.113128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11a19e-d302-430f-a087-ed92e7a40915 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:05.126553 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 632/1264] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:24:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:24:05.132613 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ba1f3-6bbd-411e-8294-49d6469c1d73 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:05.204822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:05.243983 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ba1f3-6bbd-411e-8294-49d6469c1d73 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:05.278403 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d7509-6318-40b1-a250-a2bb2162a972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:05.279199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d7509-6318-40b1-a250-a2bb2162a972 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:05.279480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d7509-6318-40b1-a250-a2bb2162a972 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:05.279747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d7509-6318-40b1-a250-a2bb2162a972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:05.292001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d7509-6318-40b1-a250-a2bb2162a972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:05.293528 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d7509-6318-40b1-a250-a2bb2162a972 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:05.311701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-334d7509-6318-40b1-a250-a2bb2162a972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:24:05.311701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:05.311701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:24:05.311701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:24:05.311701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:24:05.311701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:24:05.311701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:24:05.311701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:24:05.311701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:24:05.311701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:24:05.311701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:24:05.311701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:24:05.311701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:24:05.311701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:24:05.311701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:24:05.313131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:24:05.313131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:24:05.313131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:24:05.313131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:24:05.313131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:24:05.313131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:24:05.313131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:24:05.313131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:24:05.313131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:24:05.313131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:24:05.313131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:24:05.313131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:24:05.313131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:24:05.313131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:24:05.313131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:24:05.313131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:24:05.313131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:24:05.314409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:24:05.314409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:24:05.314409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:24:05.314409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:24:05.314409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 633/1265] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:24:05.319206 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11a19e-d302-430f-a087-ed92e7a40915 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:05.405983 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:05.429364 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11a19e-d302-430f-a087-ed92e7a40915 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:05.470231 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25ecc8-f754-4f7e-a6c8-63fcdd7a4db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:05.470826 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25ecc8-f754-4f7e-a6c8-63fcdd7a4db2 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:05.471110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25ecc8-f754-4f7e-a6c8-63fcdd7a4db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:05.471384 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25ecc8-f754-4f7e-a6c8-63fcdd7a4db2 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:05.472173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25ecc8-f754-4f7e-a6c8-63fcdd7a4db2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:05.472488 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25ecc8-f754-4f7e-a6c8-63fcdd7a4db2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:05.473929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25ecc8-f754-4f7e-a6c8-63fcdd7a4db2 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:05.488593 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 633/1266] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:05.494688 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d7509-6318-40b1-a250-a2bb2162a972 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:05.612993 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d7509-6318-40b1-a250-a2bb2162a972 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:05.635183 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:05.651084 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc15e25-84d4-4893-9cb9-a62c74d36da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:05.651982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc15e25-84d4-4893-9cb9-a62c74d36da8 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:05.652293 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc15e25-84d4-4893-9cb9-a62c74d36da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:05.652577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc15e25-84d4-4893-9cb9-a62c74d36da8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:05.661553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc15e25-84d4-4893-9cb9-a62c74d36da8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:05.663061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc15e25-84d4-4893-9cb9-a62c74d36da8 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:05.679063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-abc15e25-84d4-4893-9cb9-a62c74d36da8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 16:24:05.679063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:05.679063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:24:05.679063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:24:05.679063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:24:05.679063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:24:05.679063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:24:05.679063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:24:05.679063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:24:05.679063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:24:05.679063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:24:05.679063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:24:05.679063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:24:05.679063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:24:05.679063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:24:05.679063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:24:05.680340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:24:05.680340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:24:05.680340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:24:05.680340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:24:05.680340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:24:05.680340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:24:05.680340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:24:05.680340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:24:05.680340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:24:05.680340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:24:05.680340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:24:05.680340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:24:05.680340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:24:05.680340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:24:05.680340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:24:05.680340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:24:05.680340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:24:05.680340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:24:05.681742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:24:05.681742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:24:05.681742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:24:05.681742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:24:05.681742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:24:05.681742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:24:05.681742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:24:05.681742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:24:05.681742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 16:24:05.681742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:24:05.681742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 634/1267] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:24:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:24:05.686461 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25ecc8-f754-4f7e-a6c8-63fcdd7a4db2 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:05.801204 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25ecc8-f754-4f7e-a6c8-63fcdd7a4db2 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:05.841253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30a910-2d53-4b01-b4a2-e8e253237dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:05.841941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30a910-2d53-4b01-b4a2-e8e253237dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:05.842225 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30a910-2d53-4b01-b4a2-e8e253237dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:05.842508 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30a910-2d53-4b01-b4a2-e8e253237dd6 None admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:05.844095 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30a910-2d53-4b01-b4a2-e8e253237dd6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:05.844398 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30a910-2d53-4b01-b4a2-e8e253237dd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:05.845880 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30a910-2d53-4b01-b4a2-e8e253237dd6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:05.855576 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:05.865585 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 634/1268] 10.222.0.41 () {56 vars in 1143 bytes} [Fri May 27 16:24:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:05.871479 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc15e25-84d4-4893-9cb9-a62c74d36da8 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:05.977266 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc15e25-84d4-4893-9cb9-a62c74d36da8 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:06.016688 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da49195-9fb1-407d-af8e-23bdba8a0d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:06.017507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da49195-9fb1-407d-af8e-23bdba8a0d29 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:06.017790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da49195-9fb1-407d-af8e-23bdba8a0d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:06.018063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da49195-9fb1-407d-af8e-23bdba8a0d29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:06.029122 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da49195-9fb1-407d-af8e-23bdba8a0d29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:06.031196 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da49195-9fb1-407d-af8e-23bdba8a0d29 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:06.049732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-0da49195-9fb1-407d-af8e-23bdba8a0d29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:24:06.049732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:06.049732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:24:06.049732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:24:06.049732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:24:06.049732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:24:06.049732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:24:06.049732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:24:06.049732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:24:06.049732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:24:06.049732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:24:06.049732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:24:06.049732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:24:06.049732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:24:06.049732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:24:06.050946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:24:06.050946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:24:06.050946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:24:06.050946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:24:06.050946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:24:06.050946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:24:06.050946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:24:06.050946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:24:06.050946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:24:06.050946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:24:06.050946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:24:06.050946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:24:06.050946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:24:06.050946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:24:06.050946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:24:06.050946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:24:06.050946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:24:06.052173 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:24:06.052173 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:24:06.052173 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:24:06.052173 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:24:06.052173 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 635/1269] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:24:06.057772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30a910-2d53-4b01-b4a2-e8e253237dd6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:06.165256 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30a910-2d53-4b01-b4a2-e8e253237dd6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:06.199609 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1b66a-412f-432f-8f9e-b4866f12b343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:06.200300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1b66a-412f-432f-8f9e-b4866f12b343 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:06.200580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1b66a-412f-432f-8f9e-b4866f12b343 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:06.200849 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1b66a-412f-432f-8f9e-b4866f12b343 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:06.201921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1b66a-412f-432f-8f9e-b4866f12b343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:06.202231 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1b66a-412f-432f-8f9e-b4866f12b343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:06.203638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1b66a-412f-432f-8f9e-b4866f12b343 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:06.215028 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 635/1270] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:06.221354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da49195-9fb1-407d-af8e-23bdba8a0d29 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:06.254753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:06.327484 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da49195-9fb1-407d-af8e-23bdba8a0d29 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:06.363843 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb1a9b-b8db-409b-80dd-28bbd0099d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:06.364691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb1a9b-b8db-409b-80dd-28bbd0099d9d None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:06.364972 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb1a9b-b8db-409b-80dd-28bbd0099d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:06.365246 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb1a9b-b8db-409b-80dd-28bbd0099d9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:06.372440 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb1a9b-b8db-409b-80dd-28bbd0099d9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:06.373924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb1a9b-b8db-409b-80dd-28bbd0099d9d None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:06.388775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-8eeb1a9b-b8db-409b-80dd-28bbd0099d9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:24:06.388775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:06.388775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:24:06.388775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:24:06.388775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:24:06.388775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:24:06.388775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:24:06.388775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:24:06.388775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:24:06.388775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:24:06.388775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:24:06.388775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:24:06.388775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:24:06.388775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:24:06.388775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:24:06.389904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:24:06.389904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:24:06.389904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:24:06.389904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:24:06.389904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:24:06.389904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:24:06.389904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:24:06.389904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:24:06.389904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:24:06.389904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:24:06.389904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:24:06.389904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:24:06.389904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:24:06.389904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:24:06.389904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:24:06.389904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:24:06.389904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:24:06.391148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:24:06.391148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:24:06.391148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:24:06.391148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:24:06.391148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:24:06.391148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:24:06.391148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:24:06.391148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:24:06.391148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 636/1271] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:24:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:24:06.396764 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1b66a-412f-432f-8f9e-b4866f12b343 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:06.463387 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:06.515886 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1b66a-412f-432f-8f9e-b4866f12b343 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:06.554101 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ec90a-52bc-4180-a73d-949775ae6104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:06.554802 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ec90a-52bc-4180-a73d-949775ae6104 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:06.555085 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ec90a-52bc-4180-a73d-949775ae6104 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:06.555355 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ec90a-52bc-4180-a73d-949775ae6104 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:06.556209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ec90a-52bc-4180-a73d-949775ae6104 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:06.556519 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ec90a-52bc-4180-a73d-949775ae6104 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:06.558020 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ec90a-52bc-4180-a73d-949775ae6104 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:06.572894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 636/1272] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:24:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:06.580235 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb1a9b-b8db-409b-80dd-28bbd0099d9d None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:06.678317 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:06.688236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb1a9b-b8db-409b-80dd-28bbd0099d9d None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:06.726845 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650e82e-b488-4728-954b-1a15eca07533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:06.727756 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650e82e-b488-4728-954b-1a15eca07533 None admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:06.728122 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650e82e-b488-4728-954b-1a15eca07533 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:06.728340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650e82e-b488-4728-954b-1a15eca07533 None admin] PATH_INFO: `/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/1266a87d93da4f8d9a1ccafa03067169/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:06.730565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650e82e-b488-4728-954b-1a15eca07533 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e5c551b621342e5a5a6e742d673d525, user_id=1266a87d93da4f8d9a1ccafa03067169, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:06.731992 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e650e82e-b488-4728-954b-1a15eca07533 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:06.750353 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 637/1273] 10.222.0.41 () {58 vars in 1439 bytes} [Fri May 27 16:24:06 2022] PUT /identity/v3/projects/8e5c551b621342e5a5a6e742d673d525/users/1266a87d93da4f8d9a1ccafa03067169/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:24:08.974588 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90acb2-7473-497e-ac8b-1f62911bbd00 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:08.975183 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90acb2-7473-497e-ac8b-1f62911bbd00 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:08.975349 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90acb2-7473-497e-ac8b-1f62911bbd00 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:08.977226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 637/1274] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:24:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:24:08.983088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cddfc-bfa6-44f6-8ed4-ba26da31eaf1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:08.983518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cddfc-bfa6-44f6-8ed4-ba26da31eaf1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:08.983711 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cddfc-bfa6-44f6-8ed4-ba26da31eaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:09.001695 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-729cddfc-bfa6-44f6-8ed4-ba26da31eaf1 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:24:09.002887 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-729cddfc-bfa6-44f6-8ed4-ba26da31eaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:24:09.072649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 638/1275] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:24:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:24:09.097274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90acb2-7473-497e-ac8b-1f62911bbd00 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:09.221446 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90acb2-7473-497e-ac8b-1f62911bbd00 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:09.240963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:09.259807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05688a1-763b-43f8-8d38-97f3f56bba6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:09.260640 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05688a1-763b-43f8-8d38-97f3f56bba6e None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:09.260922 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05688a1-763b-43f8-8d38-97f3f56bba6e None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:09.261174 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05688a1-763b-43f8-8d38-97f3f56bba6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:09.272708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05688a1-763b-43f8-8d38-97f3f56bba6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 16:24:09.281264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f05688a1-763b-43f8-8d38-97f3f56bba6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:24:09.281264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:09.281264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:24:09.281264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:24:09.281264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:24:09.281264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:24:09.281264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:24:09.281264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:24:09.281264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:24:09.281264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:24:09.281264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:24:09.281264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:24:09.281264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 16:24:09.281264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 16:24:09.281264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 16:24:09.281264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 16:24:09.282529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 16:24:09.282529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 16:24:09.282529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 16:24:09.282529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 16:24:09.282529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:24:09.282529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:24:09.282529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:24:09.282529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:24:09.282529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:24:09.282529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:24:09.282529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:24:09.282529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:24:09.282529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:24:09.282529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:24:09.282529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:24:09.282529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:24:09.283722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:24:09.283722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:24:09.283722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:24:09.283722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:24:09.283722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 16:24:09.283722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 16:24:09.283722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 16:24:09.283722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 16:24:09.283722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 16:24:09.283722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 16:24:09.283722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 16:24:09.283722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:24:09.283722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 638/1276] 10.222.0.41 () {56 vars in 1096 bytes} [Fri May 27 16:24:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:24:09.290915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cddfc-bfa6-44f6-8ed4-ba26da31eaf1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:09.383521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:09.403945 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729cddfc-bfa6-44f6-8ed4-ba26da31eaf1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:09.445098 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99d858-9688-42dd-a029-d1372c523c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:09.445778 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99d858-9688-42dd-a029-d1372c523c55 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:09.446056 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99d858-9688-42dd-a029-d1372c523c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:09.446331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99d858-9688-42dd-a029-d1372c523c55 None admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:09.447087 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99d858-9688-42dd-a029-d1372c523c55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:09.447397 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99d858-9688-42dd-a029-d1372c523c55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:09.448823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99d858-9688-42dd-a029-d1372c523c55 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:09.458384 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 639/1277] 10.222.0.41 () {56 vars in 1099 bytes} [Fri May 27 16:24:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:09.464580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05688a1-763b-43f8-8d38-97f3f56bba6e None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:09.571394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05688a1-763b-43f8-8d38-97f3f56bba6e None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:09.609151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1e669-07eb-44f6-acbe-bebd566b8644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:09.610172 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1e669-07eb-44f6-acbe-bebd566b8644 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:09.610585 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1e669-07eb-44f6-acbe-bebd566b8644 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:09.610898 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1e669-07eb-44f6-acbe-bebd566b8644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:09.624089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1e669-07eb-44f6-acbe-bebd566b8644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:09.625803 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1e669-07eb-44f6-acbe-bebd566b8644 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:09.645861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-15d1e669-07eb-44f6-acbe-bebd566b8644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:24:09.645861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:09.645861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:24:09.645861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:24:09.645861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:24:09.645861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:24:09.645861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:24:09.645861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:24:09.645861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:24:09.645861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:24:09.645861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:24:09.645861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:24:09.645861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:24:09.645861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:24:09.645861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:24:09.646976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:24:09.646976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:24:09.646976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:24:09.646976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:24:09.646976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:24:09.646976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:24:09.646976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:24:09.646976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:24:09.646976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:24:09.646976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:24:09.646976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:24:09.646976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:24:09.646976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:24:09.646976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:24:09.646976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:24:09.646976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:24:09.646976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:24:09.648558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:24:09.648558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:24:09.648558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:24:09.648558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:24:09.648558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 639/1278] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:24:09.656110 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99d858-9688-42dd-a029-d1372c523c55 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:09.778855 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99d858-9688-42dd-a029-d1372c523c55 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:09.814321 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bb3ea-e90c-4c03-8ec6-2fa083639dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:09.814989 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bb3ea-e90c-4c03-8ec6-2fa083639dac None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:09.815270 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bb3ea-e90c-4c03-8ec6-2fa083639dac None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:09.815542 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bb3ea-e90c-4c03-8ec6-2fa083639dac None admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:09.816290 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bb3ea-e90c-4c03-8ec6-2fa083639dac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:09.816594 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bb3ea-e90c-4c03-8ec6-2fa083639dac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:09.818001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bb3ea-e90c-4c03-8ec6-2fa083639dac None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:09.830963 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 640/1279] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:09.837202 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1e669-07eb-44f6-acbe-bebd566b8644 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:09.875403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:09.963676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1e669-07eb-44f6-acbe-bebd566b8644 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:10.003791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cf11b-07e9-4be3-b3d3-9232086706ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:10.004637 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cf11b-07e9-4be3-b3d3-9232086706ad None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:10.004913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cf11b-07e9-4be3-b3d3-9232086706ad None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:10.005186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cf11b-07e9-4be3-b3d3-9232086706ad None admin] PATH_INFO: `/v3/users/placement` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:10.012941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445cf11b-07e9-4be3-b3d3-9232086706ad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:10.014901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445cf11b-07e9-4be3-b3d3-9232086706ad None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:10.029141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-445cf11b-07e9-4be3-b3d3-9232086706ad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 16:24:10.029141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:10.029141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:24:10.029141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:24:10.029141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:24:10.029141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:24:10.029141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:24:10.029141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:24:10.029141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:24:10.029141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:24:10.029141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:24:10.029141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:24:10.029141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 16:24:10.029141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 16:24:10.029141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 16:24:10.029141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 16:24:10.030605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:24:10.030605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:24:10.030605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 16:24:10.030605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:24:10.030605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 16:24:10.030605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 16:24:10.030605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:24:10.030605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:24:10.030605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:24:10.030605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:24:10.030605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:24:10.030605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:24:10.030605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:24:10.030605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:24:10.030605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:24:10.030605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:24:10.030605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:24:10.030605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:24:10.036778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:24:10.036778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:24:10.036778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 16:24:10.036778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 16:24:10.036778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 16:24:10.036778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 16:24:10.036778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 16:24:10.036778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 16:24:10.036778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 16:24:10.036778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:24:10.036778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 640/1280] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:24:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:24:10.037526 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bb3ea-e90c-4c03-8ec6-2fa083639dac None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:10.042484 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:10.149276 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bb3ea-e90c-4c03-8ec6-2fa083639dac None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:10.183131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bff07-5185-454a-9258-9e7a33ebed98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:10.183801 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bff07-5185-454a-9258-9e7a33ebed98 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:10.184108 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bff07-5185-454a-9258-9e7a33ebed98 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:10.184388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bff07-5185-454a-9258-9e7a33ebed98 None admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:10.185219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bff07-5185-454a-9258-9e7a33ebed98 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:10.185554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bff07-5185-454a-9258-9e7a33ebed98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:10.187038 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bff07-5185-454a-9258-9e7a33ebed98 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:10.204724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 641/1281] 10.222.0.41 () {56 vars in 1143 bytes} [Fri May 27 16:24:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:10.213229 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cf11b-07e9-4be3-b3d3-9232086706ad None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:10.320620 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:10.333765 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cf11b-07e9-4be3-b3d3-9232086706ad None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:10.370640 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc36a3-f985-4128-8676-38da392615e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:10.371301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc36a3-f985-4128-8676-38da392615e9 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:10.371585 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc36a3-f985-4128-8676-38da392615e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:10.371862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc36a3-f985-4128-8676-38da392615e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:10.443806 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc36a3-f985-4128-8676-38da392615e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:10.445362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc36a3-f985-4128-8676-38da392615e9 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:10.544173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:10.559780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 641/1282] 10.222.0.41 () {58 vars in 1282 bytes} [Fri May 27 16:24:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 16:24:10.565966 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bff07-5185-454a-9258-9e7a33ebed98 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:10.631623 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:10.680370 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bff07-5185-454a-9258-9e7a33ebed98 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:10.718616 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d3ccc-2174-478d-89c0-da33d2aafa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:10.719322 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d3ccc-2174-478d-89c0-da33d2aafa6e None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:10.719609 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d3ccc-2174-478d-89c0-da33d2aafa6e None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:10.719877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d3ccc-2174-478d-89c0-da33d2aafa6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:10.730277 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d3ccc-2174-478d-89c0-da33d2aafa6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:10.731767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d3ccc-2174-478d-89c0-da33d2aafa6e None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:10.750333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-a34d3ccc-2174-478d-89c0-da33d2aafa6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:24:10.750333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:10.750333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:24:10.750333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:24:10.750333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:24:10.750333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:24:10.750333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:24:10.750333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:24:10.750333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:24:10.750333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:24:10.750333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:24:10.750333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:24:10.750333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 16:24:10.750333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 16:24:10.750333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 16:24:10.751716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 16:24:10.751716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:24:10.751716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:24:10.751716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:24:10.751716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:24:10.751716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:24:10.751716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:24:10.751716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:24:10.751716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:24:10.751716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:24:10.751716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:24:10.751716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:24:10.751716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:24:10.751716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:24:10.751716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:24:10.751716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:24:10.751716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:24:10.753005 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 16:24:10.753005 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 16:24:10.753005 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 16:24:10.753005 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:24:10.756353 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 642/1283] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:24:10.757488 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc36a3-f985-4128-8676-38da392615e9 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:10.867414 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc36a3-f985-4128-8676-38da392615e9 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:10.905585 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6707600-aefc-4693-a34d-23f7290dd943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:10.906567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6707600-aefc-4693-a34d-23f7290dd943 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:10.906991 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6707600-aefc-4693-a34d-23f7290dd943 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:10.907423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6707600-aefc-4693-a34d-23f7290dd943 None admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:10.908659 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6707600-aefc-4693-a34d-23f7290dd943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:10.909157 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6707600-aefc-4693-a34d-23f7290dd943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:10.911212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6707600-aefc-4693-a34d-23f7290dd943 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:10.927012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 642/1284] 10.222.0.41 () {56 vars in 1109 bytes} [Fri May 27 16:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:10.933204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d3ccc-2174-478d-89c0-da33d2aafa6e None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:11.042420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d3ccc-2174-478d-89c0-da33d2aafa6e None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:11.057511 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:11.084932 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73675c97-bb42-4627-9cca-d53b000329d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:11.085754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73675c97-bb42-4627-9cca-d53b000329d0 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:11.086040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73675c97-bb42-4627-9cca-d53b000329d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:11.086318 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73675c97-bb42-4627-9cca-d53b000329d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:11.094329 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73675c97-bb42-4627-9cca-d53b000329d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:11.095809 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73675c97-bb42-4627-9cca-d53b000329d0 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:11.111020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application [None req-73675c97-bb42-4627-9cca-d53b000329d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:24:11.111020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:11.111020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:24:11.111020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:24:11.111020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:24:11.111020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:24:11.111020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:24:11.111020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:24:11.111020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:24:11.111020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:24:11.111020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:24:11.111020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:24:11.111020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 16:24:11.111020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 16:24:11.111020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 16:24:11.112228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 16:24:11.112228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:24:11.112228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:24:11.112228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:24:11.112228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:24:11.112228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:24:11.112228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:24:11.112228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:24:11.112228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application with Lock( May 27 16:24:11.112228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:24:11.112228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._enter() May 27 16:24:11.112228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:24:11.112228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:24:11.112228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:24:11.112228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.creator() May 27 16:24:11.112228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:24:11.112228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application created_value = creator( May 27 16:24:11.113523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 16:24:11.113523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 16:24:11.113523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 16:24:11.113523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 16:24:11.113523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 16:24:11.113523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 16:24:11.113523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 16:24:11.113523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: ERROR keystone.server.flask.application May 27 16:24:11.113523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 643/1285] 10.222.0.41 () {56 vars in 1111 bytes} [Fri May 27 16:24:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:24:11.119317 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6707600-aefc-4693-a34d-23f7290dd943 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:11.175630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:11.228510 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6707600-aefc-4693-a34d-23f7290dd943 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:11.266269 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263146be-5926-4051-8370-8692823f8b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:11.266941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263146be-5926-4051-8370-8692823f8b51 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:11.267224 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263146be-5926-4051-8370-8692823f8b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:11.267502 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263146be-5926-4051-8370-8692823f8b51 None admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:11.268308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263146be-5926-4051-8370-8692823f8b51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:11.268621 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263146be-5926-4051-8370-8692823f8b51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:11.270063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263146be-5926-4051-8370-8692823f8b51 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:11.284467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 643/1286] 10.222.0.41 () {56 vars in 1148 bytes} [Fri May 27 16:24:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:11.291290 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73675c97-bb42-4627-9cca-d53b000329d0 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:11.408932 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73675c97-bb42-4627-9cca-d53b000329d0 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:11.447733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0548f2-6bf9-4493-884e-b128d62e1308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:11.448444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0548f2-6bf9-4493-884e-b128d62e1308 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:11.448731 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0548f2-6bf9-4493-884e-b128d62e1308 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:11.449004 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0548f2-6bf9-4493-884e-b128d62e1308 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:11.449870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0548f2-6bf9-4493-884e-b128d62e1308 None admin] RBAC: Adding query filter params (role.id=e1e39192d3af465aa504728e32ab7cd2, scope.project.id=8e5c551b621342e5a5a6e742d673d525, user.id=1266a87d93da4f8d9a1ccafa03067169) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:11.450183 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0548f2-6bf9-4493-884e-b128d62e1308 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:11.452052 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0548f2-6bf9-4493-884e-b128d62e1308 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:11.458924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 644/1287] 10.222.0.41 () {56 vars in 1374 bytes} [Fri May 27 16:24:11 2022] GET /identity/v3/role_assignments?user.id=1266a87d93da4f8d9a1ccafa03067169&scope.project.id=8e5c551b621342e5a5a6e742d673d525&role.id=e1e39192d3af465aa504728e32ab7cd2 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:13.706581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24160286-2b4a-43d6-99ab-5532289e234b None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:13.707143 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24160286-2b4a-43d6-99ab-5532289e234b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:13.707143 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24160286-2b4a-43d6-99ab-5532289e234b None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:13.708543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 644/1288] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:24:13.714299 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaf47c-4197-4ec9-9882-f3cd43769cbf None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:13.714766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaf47c-4197-4ec9-9882-f3cd43769cbf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:13.714879 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaf47c-4197-4ec9-9882-f3cd43769cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:13.741633 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-43eaf47c-4197-4ec9-9882-f3cd43769cbf None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:24:13.743701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-43eaf47c-4197-4ec9-9882-f3cd43769cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:24:13.780310 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:13.826129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 645/1289] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:24:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:24:13.848958 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24160286-2b4a-43d6-99ab-5532289e234b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:13.964177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24160286-2b4a-43d6-99ab-5532289e234b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:13.975865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:14.006157 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d8f6b-c465-4897-8f7b-f12fa5336e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:14.007287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d8f6b-c465-4897-8f7b-f12fa5336e50 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:14.007663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d8f6b-c465-4897-8f7b-f12fa5336e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:14.008163 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d8f6b-c465-4897-8f7b-f12fa5336e50 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:14.008954 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d8f6b-c465-4897-8f7b-f12fa5336e50 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:14.010666 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d8f6b-c465-4897-8f7b-f12fa5336e50 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:14.024634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-2c5d8f6b-c465-4897-8f7b-f12fa5336e50 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 16:24:14.024634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:14.024634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:24:14.024634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:24:14.024634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:24:14.024634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:24:14.024634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:24:14.024634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:24:14.024634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 16:24:14.024634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:24:14.024634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:24:14.024634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:24:14.024634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:14.024634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:24:14.024634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:24:14.024634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:24:14.024634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:24:14.025942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:24:14.025942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:24:14.025942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:24:14.025942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:24:14.025942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:24:14.025942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:24:14.025942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:24:14.025942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:24:14.025942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:24:14.025942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:24:14.025942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:24:14.025942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:24:14.025942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:24:14.025942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:24:14.025942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:24:14.025942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:24:14.026874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:24:14.026874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:24:14.026874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:24:14.026874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:24:14.026874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:24:14.026874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:24:14.026874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:24:14.026874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:24:14.026874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:24:14.026874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:24:14.026874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:24:14.026874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:24:14.026874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 16:24:14.026874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:24:14.026874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 645/1290] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 16:24:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:24:14.033129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eaf47c-4197-4ec9-9882-f3cd43769cbf None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:14.145735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eaf47c-4197-4ec9-9882-f3cd43769cbf None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:14.179715 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d32335-6486-4a25-a22e-f5b35b8a3663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:14.180409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d32335-6486-4a25-a22e-f5b35b8a3663 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:14.180718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d32335-6486-4a25-a22e-f5b35b8a3663 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:14.180987 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d32335-6486-4a25-a22e-f5b35b8a3663 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:14.181688 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d32335-6486-4a25-a22e-f5b35b8a3663 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:14.181987 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d32335-6486-4a25-a22e-f5b35b8a3663 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:14.183370 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d32335-6486-4a25-a22e-f5b35b8a3663 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:14.188609 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 646/1291] 10.222.0.41 () {56 vars in 1116 bytes} [Fri May 27 16:24:14 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:14.194894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d8f6b-c465-4897-8f7b-f12fa5336e50 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:14.307287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d8f6b-c465-4897-8f7b-f12fa5336e50 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:14.344403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c2673-8f04-440c-a056-0e4f42a89cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:14.345082 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c2673-8f04-440c-a056-0e4f42a89cda None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:14.345364 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c2673-8f04-440c-a056-0e4f42a89cda None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:14.345638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c2673-8f04-440c-a056-0e4f42a89cda None admin] PATH_INFO: `/v3/services` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:14.346351 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c2673-8f04-440c-a056-0e4f42a89cda None admin] RBAC: Adding query filter params (type=placement) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:14.346654 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c2673-8f04-440c-a056-0e4f42a89cda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:14.348070 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c2673-8f04-440c-a056-0e4f42a89cda None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:14.353345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 646/1292] 10.222.0.41 () {56 vars in 1116 bytes} [Fri May 27 16:24:14 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:16.579987 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a023160-c185-4069-85bd-50f6d18abd17 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:16.580897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a023160-c185-4069-85bd-50f6d18abd17 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:16.580897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a023160-c185-4069-85bd-50f6d18abd17 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:16.582957 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 647/1293] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:24:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:24:16.589786 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e494c-5e27-4ece-89dd-cf45ad5b1388 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:16.590249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e494c-5e27-4ece-89dd-cf45ad5b1388 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:16.590351 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603e494c-5e27-4ece-89dd-cf45ad5b1388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:16.609909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-603e494c-5e27-4ece-89dd-cf45ad5b1388 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:24:16.611112 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-603e494c-5e27-4ece-89dd-cf45ad5b1388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:24:16.648337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:16.689511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 647/1294] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:24:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:24:16.713391 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a023160-c185-4069-85bd-50f6d18abd17 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:16.751909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:16.828055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a023160-c185-4069-85bd-50f6d18abd17 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:16.867084 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776cc0d-6eea-493f-b96b-a828fda7e232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:16.867679 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776cc0d-6eea-493f-b96b-a828fda7e232 None admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:16.868067 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776cc0d-6eea-493f-b96b-a828fda7e232 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:16.868272 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776cc0d-6eea-493f-b96b-a828fda7e232 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:16.868988 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776cc0d-6eea-493f-b96b-a828fda7e232 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:16.870379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776cc0d-6eea-493f-b96b-a828fda7e232 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:16.885958 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 648/1295] 10.222.0.41 () {60 vars in 1141 bytes} [Fri May 27 16:24:16 2022] POST /identity/v3/services => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:24:19.086143 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682581cf-2def-4486-a1cd-3f73ab93f428 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:19.087037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682581cf-2def-4486-a1cd-3f73ab93f428 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:19.087037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682581cf-2def-4486-a1cd-3f73ab93f428 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:19.089286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 648/1296] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:24:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:24:19.098532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c38df0-6386-4b51-9bf5-c62642cd0124 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:19.099264 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c38df0-6386-4b51-9bf5-c62642cd0124 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:19.099435 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c38df0-6386-4b51-9bf5-c62642cd0124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:19.121074 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-37c38df0-6386-4b51-9bf5-c62642cd0124 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:24:19.122294 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-37c38df0-6386-4b51-9bf5-c62642cd0124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:24:19.199957 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 649/1297] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:24:19 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 16:24:19.225505 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682581cf-2def-4486-a1cd-3f73ab93f428 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:19.343513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682581cf-2def-4486-a1cd-3f73ab93f428 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:19.377016 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345eece-66e6-4fb9-a844-e8fde74baa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:19.377825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345eece-66e6-4fb9-a844-e8fde74baa1d None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:19.378107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345eece-66e6-4fb9-a844-e8fde74baa1d None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:19.378380 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345eece-66e6-4fb9-a844-e8fde74baa1d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:19.379043 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f345eece-66e6-4fb9-a844-e8fde74baa1d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:19.380492 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f345eece-66e6-4fb9-a844-e8fde74baa1d None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:19.393185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-f345eece-66e6-4fb9-a844-e8fde74baa1d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 16:24:19.393185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:19.393185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:24:19.393185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:24:19.393185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:24:19.393185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:24:19.393185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:24:19.393185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:24:19.393185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 16:24:19.393185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:24:19.393185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:24:19.393185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:24:19.393185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:19.393185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:24:19.393185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:24:19.393185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:24:19.393185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:24:19.394762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:24:19.394762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:24:19.394762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:24:19.394762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:24:19.394762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:24:19.394762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:24:19.394762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:24:19.394762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:24:19.394762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:24:19.394762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:24:19.394762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:24:19.394762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:24:19.394762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:24:19.394762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:24:19.394762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:24:19.394762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:24:19.395916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:24:19.395916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:24:19.395916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:24:19.395916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:24:19.395916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:24:19.395916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:24:19.395916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:24:19.395916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:24:19.395916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:24:19.395916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:24:19.395916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:24:19.395916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:24:19.395916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 16:24:19.395916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:24:19.399564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 649/1298] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 16:24:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:24:19.400694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c38df0-6386-4b51-9bf5-c62642cd0124 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:19.419101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:19.502718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c38df0-6386-4b51-9bf5-c62642cd0124 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:19.539259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f535e-b336-4ad6-8dab-5383b9a47a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:19.539925 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f535e-b336-4ad6-8dab-5383b9a47a08 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:19.540248 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f535e-b336-4ad6-8dab-5383b9a47a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:19.540523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f535e-b336-4ad6-8dab-5383b9a47a08 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:19.541231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f535e-b336-4ad6-8dab-5383b9a47a08 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:19.541535 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f535e-b336-4ad6-8dab-5383b9a47a08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:19.542935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f535e-b336-4ad6-8dab-5383b9a47a08 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:19.548250 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 650/1299] 10.222.0.41 () {56 vars in 1116 bytes} [Fri May 27 16:24:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:19.554535 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345eece-66e6-4fb9-a844-e8fde74baa1d None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:19.589492 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:19.666898 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345eece-66e6-4fb9-a844-e8fde74baa1d None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:19.704693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa4361-1eff-4538-be68-9cb5456a09e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:19.705343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa4361-1eff-4538-be68-9cb5456a09e1 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:19.705620 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa4361-1eff-4538-be68-9cb5456a09e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:19.705898 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa4361-1eff-4538-be68-9cb5456a09e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:19.706678 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa4361-1eff-4538-be68-9cb5456a09e1 None admin] RBAC: Adding query filter params (interface=public, service_id=f1b78fe4829f46e88c630b6dddb3b9dc, region_id=RegionOne) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:19.706984 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa4361-1eff-4538-be68-9cb5456a09e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:19.708402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa4361-1eff-4538-be68-9cb5456a09e1 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:19.713423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 650/1300] 10.222.0.41 () {56 vars in 1251 bytes} [Fri May 27 16:24:19 2022] GET /identity/v3/endpoints?service_id=f1b78fe4829f46e88c630b6dddb3b9dc&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:19.721130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f535e-b336-4ad6-8dab-5383b9a47a08 None admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:19.803105 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:19.823227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f535e-b336-4ad6-8dab-5383b9a47a08 None admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:19.859132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540232c-5455-4442-b372-7f58ff6dc018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:19.859794 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540232c-5455-4442-b372-7f58ff6dc018 None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:19.860104 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540232c-5455-4442-b372-7f58ff6dc018 None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:19.860374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540232c-5455-4442-b372-7f58ff6dc018 None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:19.861039 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540232c-5455-4442-b372-7f58ff6dc018 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:19.862428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540232c-5455-4442-b372-7f58ff6dc018 None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:19.869824 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 651/1301] 10.222.0.41 () {56 vars in 1087 bytes} [Fri May 27 16:24:19 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:24:22.097502 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937dc71-e379-4e11-a588-4134de01f355 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:22.098410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937dc71-e379-4e11-a588-4134de01f355 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:22.098410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937dc71-e379-4e11-a588-4134de01f355 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:22.100697 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 651/1302] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:24:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:24:22.107264 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d1e1f-9dd6-422d-9fa5-54398dac45b5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:22.107999 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d1e1f-9dd6-422d-9fa5-54398dac45b5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:22.108218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d1e1f-9dd6-422d-9fa5-54398dac45b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:22.136673 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-635d1e1f-9dd6-422d-9fa5-54398dac45b5 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:24:22.138727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-635d1e1f-9dd6-422d-9fa5-54398dac45b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:24:22.216935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 652/1303] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:24:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 16:24:22.241096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937dc71-e379-4e11-a588-4134de01f355 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:22.349896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:22.357384 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937dc71-e379-4e11-a588-4134de01f355 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:22.395083 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d656f29-7372-4528-8f88-275446e7e0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:22.395908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d656f29-7372-4528-8f88-275446e7e0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:22.396221 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d656f29-7372-4528-8f88-275446e7e0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:22.396499 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d656f29-7372-4528-8f88-275446e7e0e6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:22.397160 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d656f29-7372-4528-8f88-275446e7e0e6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:22.398569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d656f29-7372-4528-8f88-275446e7e0e6 None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:22.411410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application [None req-7d656f29-7372-4528-8f88-275446e7e0e6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 16:24:22.411410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:22.411410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 16:24:22.411410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 16:24:22.411410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 16:24:22.411410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 16:24:22.411410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 16:24:22.411410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:24:22.411410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 16:24:22.411410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:24:22.411410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 16:24:22.411410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:24:22.411410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 16:24:22.411410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 16:24:22.411410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 16:24:22.411410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 16:24:22.411410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 16:24:22.412772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 16:24:22.412772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 16:24:22.412772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 16:24:22.412772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 16:24:22.412772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 16:24:22.412772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 16:24:22.412772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 16:24:22.412772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 16:24:22.412772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 16:24:22.412772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 16:24:22.412772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 16:24:22.412772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 16:24:22.412772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 16:24:22.412772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 16:24:22.412772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 16:24:22.412772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.get_or_create( May 27 16:24:22.414068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 16:24:22.414068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application with Lock( May 27 16:24:22.414068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 16:24:22.414068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self._enter() May 27 16:24:22.414068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 16:24:22.414068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 16:24:22.414068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 16:24:22.414068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application return self.creator() May 27 16:24:22.414068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 16:24:22.414068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application created_value = creator( May 27 16:24:22.414068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 16:24:22.414068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 16:24:22.414068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 16:24:22.414068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: ERROR keystone.server.flask.application May 27 16:24:22.414068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 652/1304] 10.222.0.41 () {56 vars in 1117 bytes} [Fri May 27 16:24:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 16:24:22.419507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d1e1f-9dd6-422d-9fa5-54398dac45b5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:22.505188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:22.528652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d1e1f-9dd6-422d-9fa5-54398dac45b5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:22.563223 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848866de-2e5f-40ae-8924-05e2effba01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:22.563888 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848866de-2e5f-40ae-8924-05e2effba01a None admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:22.564193 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848866de-2e5f-40ae-8924-05e2effba01a None admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:22.564473 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848866de-2e5f-40ae-8924-05e2effba01a None admin] PATH_INFO: `/v3/services` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:22.565182 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848866de-2e5f-40ae-8924-05e2effba01a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:24:22.565491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848866de-2e5f-40ae-8924-05e2effba01a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:22.566900 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848866de-2e5f-40ae-8924-05e2effba01a None admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:22.573104 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 653/1305] 10.222.0.41 () {56 vars in 1116 bytes} [Fri May 27 16:24:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:24:22.583977 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d656f29-7372-4528-8f88-275446e7e0e6 None admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:24:22.694216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d656f29-7372-4528-8f88-275446e7e0e6 None admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:24:22.730340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9aec66-e9b0-4c29-8c48-e4cb9c84e83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:24:22.730995 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aec66-e9b0-4c29-8c48-e4cb9c84e83b None admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:24:22.731274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aec66-e9b0-4c29-8c48-e4cb9c84e83b None admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:24:22.731549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aec66-e9b0-4c29-8c48-e4cb9c84e83b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:24:22.732316 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9aec66-e9b0-4c29-8c48-e4cb9c84e83b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:24:22.734202 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9aec66-e9b0-4c29-8c48-e4cb9c84e83b None admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:24:22.755760 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 653/1306] 10.222.0.41 () {60 vars in 1144 bytes} [Fri May 27 16:24:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:24:32.569988 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=30 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:24:32.754047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:28.122094 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fef76-6455-421c-90f5-774f0b73d79f None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:28.122692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fef76-6455-421c-90f5-774f0b73d79f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:28.122692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fef76-6455-421c-90f5-774f0b73d79f None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:28.128077 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 654/1307] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:25:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:25:28.129534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e812f8-902f-468d-baac-278f499b4d9d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:28.130004 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e812f8-902f-468d-baac-278f499b4d9d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:28.130087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e812f8-902f-468d-baac-278f499b4d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:28.231175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b9e812f8-902f-468d-baac-278f499b4d9d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:25:28.232431 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b9e812f8-902f-468d-baac-278f499b4d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:28.376510 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 654/1308] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:25:28.471466 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693c2cf-f02d-488a-ac94-4323ee2a8db0 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:28.471984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693c2cf-f02d-488a-ac94-4323ee2a8db0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:28.472483 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693c2cf-f02d-488a-ac94-4323ee2a8db0 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:28.475257 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 655/1309] 10.222.0.41 () {54 vars in 964 bytes} [Fri May 27 16:25:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:25:28.481859 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2236c-2780-4723-998b-1e7d21f1e879 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:28.482432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2236c-2780-4723-998b-1e7d21f1e879 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:28.482943 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2236c-2780-4723-998b-1e7d21f1e879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:28.572829 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-adc2236c-2780-4723-998b-1e7d21f1e879 None None] MFA Rules not processed for user `6f3fe9e871b34a8faed94550e27fefd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:25:28.573974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-adc2236c-2780-4723-998b-1e7d21f1e879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:28.597086 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:28.658120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 655/1310] 10.222.0.41 () {58 vars in 1061 bytes} [Fri May 27 16:25:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:25:28.669640 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693c2cf-f02d-488a-ac94-4323ee2a8db0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:28.673748 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8693c2cf-f02d-488a-ac94-4323ee2a8db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:28.806939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693c2cf-f02d-488a-ac94-4323ee2a8db0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:28.886188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b557307-2f4a-4deb-b9ae-236ca96c6e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:28.886846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b557307-2f4a-4deb-b9ae-236ca96c6e43 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:28.887130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b557307-2f4a-4deb-b9ae-236ca96c6e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:28.887403 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b557307-2f4a-4deb-b9ae-236ca96c6e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:28.889110 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7b557307-2f4a-4deb-b9ae-236ca96c6e43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:28.953073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:29.015993 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b557307-2f4a-4deb-b9ae-236ca96c6e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:29.017504 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b557307-2f4a-4deb-b9ae-236ca96c6e43 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:29.037649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 656/1311] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:25:31.596127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a2e07-1440-4b84-a916-a368016f9b7e None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:31.596673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a2e07-1440-4b84-a916-a368016f9b7e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:31.596673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a2e07-1440-4b84-a916-a368016f9b7e None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:31.598297 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 656/1312] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:25:31.603679 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90310cc3-27e1-449a-b12b-dc4482da6c6d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:31.604173 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90310cc3-27e1-449a-b12b-dc4482da6c6d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:31.604545 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90310cc3-27e1-449a-b12b-dc4482da6c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:31.689827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-90310cc3-27e1-449a-b12b-dc4482da6c6d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:25:31.691343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-90310cc3-27e1-449a-b12b-dc4482da6c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:31.815121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 657/1313] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:25:31.854635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a2e07-1440-4b84-a916-a368016f9b7e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:31.856272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-302a2e07-1440-4b84-a916-a368016f9b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:31.975487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a2e07-1440-4b84-a916-a368016f9b7e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:32.060561 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:32.062936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68f563-0d19-4c61-b04d-2764f3ad75ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:32.063609 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68f563-0d19-4c61-b04d-2764f3ad75ce service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:32.063963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68f563-0d19-4c61-b04d-2764f3ad75ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:32.064167 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68f563-0d19-4c61-b04d-2764f3ad75ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:32.066305 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cf68f563-0d19-4c61-b04d-2764f3ad75ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:32.198024 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68f563-0d19-4c61-b04d-2764f3ad75ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:32.199394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68f563-0d19-4c61-b04d-2764f3ad75ce service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:32.223325 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 657/1314] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:25:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:25:34.820339 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad66a7-1149-437b-a722-b9652f86793d None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:34.821229 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad66a7-1149-437b-a722-b9652f86793d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:34.821229 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad66a7-1149-437b-a722-b9652f86793d None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:34.823434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 658/1315] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:25:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:25:34.830324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6f465-ff4d-4edb-90ad-b176505411dc None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:34.830794 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6f465-ff4d-4edb-90ad-b176505411dc None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:34.830894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6f465-ff4d-4edb-90ad-b176505411dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:34.910925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a4e6f465-ff4d-4edb-90ad-b176505411dc None None] MFA Rules not processed for user `8ef914cb95d3407db3772d63d8a4e129`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:25:34.912192 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a4e6f465-ff4d-4edb-90ad-b176505411dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:34.970362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:35.025167 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 658/1316] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:25:34 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:25:35.087348 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11afd2-0b2d-42c3-9818-050bed4da1e0 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:35.087630 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11afd2-0b2d-42c3-9818-050bed4da1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:35.087994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11afd2-0b2d-42c3-9818-050bed4da1e0 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:35.090190 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 659/1317] 10.222.0.41 () {54 vars in 964 bytes} [Fri May 27 16:25:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:25:35.096592 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8a6fc-b1d2-45cc-ac6c-42e21c206fad None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:35.096879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8a6fc-b1d2-45cc-ac6c-42e21c206fad None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:35.097157 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8a6fc-b1d2-45cc-ac6c-42e21c206fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:35.179761 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-94e8a6fc-b1d2-45cc-ac6c-42e21c206fad None None] MFA Rules not processed for user `6f3fe9e871b34a8faed94550e27fefd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:25:35.181026 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-94e8a6fc-b1d2-45cc-ac6c-42e21c206fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:35.274259 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 659/1318] 10.222.0.41 () {58 vars in 1061 bytes} [Fri May 27 16:25:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:25:35.284323 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11afd2-0b2d-42c3-9818-050bed4da1e0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:35.285880 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dc11afd2-0b2d-42c3-9818-050bed4da1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:35.297267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:35.396263 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11afd2-0b2d-42c3-9818-050bed4da1e0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:35.479846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0200587-caef-499a-abb7-649322737503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:35.480897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0200587-caef-499a-abb7-649322737503 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:35.481337 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0200587-caef-499a-abb7-649322737503 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:35.481766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0200587-caef-499a-abb7-649322737503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:35.484327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f0200587-caef-499a-abb7-649322737503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:35.562335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:35.613599 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0200587-caef-499a-abb7-649322737503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:35.615076 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0200587-caef-499a-abb7-649322737503 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:35.635614 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 660/1319] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:25:35 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:25:38.803513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92984e-dc67-433c-99b9-39e9ad6b35b0 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:38.804091 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92984e-dc67-433c-99b9-39e9ad6b35b0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:38.804091 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92984e-dc67-433c-99b9-39e9ad6b35b0 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:38.805517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 660/1320] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:25:38.811278 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caaad1-9fc5-4dfe-898a-163e1241b0ad None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:38.811754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caaad1-9fc5-4dfe-898a-163e1241b0ad None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:38.812602 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caaad1-9fc5-4dfe-898a-163e1241b0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:38.884224 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-73caaad1-9fc5-4dfe-898a-163e1241b0ad None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:25:38.885450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-73caaad1-9fc5-4dfe-898a-163e1241b0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:39.006427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 661/1321] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:25:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:25:39.046122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92984e-dc67-433c-99b9-39e9ad6b35b0 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:39.048857 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-dd92984e-dc67-433c-99b9-39e9ad6b35b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:39.107545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:39.169192 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92984e-dc67-433c-99b9-39e9ad6b35b0 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:39.260761 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586321d-0c7d-4ebe-afd5-fbceb7f538c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:39.261419 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586321d-0c7d-4ebe-afd5-fbceb7f538c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:39.261702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586321d-0c7d-4ebe-afd5-fbceb7f538c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:39.261973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586321d-0c7d-4ebe-afd5-fbceb7f538c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:39.263627 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3586321d-0c7d-4ebe-afd5-fbceb7f538c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:39.372900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:39.387251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586321d-0c7d-4ebe-afd5-fbceb7f538c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:39.388747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586321d-0c7d-4ebe-afd5-fbceb7f538c3 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:39.413301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 661/1322] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:25:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:25:42.362620 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce025da-8cb1-411f-9bf2-ae01e25cdc73 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:42.363167 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce025da-8cb1-411f-9bf2-ae01e25cdc73 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:42.363281 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce025da-8cb1-411f-9bf2-ae01e25cdc73 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:42.364641 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 662/1323] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:25:42.370049 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2aec89-c373-440e-bb35-662d443397bc None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:42.370512 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2aec89-c373-440e-bb35-662d443397bc None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:42.370627 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2aec89-c373-440e-bb35-662d443397bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:42.459315 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-cf2aec89-c373-440e-bb35-662d443397bc None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:25:42.460559 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cf2aec89-c373-440e-bb35-662d443397bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:42.568315 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 662/1324] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:25:42.604845 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce025da-8cb1-411f-9bf2-ae01e25cdc73 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:42.606477 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5ce025da-8cb1-411f-9bf2-ae01e25cdc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:42.628029 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:42.728839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce025da-8cb1-411f-9bf2-ae01e25cdc73 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:42.814263 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb2567-83dc-4e41-bc30-54a7465a1612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:42.814954 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb2567-83dc-4e41-bc30-54a7465a1612 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:42.815240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb2567-83dc-4e41-bc30-54a7465a1612 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:42.815518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb2567-83dc-4e41-bc30-54a7465a1612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:42.817312 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-75bb2567-83dc-4e41-bc30-54a7465a1612 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:42.912161 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:42.958906 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb2567-83dc-4e41-bc30-54a7465a1612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:42.961380 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb2567-83dc-4e41-bc30-54a7465a1612 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:42.984226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 663/1325] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:25:45.303693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50a3cd-bc05-47bb-9219-25936d2a99a2 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:45.304296 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50a3cd-bc05-47bb-9219-25936d2a99a2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:45.304296 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50a3cd-bc05-47bb-9219-25936d2a99a2 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:45.305705 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 663/1326] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:25:45.311682 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf87eb5-2025-4061-b69b-4d6581b0c498 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:45.312315 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf87eb5-2025-4061-b69b-4d6581b0c498 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:45.312315 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf87eb5-2025-4061-b69b-4d6581b0c498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:45.378559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-edf87eb5-2025-4061-b69b-4d6581b0c498 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:25:45.379772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-edf87eb5-2025-4061-b69b-4d6581b0c498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:45.481450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 664/1327] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:25:45.518541 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50a3cd-bc05-47bb-9219-25936d2a99a2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:45.520653 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6d50a3cd-bc05-47bb-9219-25936d2a99a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:45.589567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:45.635525 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50a3cd-bc05-47bb-9219-25936d2a99a2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:45.709585 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e651ae-3f39-43ee-99bf-10849c21f28c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:45.710239 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e651ae-3f39-43ee-99bf-10849c21f28c service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:45.710525 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e651ae-3f39-43ee-99bf-10849c21f28c service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:45.710780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e651ae-3f39-43ee-99bf-10849c21f28c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:45.712489 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c0e651ae-3f39-43ee-99bf-10849c21f28c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:45.822227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:45.825271 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e651ae-3f39-43ee-99bf-10849c21f28c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:45.827279 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e651ae-3f39-43ee-99bf-10849c21f28c service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:45.847002 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 664/1328] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:25:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:25:48.105684 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0140b-9274-47ad-9a6d-5dae696980b9 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:48.106331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0140b-9274-47ad-9a6d-5dae696980b9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:48.106331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0140b-9274-47ad-9a6d-5dae696980b9 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:48.107623 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 665/1329] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:25:48.117570 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d36a8b-e770-4e4f-bc0f-2321884f34e9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:48.118148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d36a8b-e770-4e4f-bc0f-2321884f34e9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:48.118148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d36a8b-e770-4e4f-bc0f-2321884f34e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:48.191802 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d0d36a8b-e770-4e4f-bc0f-2321884f34e9 None None] MFA Rules not processed for user `8ef914cb95d3407db3772d63d8a4e129`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:25:48.193086 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d0d36a8b-e770-4e4f-bc0f-2321884f34e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:48.314115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 665/1330] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:25:48 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:25:48.354125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0140b-9274-47ad-9a6d-5dae696980b9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:48.355670 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-efb0140b-9274-47ad-9a6d-5dae696980b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:48.389674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:48.468229 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0140b-9274-47ad-9a6d-5dae696980b9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:48.547586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbeb148-0cfc-409a-b31d-91aeb60e2ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:48.548267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbeb148-0cfc-409a-b31d-91aeb60e2ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:48.548543 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbeb148-0cfc-409a-b31d-91aeb60e2ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:48.548811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbeb148-0cfc-409a-b31d-91aeb60e2ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:48.550443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2bbeb148-0cfc-409a-b31d-91aeb60e2ba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:48.631254 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:48.664591 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbeb148-0cfc-409a-b31d-91aeb60e2ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:48.666077 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbeb148-0cfc-409a-b31d-91aeb60e2ba4 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:48.686879 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 666/1331] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:25:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:25:51.134106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c361bf7-d0cb-4083-9d84-330d9386a383 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:51.134595 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c361bf7-d0cb-4083-9d84-330d9386a383 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:51.134595 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c361bf7-d0cb-4083-9d84-330d9386a383 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:51.135963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 666/1332] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:25:51.141986 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b237475-8d48-4f3d-9632-c50e166e4c09 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:51.142510 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b237475-8d48-4f3d-9632-c50e166e4c09 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:51.142618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b237475-8d48-4f3d-9632-c50e166e4c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:51.214728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0b237475-8d48-4f3d-9632-c50e166e4c09 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:25:51.215909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0b237475-8d48-4f3d-9632-c50e166e4c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:51.322716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 667/1333] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:25:51.359311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c361bf7-d0cb-4083-9d84-330d9386a383 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:51.360981 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2c361bf7-d0cb-4083-9d84-330d9386a383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:51.446232 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:51.484342 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c361bf7-d0cb-4083-9d84-330d9386a383 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:51.568441 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc2700-3b96-419e-b906-3ec718a5b596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:51.569105 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc2700-3b96-419e-b906-3ec718a5b596 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:51.569414 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc2700-3b96-419e-b906-3ec718a5b596 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:51.569684 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc2700-3b96-419e-b906-3ec718a5b596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:51.571359 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4cdc2700-3b96-419e-b906-3ec718a5b596 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:51.694217 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc2700-3b96-419e-b906-3ec718a5b596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:51.695588 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc2700-3b96-419e-b906-3ec718a5b596 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:51.707524 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:51.718945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 667/1334] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:25:53.985729 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fbf71-f024-4b3b-ac02-71d5b93cd88e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:53.986309 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fbf71-f024-4b3b-ac02-71d5b93cd88e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:53.986309 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fbf71-f024-4b3b-ac02-71d5b93cd88e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:53.987687 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 668/1335] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:25:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:25:53.996237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692293c-00bc-4a6a-93df-820b92c4b34f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:53.996955 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692293c-00bc-4a6a-93df-820b92c4b34f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:53.997103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692293c-00bc-4a6a-93df-820b92c4b34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:54.066509 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a692293c-00bc-4a6a-93df-820b92c4b34f None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:25:54.067719 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a692293c-00bc-4a6a-93df-820b92c4b34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:54.177638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 668/1336] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:25:54.217157 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fbf71-f024-4b3b-ac02-71d5b93cd88e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:54.218999 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b30fbf71-f024-4b3b-ac02-71d5b93cd88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:54.265481 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:54.335383 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fbf71-f024-4b3b-ac02-71d5b93cd88e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:54.412965 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838e704-5e23-4036-b4ab-4848b8b0151e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:54.413614 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838e704-5e23-4036-b4ab-4848b8b0151e service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:54.413902 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838e704-5e23-4036-b4ab-4848b8b0151e service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:54.414177 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838e704-5e23-4036-b4ab-4848b8b0151e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:54.415834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d838e704-5e23-4036-b4ab-4848b8b0151e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:54.523786 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:54.560294 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838e704-5e23-4036-b4ab-4848b8b0151e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:54.562148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838e704-5e23-4036-b4ab-4848b8b0151e service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:54.585971 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 669/1337] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:25:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:25:57.294996 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97129e24-cadb-459e-978a-a8dcfedb0bf7 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:57.295477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97129e24-cadb-459e-978a-a8dcfedb0bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:57.295592 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97129e24-cadb-459e-978a-a8dcfedb0bf7 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:57.297396 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 669/1338] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:25:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:25:57.302971 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26406af8-ff08-4173-a034-cd718ff978e5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:57.303371 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26406af8-ff08-4173-a034-cd718ff978e5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:57.303561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26406af8-ff08-4173-a034-cd718ff978e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:57.376370 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-26406af8-ff08-4173-a034-cd718ff978e5 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:25:57.377589 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-26406af8-ff08-4173-a034-cd718ff978e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:57.483907 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 670/1339] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:25:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:25:57.523441 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97129e24-cadb-459e-978a-a8dcfedb0bf7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:25:57.525036 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-97129e24-cadb-459e-978a-a8dcfedb0bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:57.612255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:25:57.641420 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97129e24-cadb-459e-978a-a8dcfedb0bf7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:25:57.729056 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a44cf-9e2e-4f1f-a33c-bc1e404eb5b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:25:57.729710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a44cf-9e2e-4f1f-a33c-bc1e404eb5b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:25:57.729992 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a44cf-9e2e-4f1f-a33c-bc1e404eb5b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:25:57.730252 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a44cf-9e2e-4f1f-a33c-bc1e404eb5b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:25:57.731945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-836a44cf-9e2e-4f1f-a33c-bc1e404eb5b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:25:57.862356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a44cf-9e2e-4f1f-a33c-bc1e404eb5b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:25:57.863731 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a44cf-9e2e-4f1f-a33c-bc1e404eb5b3 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:25:57.883901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 670/1340] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:25:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:26:02.179951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077613ff-dbc7-4f71-84b2-5deeec2472c9 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:02.180544 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077613ff-dbc7-4f71-84b2-5deeec2472c9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:02.180544 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077613ff-dbc7-4f71-84b2-5deeec2472c9 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:02.182073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 671/1341] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:02.187645 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231527f-dab1-4f87-bc8e-1c289e787a06 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:02.188137 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231527f-dab1-4f87-bc8e-1c289e787a06 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:02.188231 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231527f-dab1-4f87-bc8e-1c289e787a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:02.195185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:26:02.264681 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1231527f-dab1-4f87-bc8e-1c289e787a06 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:02.266004 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1231527f-dab1-4f87-bc8e-1c289e787a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:02.379175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 671/1342] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:02.417735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077613ff-dbc7-4f71-84b2-5deeec2472c9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:26:02.420269 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-077613ff-dbc7-4f71-84b2-5deeec2472c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:02.473560 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:26:02.525936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077613ff-dbc7-4f71-84b2-5deeec2472c9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:26:02.529705 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc480b25-1f89-45c3-a574-027b0c78dfb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:26:02.530436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc480b25-1f89-45c3-a574-027b0c78dfb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:02.530741 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc480b25-1f89-45c3-a574-027b0c78dfb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:02.531113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc480b25-1f89-45c3-a574-027b0c78dfb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:02.541324 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc480b25-1f89-45c3-a574-027b0c78dfb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:26:02.542806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc480b25-1f89-45c3-a574-027b0c78dfb3 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:26:02.553470 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 672/1343] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:26:05.356466 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e23e24-baeb-49d6-a6fe-ce03c6c4062a None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:05.357004 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e23e24-baeb-49d6-a6fe-ce03c6c4062a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:05.357004 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e23e24-baeb-49d6-a6fe-ce03c6c4062a None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:05.358356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 672/1344] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:05.364132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fcc61-c260-402f-a24a-f2b85173d4a8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:05.364626 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fcc61-c260-402f-a24a-f2b85173d4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:05.364810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046fcc61-c260-402f-a24a-f2b85173d4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:05.394484 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-046fcc61-c260-402f-a24a-f2b85173d4a8 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:05.395682 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-046fcc61-c260-402f-a24a-f2b85173d4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:05.493910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 673/1345] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:26:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:05.531573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e23e24-baeb-49d6-a6fe-ce03c6c4062a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:26:05.533462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-05e23e24-baeb-49d6-a6fe-ce03c6c4062a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:05.551992 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e23e24-baeb-49d6-a6fe-ce03c6c4062a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:26:05.555963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5464d-66c3-4ff8-86da-4a5882a1f4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:26:05.556658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5464d-66c3-4ff8-86da-4a5882a1f4eb service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:05.556934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5464d-66c3-4ff8-86da-4a5882a1f4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:05.557221 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5464d-66c3-4ff8-86da-4a5882a1f4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:05.567771 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5464d-66c3-4ff8-86da-4a5882a1f4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:26:05.569291 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5464d-66c3-4ff8-86da-4a5882a1f4eb service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:26:05.581987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 673/1346] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:26:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:26:10.181097 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddd54d-722b-4d86-8523-f0d38c3a838e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:10.181658 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddd54d-722b-4d86-8523-f0d38c3a838e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:10.181755 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddd54d-722b-4d86-8523-f0d38c3a838e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:10.183191 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 674/1347] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:10.188838 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b05c8-bd9a-49c3-8c6a-15cbe387e9a1 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:10.189298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b05c8-bd9a-49c3-8c6a-15cbe387e9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:10.189405 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b05c8-bd9a-49c3-8c6a-15cbe387e9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:10.209112 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a92b05c8-bd9a-49c3-8c6a-15cbe387e9a1 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:10.210347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a92b05c8-bd9a-49c3-8c6a-15cbe387e9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:10.219961 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 674/1348] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:10.259221 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddd54d-722b-4d86-8523-f0d38c3a838e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:26:10.272237 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddd54d-722b-4d86-8523-f0d38c3a838e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:26:10.276140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a64331-0ec5-404d-96d8-797ff02a853f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:26:10.276794 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a64331-0ec5-404d-96d8-797ff02a853f service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:10.277079 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a64331-0ec5-404d-96d8-797ff02a853f service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:10.277764 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a64331-0ec5-404d-96d8-797ff02a853f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:10.288098 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a64331-0ec5-404d-96d8-797ff02a853f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:26:10.289591 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a64331-0ec5-404d-96d8-797ff02a853f service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:26:10.299947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 675/1349] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:26:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:26:15.763118 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608ddb-66c4-4590-881a-a92a0ab6248c None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:15.763643 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608ddb-66c4-4590-881a-a92a0ab6248c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:15.763904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608ddb-66c4-4590-881a-a92a0ab6248c None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:15.768522 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 675/1350] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 16:26:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:15.774476 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5b7ce-bdae-4366-8ddd-82da649711c7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:15.775382 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5b7ce-bdae-4366-8ddd-82da649711c7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:15.775872 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5b7ce-bdae-4366-8ddd-82da649711c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:15.856986 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-05b5b7ce-bdae-4366-8ddd-82da649711c7 None None] MFA Rules not processed for user `1266a87d93da4f8d9a1ccafa03067169`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:15.858812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-05b5b7ce-bdae-4366-8ddd-82da649711c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:15.890765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:26:15.987473 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 676/1351] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 16:26:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:26:20.203183 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=72 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:26:20.404606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dc1a8-c84f-4743-91bf-9b26f80ef1fa None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:20.404879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dc1a8-c84f-4743-91bf-9b26f80ef1fa None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:20.406082 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6dc1a8-c84f-4743-91bf-9b26f80ef1fa None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:20.407663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 676/1352] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 16:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:20.413760 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d745f8-9833-4f84-a405-31a887ee313b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:20.414629 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d745f8-9833-4f84-a405-31a887ee313b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:20.415021 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d745f8-9833-4f84-a405-31a887ee313b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:20.434392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-51d745f8-9833-4f84-a405-31a887ee313b None None] MFA Rules not processed for user `1266a87d93da4f8d9a1ccafa03067169`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:20.435643 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-51d745f8-9833-4f84-a405-31a887ee313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:20.445640 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 677/1353] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 16:26:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:21.985686 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aa762-816c-41e2-aee8-fcd48827b552 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:21.986249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aa762-816c-41e2-aee8-fcd48827b552 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:21.986460 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aa762-816c-41e2-aee8-fcd48827b552 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:21.988030 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 677/1354] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 16:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:21.993669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54cb2d-9d43-4d35-a58b-b06c1ed4fc60 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:21.994083 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54cb2d-9d43-4d35-a58b-b06c1ed4fc60 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:21.994358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54cb2d-9d43-4d35-a58b-b06c1ed4fc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:22.013482 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-aa54cb2d-9d43-4d35-a58b-b06c1ed4fc60 None None] MFA Rules not processed for user `1266a87d93da4f8d9a1ccafa03067169`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:22.014938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-aa54cb2d-9d43-4d35-a58b-b06c1ed4fc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:22.025573 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 678/1355] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 16:26:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:25.843066 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9286b-9d9b-40a8-ad8b-174094960b2e None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:25.843838 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9286b-9d9b-40a8-ad8b-174094960b2e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:25.843838 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9286b-9d9b-40a8-ad8b-174094960b2e None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:25.844956 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 678/1356] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:25.850678 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111cfa4-18e4-4120-bbc0-17f7eb3fcd31 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:25.851116 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111cfa4-18e4-4120-bbc0-17f7eb3fcd31 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:25.851228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111cfa4-18e4-4120-bbc0-17f7eb3fcd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:25.871426 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d111cfa4-18e4-4120-bbc0-17f7eb3fcd31 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:25.872664 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d111cfa4-18e4-4120-bbc0-17f7eb3fcd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:25.882328 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 679/1357] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:25.937174 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30477670-0212-49b2-9295-ac1722b3c991 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:25.937887 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30477670-0212-49b2-9295-ac1722b3c991 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:25.938382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30477670-0212-49b2-9295-ac1722b3c991 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:25.940523 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 679/1358] 10.222.0.41 () {54 vars in 961 bytes} [Fri May 27 16:26:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:25.949065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e86d6e-ee7c-43c9-bd17-e7a4eef52f14 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:25.949813 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e86d6e-ee7c-43c9-bd17-e7a4eef52f14 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:25.950452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e86d6e-ee7c-43c9-bd17-e7a4eef52f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:26.007154 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e0e86d6e-ee7c-43c9-bd17-e7a4eef52f14 None None] MFA Rules not processed for user `3caa3dbc7bd24ebba28296a1eba9cefe`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:26.008382 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e0e86d6e-ee7c-43c9-bd17-e7a4eef52f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:26.112189 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 680/1359] 10.222.0.41 () {58 vars in 1058 bytes} [Fri May 27 16:26:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:26:26.115539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30477670-0212-49b2-9295-ac1722b3c991 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:26:26.131018 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30477670-0212-49b2-9295-ac1722b3c991 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:26:26.136524 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ed103-cb07-42be-9e95-3d9ace8d8a06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:26:26.137309 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ed103-cb07-42be-9e95-3d9ace8d8a06 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:26.137591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ed103-cb07-42be-9e95-3d9ace8d8a06 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:26.137984 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ed103-cb07-42be-9e95-3d9ace8d8a06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:26.146920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ed103-cb07-42be-9e95-3d9ace8d8a06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:26:26.148628 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ed103-cb07-42be-9e95-3d9ace8d8a06 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:26:26.159099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 680/1360] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:26:28.614790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65540f21-7a50-4d6a-9e9e-e1b0dbabb74f None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:28.615310 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65540f21-7a50-4d6a-9e9e-e1b0dbabb74f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:28.615310 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65540f21-7a50-4d6a-9e9e-e1b0dbabb74f None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:28.616896 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 681/1361] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:28.622093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055db74-00e3-404b-a229-999ce02a9609 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:28.622535 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055db74-00e3-404b-a229-999ce02a9609 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:28.622639 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055db74-00e3-404b-a229-999ce02a9609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:28.640853 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a055db74-00e3-404b-a229-999ce02a9609 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:28.642046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a055db74-00e3-404b-a229-999ce02a9609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:28.650254 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 681/1362] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:28.696588 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65540f21-7a50-4d6a-9e9e-e1b0dbabb74f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:26:28.713115 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65540f21-7a50-4d6a-9e9e-e1b0dbabb74f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:26:28.719012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf2f3d-0f33-4b20-9a5b-acce31932075 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:26:28.719667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf2f3d-0f33-4b20-9a5b-acce31932075 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:28.719946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf2f3d-0f33-4b20-9a5b-acce31932075 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:28.720244 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf2f3d-0f33-4b20-9a5b-acce31932075 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:28.729327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf2f3d-0f33-4b20-9a5b-acce31932075 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:26:28.730922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf2f3d-0f33-4b20-9a5b-acce31932075 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:26:28.741966 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 682/1363] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:26:31.299567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e13780-8d50-4113-a385-4913cd4b760c None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:31.300429 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e13780-8d50-4113-a385-4913cd4b760c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:31.300704 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e13780-8d50-4113-a385-4913cd4b760c None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:31.302143 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 682/1364] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:26:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:31.307915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af755a-97d9-4c51-911a-70f46d694fd9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:31.308719 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af755a-97d9-4c51-911a-70f46d694fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:31.308719 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af755a-97d9-4c51-911a-70f46d694fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:31.328300 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-83af755a-97d9-4c51-911a-70f46d694fd9 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:31.329594 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-83af755a-97d9-4c51-911a-70f46d694fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:31.337979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 683/1365] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:31.392188 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26874c-094f-4a78-a5bf-489082eddc24 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:31.392559 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26874c-094f-4a78-a5bf-489082eddc24 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:31.392746 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26874c-094f-4a78-a5bf-489082eddc24 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:31.395760 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 683/1366] 10.222.0.41 () {54 vars in 961 bytes} [Fri May 27 16:26:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:31.401874 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43defda1-761d-4de1-a5a1-4ca1ba290a7f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:31.402151 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43defda1-761d-4de1-a5a1-4ca1ba290a7f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:31.402588 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43defda1-761d-4de1-a5a1-4ca1ba290a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:31.423773 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-43defda1-761d-4de1-a5a1-4ca1ba290a7f None None] MFA Rules not processed for user `3caa3dbc7bd24ebba28296a1eba9cefe`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:31.424995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-43defda1-761d-4de1-a5a1-4ca1ba290a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:31.436814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 684/1367] 10.222.0.41 () {58 vars in 1058 bytes} [Fri May 27 16:26:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:31.452681 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26874c-094f-4a78-a5bf-489082eddc24 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:26:31.481094 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26874c-094f-4a78-a5bf-489082eddc24 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:26:31.487020 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851f7e7-527b-46aa-801b-fcd301efec02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:26:31.487687 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851f7e7-527b-46aa-801b-fcd301efec02 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:31.487970 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851f7e7-527b-46aa-801b-fcd301efec02 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:31.488775 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851f7e7-527b-46aa-801b-fcd301efec02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:31.497554 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851f7e7-527b-46aa-801b-fcd301efec02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:26:31.499290 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851f7e7-527b-46aa-801b-fcd301efec02 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:26:31.510159 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 684/1368] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:26:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:26:33.836301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db723f2-78c2-4ee7-8077-f8848db47dd1 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:33.836889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db723f2-78c2-4ee7-8077-f8848db47dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:33.836889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db723f2-78c2-4ee7-8077-f8848db47dd1 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:33.838249 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 685/1369] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:26:33.844241 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb1cb2-6430-4029-8fe6-022afb8de731 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:33.844754 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb1cb2-6430-4029-8fe6-022afb8de731 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:33.844839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb1cb2-6430-4029-8fe6-022afb8de731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:33.864624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-71eb1cb2-6430-4029-8fe6-022afb8de731 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:33.865869 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-71eb1cb2-6430-4029-8fe6-022afb8de731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:33.875538 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 685/1370] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:33.920118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db723f2-78c2-4ee7-8077-f8848db47dd1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:26:33.934759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db723f2-78c2-4ee7-8077-f8848db47dd1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:26:33.941287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531ae85-9245-42e8-a244-e51c66154b26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:26:33.941972 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531ae85-9245-42e8-a244-e51c66154b26 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:33.942237 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531ae85-9245-42e8-a244-e51c66154b26 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:33.942535 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531ae85-9245-42e8-a244-e51c66154b26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:33.951505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531ae85-9245-42e8-a244-e51c66154b26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:26:33.953514 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531ae85-9245-42e8-a244-e51c66154b26 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:26:33.963944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 686/1371] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:26:34.262688 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d6db1-6e95-446a-8330-87513749017f None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:34.263065 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d6db1-6e95-446a-8330-87513749017f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:34.263313 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d6db1-6e95-446a-8330-87513749017f None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:34.265139 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 686/1372] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:34.271124 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112643e-7a6d-4c1b-a27f-293c55b793bf None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:34.271771 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112643e-7a6d-4c1b-a27f-293c55b793bf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:34.272297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112643e-7a6d-4c1b-a27f-293c55b793bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:34.291872 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9112643e-7a6d-4c1b-a27f-293c55b793bf None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:34.293348 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9112643e-7a6d-4c1b-a27f-293c55b793bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:34.304386 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 687/1373] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:34.581732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dd7eb-2a8e-4ed4-a728-cd90d4c55ff2 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:34.583001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dd7eb-2a8e-4ed4-a728-cd90d4c55ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:34.583406 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dd7eb-2a8e-4ed4-a728-cd90d4c55ff2 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:34.585029 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 687/1374] 10.222.0.41 () {54 vars in 963 bytes} [Fri May 27 16:26:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:34.593384 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e9ad3-a1af-4700-aaa3-e190c6bb649b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:34.593642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e9ad3-a1af-4700-aaa3-e190c6bb649b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:34.594186 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e9ad3-a1af-4700-aaa3-e190c6bb649b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:34.602275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:26:34.652943 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-746e9ad3-a1af-4700-aaa3-e190c6bb649b None None] MFA Rules not processed for user `4561bdacf98d47a6beffbcc400120bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:34.654491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-746e9ad3-a1af-4700-aaa3-e190c6bb649b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:34.731793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 688/1375] 10.222.0.41 () {58 vars in 1060 bytes} [Fri May 27 16:26:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:34.738828 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dd7eb-2a8e-4ed4-a728-cd90d4c55ff2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:26:34.751669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dd7eb-2a8e-4ed4-a728-cd90d4c55ff2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:26:34.755495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e9a8c-2853-43ed-8c8d-a375eec30e6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:26:34.756465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e9a8c-2853-43ed-8c8d-a375eec30e6a service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:34.757006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e9a8c-2853-43ed-8c8d-a375eec30e6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:34.757495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e9a8c-2853-43ed-8c8d-a375eec30e6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:34.768117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e9a8c-2853-43ed-8c8d-a375eec30e6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:26:34.769717 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e9a8c-2853-43ed-8c8d-a375eec30e6a service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:26:34.782537 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 688/1376] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:26:36.285751 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91be097-cc00-4fd3-bee4-054f821e6205 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:36.286531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91be097-cc00-4fd3-bee4-054f821e6205 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:36.286531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91be097-cc00-4fd3-bee4-054f821e6205 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:36.288291 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 689/1377] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:36.293792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15f711-bb2d-4b7c-9b8c-e69ac1e9cd76 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:36.294250 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15f711-bb2d-4b7c-9b8c-e69ac1e9cd76 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:36.294370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15f711-bb2d-4b7c-9b8c-e69ac1e9cd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:36.314248 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7c15f711-bb2d-4b7c-9b8c-e69ac1e9cd76 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:36.315450 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7c15f711-bb2d-4b7c-9b8c-e69ac1e9cd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:36.324931 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 689/1378] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:36.370308 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91be097-cc00-4fd3-bee4-054f821e6205 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:26:36.386907 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91be097-cc00-4fd3-bee4-054f821e6205 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:26:36.393935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639684d3-c879-4493-b7fd-bc5bb96d4774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:26:36.394695 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639684d3-c879-4493-b7fd-bc5bb96d4774 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:36.395045 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639684d3-c879-4493-b7fd-bc5bb96d4774 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:36.395386 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639684d3-c879-4493-b7fd-bc5bb96d4774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:36.404884 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639684d3-c879-4493-b7fd-bc5bb96d4774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:26:36.406787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639684d3-c879-4493-b7fd-bc5bb96d4774 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:26:36.417341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 690/1379] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:26:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:26:38.791761 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7d93f-f06d-4fda-9d0c-615968275470 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:38.792678 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7d93f-f06d-4fda-9d0c-615968275470 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:38.793105 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7d93f-f06d-4fda-9d0c-615968275470 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:38.795044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 690/1380] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:26:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:38.800999 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbf1bc-a633-4040-bdd7-f7b6390020e7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:38.801893 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbf1bc-a633-4040-bdd7-f7b6390020e7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:38.802324 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbf1bc-a633-4040-bdd7-f7b6390020e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:38.822246 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-54fbf1bc-a633-4040-bdd7-f7b6390020e7 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:38.823459 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-54fbf1bc-a633-4040-bdd7-f7b6390020e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:38.832711 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 691/1381] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:26:38.879498 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7d93f-f06d-4fda-9d0c-615968275470 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:26:38.896330 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7d93f-f06d-4fda-9d0c-615968275470 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:26:38.902252 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ee36e-8ab1-45c3-9e09-922ab87efc53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:26:38.902922 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ee36e-8ab1-45c3-9e09-922ab87efc53 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:38.903201 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ee36e-8ab1-45c3-9e09-922ab87efc53 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:38.904449 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ee36e-8ab1-45c3-9e09-922ab87efc53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:38.914319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ee36e-8ab1-45c3-9e09-922ab87efc53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:26:38.915986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ee36e-8ab1-45c3-9e09-922ab87efc53 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:26:38.929208 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 691/1382] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:26:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:26:41.317065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383da31-b549-434f-a5a1-b00b8fc1f397 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:41.317682 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383da31-b549-434f-a5a1-b00b8fc1f397 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:41.317682 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383da31-b549-434f-a5a1-b00b8fc1f397 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:41.318995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 692/1383] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:41.325286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425d89-7636-41e4-ad66-5a62243cfe1c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:41.325928 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425d89-7636-41e4-ad66-5a62243cfe1c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:41.326269 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425d89-7636-41e4-ad66-5a62243cfe1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:41.349337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-5c425d89-7636-41e4-ad66-5a62243cfe1c None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:41.350699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5c425d89-7636-41e4-ad66-5a62243cfe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:41.360368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 692/1384] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:26:41.406523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383da31-b549-434f-a5a1-b00b8fc1f397 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:26:41.424430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383da31-b549-434f-a5a1-b00b8fc1f397 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:26:41.434280 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f661368-1f8d-4f1c-bf83-b75d04afee80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:26:41.435436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f661368-1f8d-4f1c-bf83-b75d04afee80 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:41.436113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f661368-1f8d-4f1c-bf83-b75d04afee80 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:41.437547 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f661368-1f8d-4f1c-bf83-b75d04afee80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:41.450745 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f661368-1f8d-4f1c-bf83-b75d04afee80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:26:41.453695 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f661368-1f8d-4f1c-bf83-b75d04afee80 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:26:41.465334 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 693/1385] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:26:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:26:43.834806 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51843e35-0684-424c-92ff-c4d501f7c428 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:43.835437 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51843e35-0684-424c-92ff-c4d501f7c428 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:43.835437 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51843e35-0684-424c-92ff-c4d501f7c428 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:43.836780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 693/1386] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:43.843198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a67e8d-6eb2-47ea-9682-61ca51a1a5a4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:43.843748 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a67e8d-6eb2-47ea-9682-61ca51a1a5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:43.844315 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a67e8d-6eb2-47ea-9682-61ca51a1a5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:43.869767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-11a67e8d-6eb2-47ea-9682-61ca51a1a5a4 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:43.871472 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-11a67e8d-6eb2-47ea-9682-61ca51a1a5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:43.882658 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 694/1387] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:43.927329 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51843e35-0684-424c-92ff-c4d501f7c428 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:26:43.943273 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51843e35-0684-424c-92ff-c4d501f7c428 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:26:43.950643 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760ac45-07da-4ee6-960e-a92bf565b063 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:26:43.952310 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760ac45-07da-4ee6-960e-a92bf565b063 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:43.952717 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760ac45-07da-4ee6-960e-a92bf565b063 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:43.953081 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760ac45-07da-4ee6-960e-a92bf565b063 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:43.966368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760ac45-07da-4ee6-960e-a92bf565b063 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:26:43.969488 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760ac45-07da-4ee6-960e-a92bf565b063 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:26:43.985389 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 694/1388] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:26:46.385654 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c6a8f-2320-4c49-988a-e3deaa83c26e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:46.386201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c6a8f-2320-4c49-988a-e3deaa83c26e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:46.386201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c6a8f-2320-4c49-988a-e3deaa83c26e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:46.387703 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 695/1389] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:46.394109 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424fac6-bad0-46ed-9299-dbd5a634a786 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:46.394566 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424fac6-bad0-46ed-9299-dbd5a634a786 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:46.394667 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424fac6-bad0-46ed-9299-dbd5a634a786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:46.414737 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3424fac6-bad0-46ed-9299-dbd5a634a786 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:46.415956 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3424fac6-bad0-46ed-9299-dbd5a634a786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:46.426646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 695/1390] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:46.474621 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c6a8f-2320-4c49-988a-e3deaa83c26e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:26:46.492638 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c6a8f-2320-4c49-988a-e3deaa83c26e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:26:46.499440 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd35a771-a4eb-4738-a8b2-ad080cd8b5fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:26:46.500375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35a771-a4eb-4738-a8b2-ad080cd8b5fc service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:46.500921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35a771-a4eb-4738-a8b2-ad080cd8b5fc service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:46.501336 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd35a771-a4eb-4738-a8b2-ad080cd8b5fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:46.513269 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35a771-a4eb-4738-a8b2-ad080cd8b5fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:26:46.515414 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd35a771-a4eb-4738-a8b2-ad080cd8b5fc service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:26:46.528298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 696/1391] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:26:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:26:48.899036 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e0620-5710-4c86-89b8-27b2edca6aac None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:48.899798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e0620-5710-4c86-89b8-27b2edca6aac None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:48.899798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e0620-5710-4c86-89b8-27b2edca6aac None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:48.901132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 696/1392] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:48.907360 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed1b8b-f184-4fef-ba49-88d9c841342a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:48.907958 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed1b8b-f184-4fef-ba49-88d9c841342a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:48.907958 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed1b8b-f184-4fef-ba49-88d9c841342a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:48.928555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c4ed1b8b-f184-4fef-ba49-88d9c841342a None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:48.930150 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c4ed1b8b-f184-4fef-ba49-88d9c841342a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:48.938906 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 697/1393] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:48.989516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e0620-5710-4c86-89b8-27b2edca6aac None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:26:49.008477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e0620-5710-4c86-89b8-27b2edca6aac None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:26:49.015375 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287fb8b-79c7-45b1-9156-087d7b84dd89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:26:49.016678 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287fb8b-79c7-45b1-9156-087d7b84dd89 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:49.017260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287fb8b-79c7-45b1-9156-087d7b84dd89 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:49.018160 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287fb8b-79c7-45b1-9156-087d7b84dd89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:49.029139 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287fb8b-79c7-45b1-9156-087d7b84dd89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:26:49.030761 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287fb8b-79c7-45b1-9156-087d7b84dd89 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:26:49.041314 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 697/1394] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:26:51.162727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73215337-0d40-4c29-b94f-9dfbbc0074a4 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:51.163766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73215337-0d40-4c29-b94f-9dfbbc0074a4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:51.164079 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73215337-0d40-4c29-b94f-9dfbbc0074a4 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:51.165852 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 698/1395] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:51.175727 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290bf64-01e3-4649-92f5-311b5e5c0e17 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:51.176321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290bf64-01e3-4649-92f5-311b5e5c0e17 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:51.176689 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c290bf64-01e3-4649-92f5-311b5e5c0e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:51.184001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=52 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:26:51.199609 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c290bf64-01e3-4649-92f5-311b5e5c0e17 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:51.200964 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c290bf64-01e3-4649-92f5-311b5e5c0e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:51.210652 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 698/1396] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:51.269736 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9212d-4fc3-4b57-a8f8-531b82e26a15 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:51.270023 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9212d-4fc3-4b57-a8f8-531b82e26a15 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:51.270497 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9212d-4fc3-4b57-a8f8-531b82e26a15 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:51.271901 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 699/1397] 10.222.0.41 () {54 vars in 962 bytes} [Fri May 27 16:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:51.290289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f878d72-2b5d-4e09-8807-0369e2674e3c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:51.291033 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f878d72-2b5d-4e09-8807-0369e2674e3c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:51.291334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f878d72-2b5d-4e09-8807-0369e2674e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:51.350038 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7f878d72-2b5d-4e09-8807-0369e2674e3c None None] MFA Rules not processed for user `b72987d279bf4767bad23918fc33302b`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:51.351089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7f878d72-2b5d-4e09-8807-0369e2674e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:51.370987 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92d13e-23da-4e32-aae9-6afb39af1597 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:51.371253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92d13e-23da-4e32-aae9-6afb39af1597 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:51.371525 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92d13e-23da-4e32-aae9-6afb39af1597 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:51.372962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 700/1398] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:51.378903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d685c3-f541-40cc-9c9c-3e40892fb5ff None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:51.379183 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d685c3-f541-40cc-9c9c-3e40892fb5ff None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:51.379454 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d685c3-f541-40cc-9c9c-3e40892fb5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:51.400087 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e2d685c3-f541-40cc-9c9c-3e40892fb5ff None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:51.401311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e2d685c3-f541-40cc-9c9c-3e40892fb5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:51.409899 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 701/1399] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:26:51.427340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 699/1400] 10.222.0.41 () {58 vars in 1059 bytes} [Fri May 27 16:26:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:51.435546 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d685c3-f541-40cc-9c9c-3e40892fb5ff None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:26:51.446665 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d685c3-f541-40cc-9c9c-3e40892fb5ff None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:26:51.450494 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64699104-23ea-475c-8e9f-2281df1d9890 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b72987d279bf4767bad23918fc33302b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:26:51.451325 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64699104-23ea-475c-8e9f-2281df1d9890 service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:51.451792 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64699104-23ea-475c-8e9f-2281df1d9890 service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:51.452444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64699104-23ea-475c-8e9f-2281df1d9890 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:51.456821 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f878d72-2b5d-4e09-8807-0369e2674e3c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:26:51.462346 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64699104-23ea-475c-8e9f-2281df1d9890 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:26:51.463819 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64699104-23ea-475c-8e9f-2281df1d9890 service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:26:51.470873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f878d72-2b5d-4e09-8807-0369e2674e3c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:26:51.475219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 702/1401] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:26:51.477144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5406c-3d20-4d27-a09c-74ef200d761e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:26:51.477826 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5406c-3d20-4d27-a09c-74ef200d761e service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:51.478099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5406c-3d20-4d27-a09c-74ef200d761e service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:51.478400 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5406c-3d20-4d27-a09c-74ef200d761e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:51.488263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5406c-3d20-4d27-a09c-74ef200d761e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:26:51.489912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5406c-3d20-4d27-a09c-74ef200d761e service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:26:51.500478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 700/1402] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:26:52.057282 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c931a-1858-42b0-8d29-b411154ee6cb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:52.057566 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c931a-1858-42b0-8d29-b411154ee6cb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:52.057859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c931a-1858-42b0-8d29-b411154ee6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:52.118779 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-861c931a-1858-42b0-8d29-b411154ee6cb None None] MFA Rules not processed for user `2ccee0bc7e2b41f4a2fe2a891a95b318`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:52.120332 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-861c931a-1858-42b0-8d29-b411154ee6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:52.156226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:26:52.199574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 703/1403] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 16:26:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:52.250515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d1090-ab56-44e5-8e50-0dc11aaaf1a2 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:52.251116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d1090-ab56-44e5-8e50-0dc11aaaf1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:52.251116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d1090-ab56-44e5-8e50-0dc11aaaf1a2 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:52.252555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 701/1404] 10.222.0.41 () {54 vars in 942 bytes} [Fri May 27 16:26:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:52.260265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35895ce9-6cf6-4ee4-bcbb-5fafd4fa4266 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:52.260778 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35895ce9-6cf6-4ee4-bcbb-5fafd4fa4266 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:52.261043 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35895ce9-6cf6-4ee4-bcbb-5fafd4fa4266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:52.332663 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-35895ce9-6cf6-4ee4-bcbb-5fafd4fa4266 None None] MFA Rules not processed for user `dbfcca96ad754692b3fb7f891013dafb`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:52.333896 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-35895ce9-6cf6-4ee4-bcbb-5fafd4fa4266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:52.423199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 704/1405] 10.222.0.41 () {58 vars in 1039 bytes} [Fri May 27 16:26:52 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:26:52.432557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d1090-ab56-44e5-8e50-0dc11aaaf1a2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:26:52.447981 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d1090-ab56-44e5-8e50-0dc11aaaf1a2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:26:52.454494 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa8394-e90f-42c0-b356-d1bf2c0d9800 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbfcca96ad754692b3fb7f891013dafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:26:52.455154 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa8394-e90f-42c0-b356-d1bf2c0d9800 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:52.455434 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa8394-e90f-42c0-b356-d1bf2c0d9800 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:52.455704 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa8394-e90f-42c0-b356-d1bf2c0d9800 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:52.465439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa8394-e90f-42c0-b356-d1bf2c0d9800 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:26:52.467054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa8394-e90f-42c0-b356-d1bf2c0d9800 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:26:52.475733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 702/1406] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 16:26:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:26:53.846390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5809a7-de25-4ad4-b5d8-19a0fdcf2661 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:53.846979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5809a7-de25-4ad4-b5d8-19a0fdcf2661 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:53.846979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5809a7-de25-4ad4-b5d8-19a0fdcf2661 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:53.849499 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 705/1407] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:26:53 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:26:53.856403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e973d-1952-4bed-9158-081d7b0fb55b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:53.857544 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e973d-1952-4bed-9158-081d7b0fb55b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:53.858553 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e973d-1952-4bed-9158-081d7b0fb55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:53.881559 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-fd5e973d-1952-4bed-9158-081d7b0fb55b None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:26:53.882830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fd5e973d-1952-4bed-9158-081d7b0fb55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:26:53.891424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 703/1408] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:26:53.941739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5809a7-de25-4ad4-b5d8-19a0fdcf2661 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:26:53.961526 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5809a7-de25-4ad4-b5d8-19a0fdcf2661 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:26:53.969631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536f918-f560-4daa-b5ff-1230c80ee5ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:26:53.970867 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536f918-f560-4daa-b5ff-1230c80ee5ec service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:26:53.971253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536f918-f560-4daa-b5ff-1230c80ee5ec service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:26:53.971563 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536f918-f560-4daa-b5ff-1230c80ee5ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:26:53.987980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536f918-f560-4daa-b5ff-1230c80ee5ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:26:53.990068 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536f918-f560-4daa-b5ff-1230c80ee5ec service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:26:54.006056 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 706/1409] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:03.875687 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=55 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:27:04.002530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=62 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:27:16.047433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faef9f2-0af0-457a-b953-5345526f02c3 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:16.048154 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faef9f2-0af0-457a-b953-5345526f02c3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:16.048154 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faef9f2-0af0-457a-b953-5345526f02c3 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:16.049904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 704/1410] 10.222.0.41 () {54 vars in 918 bytes} [Fri May 27 16:27:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:16.058982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abd09c-e4ec-463b-b5ee-8310fa2554bf None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:16.059522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abd09c-e4ec-463b-b5ee-8310fa2554bf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:16.059522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abd09c-e4ec-463b-b5ee-8310fa2554bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:16.083202 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d0abd09c-e4ec-463b-b5ee-8310fa2554bf None None] MFA Rules not processed for user `1266a87d93da4f8d9a1ccafa03067169`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:16.084481 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d0abd09c-e4ec-463b-b5ee-8310fa2554bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:16.093750 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 707/1411] 10.222.0.41 () {58 vars in 1015 bytes} [Fri May 27 16:27:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:16.110066 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078d5ca-380a-4d3a-bc20-ba3323bbecfb None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:16.110347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078d5ca-380a-4d3a-bc20-ba3323bbecfb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:16.110622 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078d5ca-380a-4d3a-bc20-ba3323bbecfb None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:16.112033 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 705/1412] 10.222.0.41 () {54 vars in 918 bytes} [Fri May 27 16:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:16.117684 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525d766-04c7-46b3-b793-cf8863455977 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:16.117975 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525d766-04c7-46b3-b793-cf8863455977 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:16.118820 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525d766-04c7-46b3-b793-cf8863455977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:16.142874 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b525d766-04c7-46b3-b793-cf8863455977 None None] MFA Rules not processed for user `3caa3dbc7bd24ebba28296a1eba9cefe`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:16.144713 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b525d766-04c7-46b3-b793-cf8863455977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:16.154788 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 708/1413] 10.222.0.41 () {58 vars in 1015 bytes} [Fri May 27 16:27:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:18.908146 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42938c13-d360-4a76-b536-ff90e57d2ea7 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:18.909067 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42938c13-d360-4a76-b536-ff90e57d2ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:18.909067 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42938c13-d360-4a76-b536-ff90e57d2ea7 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:18.911306 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:27:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:18.917335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aef64-4a03-484c-b07a-b7edc6d2053f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:18.917785 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aef64-4a03-484c-b07a-b7edc6d2053f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:18.917907 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1aef64-4a03-484c-b07a-b7edc6d2053f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:18.942789 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0f1aef64-4a03-484c-b07a-b7edc6d2053f None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:18.944545 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0f1aef64-4a03-484c-b07a-b7edc6d2053f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:18.958763 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:19.009058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42938c13-d360-4a76-b536-ff90e57d2ea7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:19.025546 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42938c13-d360-4a76-b536-ff90e57d2ea7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:19.031894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc33111-27ee-44b1-9521-8835594813f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:19.032577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc33111-27ee-44b1-9521-8835594813f4 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:19.032862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc33111-27ee-44b1-9521-8835594813f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:19.033138 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc33111-27ee-44b1-9521-8835594813f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:19.042432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc33111-27ee-44b1-9521-8835594813f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:19.044046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc33111-27ee-44b1-9521-8835594813f4 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:19.053635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 707/1416] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:27:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:27:20.034849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a31ef4-91a0-48b5-8c90-69eb35e6e81d None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:20.035473 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a31ef4-91a0-48b5-8c90-69eb35e6e81d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:20.035473 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a31ef4-91a0-48b5-8c90-69eb35e6e81d None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:20.037470 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:20.045275 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72924a1a-16cd-4400-83cc-470963305260 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:20.045701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72924a1a-16cd-4400-83cc-470963305260 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:20.045931 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72924a1a-16cd-4400-83cc-470963305260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:20.072828 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-72924a1a-16cd-4400-83cc-470963305260 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:20.074049 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-72924a1a-16cd-4400-83cc-470963305260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:20.083382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:20.245098 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a31ef4-91a0-48b5-8c90-69eb35e6e81d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:20.265612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a31ef4-91a0-48b5-8c90-69eb35e6e81d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:20.272814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025adb64-315d-4834-8fa7-619b5c9059c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:20.273459 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025adb64-315d-4834-8fa7-619b5c9059c6 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:20.273755 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025adb64-315d-4834-8fa7-619b5c9059c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:20.274012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025adb64-315d-4834-8fa7-619b5c9059c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:20.282851 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025adb64-315d-4834-8fa7-619b5c9059c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:20.284525 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025adb64-315d-4834-8fa7-619b5c9059c6 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:20.294527 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 711/1419] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:27:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:21.243367 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41333f-055a-4435-bb3d-b0368033f577 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:21.243963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41333f-055a-4435-bb3d-b0368033f577 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:21.243963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41333f-055a-4435-bb3d-b0368033f577 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:21.245343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:21.251298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0ae34-671e-4a8b-8f45-a9b120c62be0 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:21.251960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0ae34-671e-4a8b-8f45-a9b120c62be0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:21.252144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0ae34-671e-4a8b-8f45-a9b120c62be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:21.278484 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-19c0ae34-671e-4a8b-8f45-a9b120c62be0 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:21.279697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-19c0ae34-671e-4a8b-8f45-a9b120c62be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:21.289377 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:21.439629 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41333f-055a-4435-bb3d-b0368033f577 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:21.457402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41333f-055a-4435-bb3d-b0368033f577 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:21.463726 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad7059-a1dd-4d76-ade8-1d4bfa27b0fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:21.464404 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad7059-a1dd-4d76-ade8-1d4bfa27b0fd service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:21.464681 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad7059-a1dd-4d76-ade8-1d4bfa27b0fd service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:21.464968 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad7059-a1dd-4d76-ade8-1d4bfa27b0fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:21.473941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad7059-a1dd-4d76-ade8-1d4bfa27b0fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:21.475519 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad7059-a1dd-4d76-ade8-1d4bfa27b0fd service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:21.485068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 710/1422] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:22.408693 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02faad-8dfe-4e57-964a-1d6c1adfdd67 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:22.409566 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02faad-8dfe-4e57-964a-1d6c1adfdd67 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:22.409566 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02faad-8dfe-4e57-964a-1d6c1adfdd67 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:22.411674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:27:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:22.417854 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b6949-ea1a-44b8-b23f-a366143f0af7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:22.418317 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b6949-ea1a-44b8-b23f-a366143f0af7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:22.418415 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b6949-ea1a-44b8-b23f-a366143f0af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:22.445415 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-aa3b6949-ea1a-44b8-b23f-a366143f0af7 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:22.446638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-aa3b6949-ea1a-44b8-b23f-a366143f0af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:22.456620 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:22.606146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02faad-8dfe-4e57-964a-1d6c1adfdd67 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:22.621373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02faad-8dfe-4e57-964a-1d6c1adfdd67 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:22.627207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2adc26f-1ff4-4e0f-a883-6b20dd271bbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:22.627857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adc26f-1ff4-4e0f-a883-6b20dd271bbf service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:22.628165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adc26f-1ff4-4e0f-a883-6b20dd271bbf service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:22.628442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adc26f-1ff4-4e0f-a883-6b20dd271bbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:22.636964 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2adc26f-1ff4-4e0f-a883-6b20dd271bbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:22.638580 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2adc26f-1ff4-4e0f-a883-6b20dd271bbf service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:22.648840 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 714/1425] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:27:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:23.563172 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3c2d5-d652-4853-9754-f56b76e80555 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:23.563747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3c2d5-d652-4853-9754-f56b76e80555 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:23.563747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3c2d5-d652-4853-9754-f56b76e80555 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:23.565051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:23.570382 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9148b-68b5-4586-83bc-120200b85f0e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:23.570839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9148b-68b5-4586-83bc-120200b85f0e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:23.570938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9148b-68b5-4586-83bc-120200b85f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:23.592768 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e8c9148b-68b5-4586-83bc-120200b85f0e None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:23.593952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e8c9148b-68b5-4586-83bc-120200b85f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:23.603188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:23.749191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3c2d5-d652-4853-9754-f56b76e80555 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:23.765916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3c2d5-d652-4853-9754-f56b76e80555 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:23.773182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76901060-ccb9-4782-9a3e-5351c9429066 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:23.773819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76901060-ccb9-4782-9a3e-5351c9429066 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:23.774128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76901060-ccb9-4782-9a3e-5351c9429066 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:23.774423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76901060-ccb9-4782-9a3e-5351c9429066 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:23.783475 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76901060-ccb9-4782-9a3e-5351c9429066 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:23.785113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76901060-ccb9-4782-9a3e-5351c9429066 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:23.795178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 713/1428] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:24.669872 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa006ee9-d9ec-4fe6-a500-d8e7404bf624 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:24.670480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa006ee9-d9ec-4fe6-a500-d8e7404bf624 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:24.670480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa006ee9-d9ec-4fe6-a500-d8e7404bf624 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:24.671956 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:24.677185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfd6b5-4936-49b2-9cfd-d6f7568bf0b5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:24.677636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfd6b5-4936-49b2-9cfd-d6f7568bf0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:24.677747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfd6b5-4936-49b2-9cfd-d6f7568bf0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:24.701263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7bdfd6b5-4936-49b2-9cfd-d6f7568bf0b5 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:24.702831 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7bdfd6b5-4936-49b2-9cfd-d6f7568bf0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:24.712590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:24.864921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa006ee9-d9ec-4fe6-a500-d8e7404bf624 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:24.880954 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa006ee9-d9ec-4fe6-a500-d8e7404bf624 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:24.887158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78ff26-b561-4a89-9833-f1d16deab1e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:24.887798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78ff26-b561-4a89-9833-f1d16deab1e5 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:24.888117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78ff26-b561-4a89-9833-f1d16deab1e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:24.888401 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78ff26-b561-4a89-9833-f1d16deab1e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:24.900295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78ff26-b561-4a89-9833-f1d16deab1e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:24.902886 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78ff26-b561-4a89-9833-f1d16deab1e5 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:24.918056 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 717/1431] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:27:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:25.772349 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7080f1b-013f-448c-8879-93f7990c33b8 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:25.772930 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7080f1b-013f-448c-8879-93f7990c33b8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:25.772930 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7080f1b-013f-448c-8879-93f7990c33b8 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:25.774288 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:25.780735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd888d6-7917-4c6c-95cd-6ffba7e994df None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:25.781495 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd888d6-7917-4c6c-95cd-6ffba7e994df None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:25.781629 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd888d6-7917-4c6c-95cd-6ffba7e994df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:25.809357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-efd888d6-7917-4c6c-95cd-6ffba7e994df None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:25.810560 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-efd888d6-7917-4c6c-95cd-6ffba7e994df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:25.821161 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:25.971614 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7080f1b-013f-448c-8879-93f7990c33b8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:25.993041 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7080f1b-013f-448c-8879-93f7990c33b8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:26.003556 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b498a-f3b4-4aff-a862-59322ca55e0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:26.004564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b498a-f3b4-4aff-a862-59322ca55e0f service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:26.004929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b498a-f3b4-4aff-a862-59322ca55e0f service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:26.005202 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b498a-f3b4-4aff-a862-59322ca55e0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:26.014862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b498a-f3b4-4aff-a862-59322ca55e0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:26.016842 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b498a-f3b4-4aff-a862-59322ca55e0f service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:26.029805 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 716/1434] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:27:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:26.892583 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164e219-78c8-4fa6-b79b-887bf3a6c2c3 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:26.893532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164e219-78c8-4fa6-b79b-887bf3a6c2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:26.893532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164e219-78c8-4fa6-b79b-887bf3a6c2c3 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:26.895779 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:27:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:26.901096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf85d4c-b7a8-4625-ac5a-3ec593b74c46 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:26.901556 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf85d4c-b7a8-4625-ac5a-3ec593b74c46 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:26.901662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf85d4c-b7a8-4625-ac5a-3ec593b74c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:26.927338 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-aaf85d4c-b7a8-4625-ac5a-3ec593b74c46 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:26.929003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-aaf85d4c-b7a8-4625-ac5a-3ec593b74c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:26.943912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:27.093577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164e219-78c8-4fa6-b79b-887bf3a6c2c3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:27.112976 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164e219-78c8-4fa6-b79b-887bf3a6c2c3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:27.118989 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cca3fb-64fb-4866-a3e2-351d400da263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:27.119634 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cca3fb-64fb-4866-a3e2-351d400da263 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:27.119917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cca3fb-64fb-4866-a3e2-351d400da263 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:27.120221 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cca3fb-64fb-4866-a3e2-351d400da263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:27.129401 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cca3fb-64fb-4866-a3e2-351d400da263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:27.131045 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cca3fb-64fb-4866-a3e2-351d400da263 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:27.140956 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 720/1437] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:27:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:28.059022 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b968b37-87d8-4dbc-a635-d9508753de95 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:28.059627 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b968b37-87d8-4dbc-a635-d9508753de95 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:28.059627 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b968b37-87d8-4dbc-a635-d9508753de95 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:28.061039 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:28.066965 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9c5c4-17ac-4b9b-a59e-e25a8df5a48a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:28.067449 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9c5c4-17ac-4b9b-a59e-e25a8df5a48a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:28.067546 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9c5c4-17ac-4b9b-a59e-e25a8df5a48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:28.092560 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-89c9c5c4-17ac-4b9b-a59e-e25a8df5a48a None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:28.093766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-89c9c5c4-17ac-4b9b-a59e-e25a8df5a48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:28.102663 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:28.251541 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b968b37-87d8-4dbc-a635-d9508753de95 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:28.271795 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b968b37-87d8-4dbc-a635-d9508753de95 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:28.282110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8df7f-a52f-4645-bdf1-2ac70af65bde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:28.282993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8df7f-a52f-4645-bdf1-2ac70af65bde service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:28.283393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8df7f-a52f-4645-bdf1-2ac70af65bde service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:28.283723 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8df7f-a52f-4645-bdf1-2ac70af65bde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:28.294012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8df7f-a52f-4645-bdf1-2ac70af65bde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:28.295636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8df7f-a52f-4645-bdf1-2ac70af65bde service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:28.305934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 719/1440] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:27:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:30.394961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b947d50-ead3-4985-a6aa-745b37ca26b6 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:30.395689 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b947d50-ead3-4985-a6aa-745b37ca26b6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:30.395813 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b947d50-ead3-4985-a6aa-745b37ca26b6 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:30.397191 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:30.405868 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714033f-9332-483a-991f-5d2d20f92609 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:30.406418 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714033f-9332-483a-991f-5d2d20f92609 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:30.406418 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714033f-9332-483a-991f-5d2d20f92609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:30.434135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a714033f-9332-483a-991f-5d2d20f92609 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:30.435352 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a714033f-9332-483a-991f-5d2d20f92609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:30.445289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:30.488422 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b947d50-ead3-4985-a6aa-745b37ca26b6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:30.506873 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b947d50-ead3-4985-a6aa-745b37ca26b6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:30.511128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138da28-9860-47a3-96cc-c12ae4f5f3a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:30.511773 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138da28-9860-47a3-96cc-c12ae4f5f3a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:30.512061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138da28-9860-47a3-96cc-c12ae4f5f3a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:30.512362 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138da28-9860-47a3-96cc-c12ae4f5f3a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:30.521962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138da28-9860-47a3-96cc-c12ae4f5f3a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:30.523424 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138da28-9860-47a3-96cc-c12ae4f5f3a6 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:30.533168 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 723/1443] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:32.970989 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5088a-f552-416f-906a-15f93f3896ef None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:32.971599 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5088a-f552-416f-906a-15f93f3896ef None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:32.971599 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5088a-f552-416f-906a-15f93f3896ef None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:32.972957 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:27:32.980126 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b9642-cc2d-4e21-baf9-dd972fc91a3e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:32.980870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b9642-cc2d-4e21-baf9-dd972fc91a3e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:32.981078 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b9642-cc2d-4e21-baf9-dd972fc91a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:33.006395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7e8b9642-cc2d-4e21-baf9-dd972fc91a3e None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:33.007610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7e8b9642-cc2d-4e21-baf9-dd972fc91a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:33.015738 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:33.062899 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5088a-f552-416f-906a-15f93f3896ef None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:33.081136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5088a-f552-416f-906a-15f93f3896ef None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:33.085642 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd836f-2c85-40ba-8591-489482fa3c9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:33.086286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd836f-2c85-40ba-8591-489482fa3c9e service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:33.086567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd836f-2c85-40ba-8591-489482fa3c9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:33.086841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd836f-2c85-40ba-8591-489482fa3c9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:33.097603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd836f-2c85-40ba-8591-489482fa3c9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:33.099304 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd836f-2c85-40ba-8591-489482fa3c9e service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:33.109638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 722/1446] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:27:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:35.722776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce388f-fafa-4a10-a341-d65e7324f22a None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:35.723808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce388f-fafa-4a10-a341-d65e7324f22a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:35.723808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce388f-fafa-4a10-a341-d65e7324f22a None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:35.725082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:35.730946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbaab44-dc43-4a71-9763-666fa9567db9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:35.731566 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbaab44-dc43-4a71-9763-666fa9567db9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:35.731566 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbaab44-dc43-4a71-9763-666fa9567db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:35.752423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-bdbaab44-dc43-4a71-9763-666fa9567db9 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:35.753638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bdbaab44-dc43-4a71-9763-666fa9567db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:35.763750 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:35.806850 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce388f-fafa-4a10-a341-d65e7324f22a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:35.820040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce388f-fafa-4a10-a341-d65e7324f22a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:35.824168 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f11387-38a2-40b8-bb25-99e33b4b3217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:35.824820 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f11387-38a2-40b8-bb25-99e33b4b3217 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:35.825105 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f11387-38a2-40b8-bb25-99e33b4b3217 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:35.825379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f11387-38a2-40b8-bb25-99e33b4b3217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:35.836699 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f11387-38a2-40b8-bb25-99e33b4b3217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:35.838169 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f11387-38a2-40b8-bb25-99e33b4b3217 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:35.847722 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 726/1449] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:38.187193 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a770a-3593-43f7-8347-f2c3972c7bbb None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:38.187793 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a770a-3593-43f7-8347-f2c3972c7bbb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:38.187793 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a770a-3593-43f7-8347-f2c3972c7bbb None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:38.189196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:38.194942 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646dfa4-0893-4712-abb8-5081351cdd69 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:38.195397 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646dfa4-0893-4712-abb8-5081351cdd69 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:38.195512 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646dfa4-0893-4712-abb8-5081351cdd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:38.215047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b646dfa4-0893-4712-abb8-5081351cdd69 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:38.216373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b646dfa4-0893-4712-abb8-5081351cdd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:38.226295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:38.265454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a770a-3593-43f7-8347-f2c3972c7bbb None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:38.283793 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a770a-3593-43f7-8347-f2c3972c7bbb None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:38.288296 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d27447-1c6b-4472-84fa-80e098a39343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:38.288972 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d27447-1c6b-4472-84fa-80e098a39343 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:38.289351 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d27447-1c6b-4472-84fa-80e098a39343 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:38.289680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d27447-1c6b-4472-84fa-80e098a39343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:38.299496 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d27447-1c6b-4472-84fa-80e098a39343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:38.300989 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d27447-1c6b-4472-84fa-80e098a39343 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:38.310707 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 725/1452] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:40.558393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eecab1-f77c-45c3-8c10-515ee2958a4e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:40.559024 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eecab1-f77c-45c3-8c10-515ee2958a4e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:40.559024 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eecab1-f77c-45c3-8c10-515ee2958a4e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:40.560363 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:27:40.566818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2650-3ab7-43bb-9533-0733b4be191d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:40.567435 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2650-3ab7-43bb-9533-0733b4be191d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:40.567626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2650-3ab7-43bb-9533-0733b4be191d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:40.589022 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c64b2650-3ab7-43bb-9533-0733b4be191d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:40.590264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c64b2650-3ab7-43bb-9533-0733b4be191d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:40.599230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:40.641767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eecab1-f77c-45c3-8c10-515ee2958a4e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:40.655606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eecab1-f77c-45c3-8c10-515ee2958a4e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:40.662212 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90123752-d205-44bb-be6e-65076f8f1c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:40.662862 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90123752-d205-44bb-be6e-65076f8f1c52 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:40.663144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90123752-d205-44bb-be6e-65076f8f1c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:40.663417 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90123752-d205-44bb-be6e-65076f8f1c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:40.674582 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90123752-d205-44bb-be6e-65076f8f1c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:40.676047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90123752-d205-44bb-be6e-65076f8f1c52 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:40.685929 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 729/1455] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:27:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:43.037716 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1989239-e259-4653-a5ad-bfcd955ed816 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:43.038350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1989239-e259-4653-a5ad-bfcd955ed816 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:43.038350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1989239-e259-4653-a5ad-bfcd955ed816 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:43.039657 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:27:43.045817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8914a2f-9892-4247-950e-e08cf2ecca36 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:43.046338 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8914a2f-9892-4247-950e-e08cf2ecca36 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:43.046550 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8914a2f-9892-4247-950e-e08cf2ecca36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:43.065139 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b8914a2f-9892-4247-950e-e08cf2ecca36 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:43.066349 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b8914a2f-9892-4247-950e-e08cf2ecca36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:43.074796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:43.113004 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1989239-e259-4653-a5ad-bfcd955ed816 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:43.126400 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1989239-e259-4653-a5ad-bfcd955ed816 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:43.132482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457b368-427b-4466-8a45-36f854aaafb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:43.133139 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457b368-427b-4466-8a45-36f854aaafb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:43.133420 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457b368-427b-4466-8a45-36f854aaafb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:43.133727 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457b368-427b-4466-8a45-36f854aaafb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:43.144479 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457b368-427b-4466-8a45-36f854aaafb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:43.146576 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457b368-427b-4466-8a45-36f854aaafb1 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:43.159540 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 728/1458] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:27:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:45.468211 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907a2bb-42a2-45ff-b40e-fc8d13be58dd None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:45.468832 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907a2bb-42a2-45ff-b40e-fc8d13be58dd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:45.468832 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1907a2bb-42a2-45ff-b40e-fc8d13be58dd None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:45.470736 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:45.478111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db31186-43c6-47f0-bb48-00bc6e81603d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:45.478558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db31186-43c6-47f0-bb48-00bc6e81603d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:45.478655 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db31186-43c6-47f0-bb48-00bc6e81603d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:45.485298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=70 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:27:45.498630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0db31186-43c6-47f0-bb48-00bc6e81603d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:45.499830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0db31186-43c6-47f0-bb48-00bc6e81603d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:45.509386 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:45.548917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907a2bb-42a2-45ff-b40e-fc8d13be58dd None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:45.558591 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=73 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:27:45.568191 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1907a2bb-42a2-45ff-b40e-fc8d13be58dd None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:45.571970 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd096e-c315-46a6-9070-4e05e7ffc469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:45.572661 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd096e-c315-46a6-9070-4e05e7ffc469 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:45.572939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd096e-c315-46a6-9070-4e05e7ffc469 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:45.573204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd096e-c315-46a6-9070-4e05e7ffc469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:45.584038 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd096e-c315-46a6-9070-4e05e7ffc469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:45.585537 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd096e-c315-46a6-9070-4e05e7ffc469 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:45.595669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 732/1461] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:47.867025 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a98ea-2310-407e-9416-b4b65437f9c7 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:47.867626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a98ea-2310-407e-9416-b4b65437f9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:47.867626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a98ea-2310-407e-9416-b4b65437f9c7 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:47.869790 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:47.875527 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f223b47-4366-45d0-8ea8-e2bd666a34a9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:47.876034 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f223b47-4366-45d0-8ea8-e2bd666a34a9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:47.876134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f223b47-4366-45d0-8ea8-e2bd666a34a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:47.895890 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4f223b47-4366-45d0-8ea8-e2bd666a34a9 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:47.897181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4f223b47-4366-45d0-8ea8-e2bd666a34a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:47.905596 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:47.944041 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a98ea-2310-407e-9416-b4b65437f9c7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:47.959375 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a98ea-2310-407e-9416-b4b65437f9c7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:47.965258 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854ad7e-8aa9-4546-84ce-c6af97575ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:47.965911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854ad7e-8aa9-4546-84ce-c6af97575ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:47.966238 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854ad7e-8aa9-4546-84ce-c6af97575ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:47.966603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854ad7e-8aa9-4546-84ce-c6af97575ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:47.978910 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854ad7e-8aa9-4546-84ce-c6af97575ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:47.980429 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854ad7e-8aa9-4546-84ce-c6af97575ae7 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:47.990856 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 731/1464] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:27:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:50.236824 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a824a-47d1-49e5-b7ee-07d42e918ad5 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:50.237432 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a824a-47d1-49e5-b7ee-07d42e918ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:50.237432 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a824a-47d1-49e5-b7ee-07d42e918ad5 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:50.239383 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:50.247149 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7139de-a169-4d9c-9534-19e625851dfa None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:50.247620 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7139de-a169-4d9c-9534-19e625851dfa None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:50.247726 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7139de-a169-4d9c-9534-19e625851dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:50.269611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-cd7139de-a169-4d9c-9534-19e625851dfa None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:50.270979 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cd7139de-a169-4d9c-9534-19e625851dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:50.279952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:50.318976 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a824a-47d1-49e5-b7ee-07d42e918ad5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:50.335246 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a824a-47d1-49e5-b7ee-07d42e918ad5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:50.347418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75a7d4-7a2e-49fe-aa26-edd7c2078ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:50.348223 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75a7d4-7a2e-49fe-aa26-edd7c2078ebd service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:50.348647 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75a7d4-7a2e-49fe-aa26-edd7c2078ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:50.348930 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75a7d4-7a2e-49fe-aa26-edd7c2078ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:50.360159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75a7d4-7a2e-49fe-aa26-edd7c2078ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:50.361629 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75a7d4-7a2e-49fe-aa26-edd7c2078ebd service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:50.371794 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 735/1467] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:27:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:27:52.623326 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2a79b-9304-4dfd-abe8-5a0994758923 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:52.623930 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2a79b-9304-4dfd-abe8-5a0994758923 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:52.623930 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2a79b-9304-4dfd-abe8-5a0994758923 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:52.625921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:27:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:27:52.634717 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435dcc5-b851-47f0-86e6-6869b71f109d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:52.635171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435dcc5-b851-47f0-86e6-6869b71f109d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:52.635284 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435dcc5-b851-47f0-86e6-6869b71f109d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:52.653827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1435dcc5-b851-47f0-86e6-6869b71f109d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:27:52.655027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1435dcc5-b851-47f0-86e6-6869b71f109d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:27:52.663697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:27:52.699407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2a79b-9304-4dfd-abe8-5a0994758923 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:27:52.713024 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2a79b-9304-4dfd-abe8-5a0994758923 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:27:52.717664 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2ec76-917f-498a-bc5c-ee2f071567c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:27:52.718317 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2ec76-917f-498a-bc5c-ee2f071567c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:27:52.718605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2ec76-917f-498a-bc5c-ee2f071567c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:27:52.718887 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2ec76-917f-498a-bc5c-ee2f071567c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:27:52.729050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2ec76-917f-498a-bc5c-ee2f071567c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:27:52.730509 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2ec76-917f-498a-bc5c-ee2f071567c1 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:27:52.741052 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 734/1470] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:28:02.648502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=17 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:28:02.735825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=17 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:28:26.186980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029345ac-5268-450d-8feb-f70072602215 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:26.187585 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029345ac-5268-450d-8feb-f70072602215 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:26.187585 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029345ac-5268-450d-8feb-f70072602215 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:26.188961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 737/1471] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:28:26.194381 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de3bb-122a-4648-a78c-5beb2f3c3bfb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:26.194836 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de3bb-122a-4648-a78c-5beb2f3c3bfb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:26.194946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de3bb-122a-4648-a78c-5beb2f3c3bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:26.214685 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-494de3bb-122a-4648-a78c-5beb2f3c3bfb None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:28:26.215966 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-494de3bb-122a-4648-a78c-5beb2f3c3bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:28:26.224236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 735/1472] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:28:26.278637 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3ae3f-1b54-4ecb-86c6-d73dcbac4dd2 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:26.278928 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3ae3f-1b54-4ecb-86c6-d73dcbac4dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:26.279207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3ae3f-1b54-4ecb-86c6-d73dcbac4dd2 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:26.280685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 738/1473] 10.222.0.41 () {54 vars in 962 bytes} [Fri May 27 16:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:28:26.285771 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926377c-7465-4ef7-978e-9547b52378e2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:26.286154 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926377c-7465-4ef7-978e-9547b52378e2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:26.286437 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926377c-7465-4ef7-978e-9547b52378e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:26.307005 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d926377c-7465-4ef7-978e-9547b52378e2 None None] MFA Rules not processed for user `b72987d279bf4767bad23918fc33302b`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:28:26.308264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d926377c-7465-4ef7-978e-9547b52378e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:28:26.315537 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 736/1474] 10.222.0.41 () {58 vars in 1059 bytes} [Fri May 27 16:28:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:28:26.322870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3ae3f-1b54-4ecb-86c6-d73dcbac4dd2 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:28:26.335019 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3ae3f-1b54-4ecb-86c6-d73dcbac4dd2 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:28:26.338658 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c570d-1a16-44e8-a3e4-8c8d7b00e876 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b72987d279bf4767bad23918fc33302b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:28:26.339949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c570d-1a16-44e8-a3e4-8c8d7b00e876 service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:26.340268 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c570d-1a16-44e8-a3e4-8c8d7b00e876 service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:26.340567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c570d-1a16-44e8-a3e4-8c8d7b00e876 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:26.350211 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c570d-1a16-44e8-a3e4-8c8d7b00e876 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:28:26.351671 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c570d-1a16-44e8-a3e4-8c8d7b00e876 service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:28:26.360842 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 739/1475] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:28:28.704674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd460439-982c-48dc-a9ae-f6157e33be74 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:28.705211 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd460439-982c-48dc-a9ae-f6157e33be74 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:28.705211 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd460439-982c-48dc-a9ae-f6157e33be74 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:28.706614 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 737/1476] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:28:28.712820 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f99fa-4fac-4da5-9928-0ff51340a65e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:28.713297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f99fa-4fac-4da5-9928-0ff51340a65e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:28.713417 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f99fa-4fac-4da5-9928-0ff51340a65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:28.733020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3d6f99fa-4fac-4da5-9928-0ff51340a65e None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:28:28.734220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3d6f99fa-4fac-4da5-9928-0ff51340a65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:28:28.743506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 740/1477] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:28:28.770277 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd460439-982c-48dc-a9ae-f6157e33be74 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:28:28.785300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd460439-982c-48dc-a9ae-f6157e33be74 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:28:28.790776 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8f24c-3adf-4bb4-8d13-b0f25862a46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:28:28.791432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8f24c-3adf-4bb4-8d13-b0f25862a46d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:28.791716 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8f24c-3adf-4bb4-8d13-b0f25862a46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:28.791980 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8f24c-3adf-4bb4-8d13-b0f25862a46d admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:28.792763 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8f24c-3adf-4bb4-8d13-b0f25862a46d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:28:28.794597 dv-cinder-835553-1-smb devstack@keystone.service[80263]: WARNING py.warnings [None req-43a8f24c-3adf-4bb4-8d13-b0f25862a46d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:28:28.794597 dv-cinder-835553-1-smb devstack@keystone.service[80263]: warnings.warn(msg) May 27 16:28:28.794597 dv-cinder-835553-1-smb devstack@keystone.service[80263]: May 27 16:28:28.795745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8f24c-3adf-4bb4-8d13-b0f25862a46d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:28:28.817205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 738/1478] 10.222.0.41 () {56 vars in 1108 bytes} [Fri May 27 16:28:28 2022] GET /identity/v3/projects => generated 2553 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:28:31.067659 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9be40-ac25-45c4-a929-65b426efbc8f None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:31.068279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9be40-ac25-45c4-a929-65b426efbc8f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:31.068279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9be40-ac25-45c4-a929-65b426efbc8f None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:31.069719 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 741/1479] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:28:31.075593 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819befc-f577-4683-bb27-6c8e65a5da00 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:31.076151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819befc-f577-4683-bb27-6c8e65a5da00 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:31.076263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819befc-f577-4683-bb27-6c8e65a5da00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:31.097579 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9819befc-f577-4683-bb27-6c8e65a5da00 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:28:31.099151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9819befc-f577-4683-bb27-6c8e65a5da00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:28:31.108142 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 739/1480] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:28:31.154581 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9be40-ac25-45c4-a929-65b426efbc8f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:28:31.170767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9be40-ac25-45c4-a929-65b426efbc8f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:28:31.176540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22485269-ff24-4876-b471-422810b893e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:28:31.177201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22485269-ff24-4876-b471-422810b893e4 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:31.177486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22485269-ff24-4876-b471-422810b893e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:31.177764 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22485269-ff24-4876-b471-422810b893e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:31.186866 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22485269-ff24-4876-b471-422810b893e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:28:31.189216 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22485269-ff24-4876-b471-422810b893e4 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:28:31.200231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 742/1481] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:28:33.631135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3fbf7-4034-4be2-b2b5-5f6163c85517 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:33.631975 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3fbf7-4034-4be2-b2b5-5f6163c85517 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:33.631975 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3fbf7-4034-4be2-b2b5-5f6163c85517 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:33.634115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 740/1482] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:28:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:28:33.640596 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa4839-ecfa-483f-aaa6-08a58b5bbc2d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:33.641153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa4839-ecfa-483f-aaa6-08a58b5bbc2d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:33.641153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa4839-ecfa-483f-aaa6-08a58b5bbc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:33.662482 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9caa4839-ecfa-483f-aaa6-08a58b5bbc2d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:28:33.663726 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9caa4839-ecfa-483f-aaa6-08a58b5bbc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:28:33.672675 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 743/1483] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:28:33.714311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3fbf7-4034-4be2-b2b5-5f6163c85517 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:28:33.721638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3fbf7-4034-4be2-b2b5-5f6163c85517 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:28:33.725972 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c428a1-fbaf-440f-955d-58cdf31ba372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:28:33.726630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c428a1-fbaf-440f-955d-58cdf31ba372 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:33.726914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c428a1-fbaf-440f-955d-58cdf31ba372 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:33.727189 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c428a1-fbaf-440f-955d-58cdf31ba372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:33.737328 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c428a1-fbaf-440f-955d-58cdf31ba372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:28:33.738940 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c428a1-fbaf-440f-955d-58cdf31ba372 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:28:33.749685 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 741/1484] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:28:36.037472 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78786b-1874-4ad5-b8d3-bd0f95b9b047 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:36.038113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78786b-1874-4ad5-b8d3-bd0f95b9b047 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:36.038113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78786b-1874-4ad5-b8d3-bd0f95b9b047 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:36.039429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 744/1485] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:28:36.046182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad8996-caf4-4e2b-bcdf-c3cdb17fc3e8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:36.046942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad8996-caf4-4e2b-bcdf-c3cdb17fc3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:36.047108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad8996-caf4-4e2b-bcdf-c3cdb17fc3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:36.069155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-29ad8996-caf4-4e2b-bcdf-c3cdb17fc3e8 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:28:36.070409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-29ad8996-caf4-4e2b-bcdf-c3cdb17fc3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:28:36.080750 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 742/1486] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:28:36.126277 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78786b-1874-4ad5-b8d3-bd0f95b9b047 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:28:36.144099 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78786b-1874-4ad5-b8d3-bd0f95b9b047 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:28:36.151373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77f1bf-4a28-443d-9664-5495ac5ec211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:28:36.152649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77f1bf-4a28-443d-9664-5495ac5ec211 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:36.153154 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77f1bf-4a28-443d-9664-5495ac5ec211 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:36.153654 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77f1bf-4a28-443d-9664-5495ac5ec211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:36.168746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77f1bf-4a28-443d-9664-5495ac5ec211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:28:36.170331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77f1bf-4a28-443d-9664-5495ac5ec211 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:28:36.183589 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 745/1487] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:28:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:28:38.565118 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0885d38-5ff3-499e-b35c-2c3f3e6f7795 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:38.565736 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0885d38-5ff3-499e-b35c-2c3f3e6f7795 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:38.565736 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0885d38-5ff3-499e-b35c-2c3f3e6f7795 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:38.566945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 743/1488] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:28:38.574239 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc656b1-090f-4554-b268-43111b27f3b1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:38.574802 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc656b1-090f-4554-b268-43111b27f3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:38.574802 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc656b1-090f-4554-b268-43111b27f3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:38.597644 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-bfc656b1-090f-4554-b268-43111b27f3b1 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:28:38.599353 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bfc656b1-090f-4554-b268-43111b27f3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:28:38.608152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 746/1489] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:28:38.650349 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0885d38-5ff3-499e-b35c-2c3f3e6f7795 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:28:38.664744 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0885d38-5ff3-499e-b35c-2c3f3e6f7795 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:28:38.668998 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810d3c1-ebf7-4d9a-9dc4-88abecb98869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:28:38.669648 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810d3c1-ebf7-4d9a-9dc4-88abecb98869 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:38.669927 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810d3c1-ebf7-4d9a-9dc4-88abecb98869 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:38.670197 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810d3c1-ebf7-4d9a-9dc4-88abecb98869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:38.680317 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810d3c1-ebf7-4d9a-9dc4-88abecb98869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:28:38.681773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810d3c1-ebf7-4d9a-9dc4-88abecb98869 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:28:38.691718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 744/1490] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:28:41.148227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20656f-7090-4f8b-9b14-c9aa65cf4234 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:41.148971 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20656f-7090-4f8b-9b14-c9aa65cf4234 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:41.148971 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20656f-7090-4f8b-9b14-c9aa65cf4234 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:41.150175 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 747/1491] 10.222.0.41 () {54 vars in 926 bytes} [Fri May 27 16:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:28:41.156597 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0c70e-e5ff-4881-b5d2-84bd61c26c7c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:41.157221 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0c70e-e5ff-4881-b5d2-84bd61c26c7c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:41.157221 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0c70e-e5ff-4881-b5d2-84bd61c26c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:41.177999 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-09f0c70e-e5ff-4881-b5d2-84bd61c26c7c None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:28:41.179228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-09f0c70e-e5ff-4881-b5d2-84bd61c26c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:28:41.187943 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 745/1492] 10.222.0.41 () {58 vars in 1023 bytes} [Fri May 27 16:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:28:41.229294 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20656f-7090-4f8b-9b14-c9aa65cf4234 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:28:41.242224 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20656f-7090-4f8b-9b14-c9aa65cf4234 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:28:41.246049 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d6674-408a-44eb-af76-4e37873e08fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:28:41.246718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d6674-408a-44eb-af76-4e37873e08fd service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:28:41.246999 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d6674-408a-44eb-af76-4e37873e08fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:28:41.247270 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d6674-408a-44eb-af76-4e37873e08fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:28:41.259256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d6674-408a-44eb-af76-4e37873e08fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:28:41.260833 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d6674-408a-44eb-af76-4e37873e08fd service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:28:41.273366 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 748/1493] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:28:51.171531 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=33 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:28:51.267118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=33 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:33.796059 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e11233-ee57-4621-80a3-6273ee13a093 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:33.796711 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e11233-ee57-4621-80a3-6273ee13a093 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:33.796711 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e11233-ee57-4621-80a3-6273ee13a093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:33.816795 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-64e11233-ee57-4621-80a3-6273ee13a093 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:33.817994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-64e11233-ee57-4621-80a3-6273ee13a093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:33.826970 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 746/1494] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:33.837092 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605807e1-595a-4295-988c-5d688146afe5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:33.837643 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605807e1-595a-4295-988c-5d688146afe5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:33.837643 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605807e1-595a-4295-988c-5d688146afe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:33.856768 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-605807e1-595a-4295-988c-5d688146afe5 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:33.857956 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-605807e1-595a-4295-988c-5d688146afe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:33.867975 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 749/1495] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:33.872988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e11233-ee57-4621-80a3-6273ee13a093 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:33.883538 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e11233-ee57-4621-80a3-6273ee13a093 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:33.889561 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5cd7a-0fa3-4ffb-bb91-f9f25e72d2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:33.890280 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5cd7a-0fa3-4ffb-bb91-f9f25e72d2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:33.890564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5cd7a-0fa3-4ffb-bb91-f9f25e72d2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:33.890834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5cd7a-0fa3-4ffb-bb91-f9f25e72d2b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:33.891548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5cd7a-0fa3-4ffb-bb91-f9f25e72d2b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:30:33.891849 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5cd7a-0fa3-4ffb-bb91-f9f25e72d2b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:33.892913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: WARNING py.warnings [None req-d0a5cd7a-0fa3-4ffb-bb91-f9f25e72d2b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 16:30:33.892913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: warnings.warn(msg) May 27 16:30:33.892913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: May 27 16:30:33.893815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5cd7a-0fa3-4ffb-bb91-f9f25e72d2b4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:33.906295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 747/1496] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:30:33.914578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605807e1-595a-4295-988c-5d688146afe5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:33.924264 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605807e1-595a-4295-988c-5d688146afe5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:33.929458 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e514cf-f94d-49b6-95d3-2951724a7f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:33.930112 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e514cf-f94d-49b6-95d3-2951724a7f9c admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:33.930388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e514cf-f94d-49b6-95d3-2951724a7f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:33.930661 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e514cf-f94d-49b6-95d3-2951724a7f9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:33.931344 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e514cf-f94d-49b6-95d3-2951724a7f9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:33.933126 dv-cinder-835553-1-smb devstack@keystone.service[80264]: WARNING py.warnings [None req-18e514cf-f94d-49b6-95d3-2951724a7f9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:30:33.933126 dv-cinder-835553-1-smb devstack@keystone.service[80264]: warnings.warn(msg) May 27 16:30:33.933126 dv-cinder-835553-1-smb devstack@keystone.service[80264]: May 27 16:30:33.934554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e514cf-f94d-49b6-95d3-2951724a7f9c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:33.982857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 750/1497] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:30:33 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:33.988453 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5cd7a-0fa3-4ffb-bb91-f9f25e72d2b4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:34.005544 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5cd7a-0fa3-4ffb-bb91-f9f25e72d2b4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:34.072403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67219f-ba80-4d55-8cd7-bc9e5f8cf7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:34.073001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67219f-ba80-4d55-8cd7-bc9e5f8cf7eb admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:34.073288 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67219f-ba80-4d55-8cd7-bc9e5f8cf7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:34.073559 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67219f-ba80-4d55-8cd7-bc9e5f8cf7eb admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:34.074799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67219f-ba80-4d55-8cd7-bc9e5f8cf7eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:34.075574 dv-cinder-835553-1-smb devstack@keystone.service[80263]: WARNING py.warnings [None req-6a67219f-ba80-4d55-8cd7-bc9e5f8cf7eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:30:34.075574 dv-cinder-835553-1-smb devstack@keystone.service[80263]: warnings.warn(msg) May 27 16:30:34.075574 dv-cinder-835553-1-smb devstack@keystone.service[80263]: May 27 16:30:34.076828 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67219f-ba80-4d55-8cd7-bc9e5f8cf7eb admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:34.099832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 748/1498] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:30:33 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:30:34.104199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e514cf-f94d-49b6-95d3-2951724a7f9c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:34.119342 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e514cf-f94d-49b6-95d3-2951724a7f9c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:34.126582 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b05fc3-9e49-482f-b88a-56d1b533247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:34.127255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b05fc3-9e49-482f-b88a-56d1b533247c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:34.127537 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b05fc3-9e49-482f-b88a-56d1b533247c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:34.127810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b05fc3-9e49-482f-b88a-56d1b533247c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:34.128566 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b05fc3-9e49-482f-b88a-56d1b533247c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:34.129601 dv-cinder-835553-1-smb devstack@keystone.service[80264]: WARNING py.warnings [None req-63b05fc3-9e49-482f-b88a-56d1b533247c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 16:30:34.129601 dv-cinder-835553-1-smb devstack@keystone.service[80264]: warnings.warn(msg) May 27 16:30:34.129601 dv-cinder-835553-1-smb devstack@keystone.service[80264]: May 27 16:30:34.130529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b05fc3-9e49-482f-b88a-56d1b533247c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:34.145668 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 751/1499] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:34.149973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67219f-ba80-4d55-8cd7-bc9e5f8cf7eb admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:34.160088 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67219f-ba80-4d55-8cd7-bc9e5f8cf7eb admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:34.165602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a3d3d-43f1-4e2e-86c1-e904e7a30ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:34.166258 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a3d3d-43f1-4e2e-86c1-e904e7a30ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:34.166539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a3d3d-43f1-4e2e-86c1-e904e7a30ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:34.166814 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a3d3d-43f1-4e2e-86c1-e904e7a30ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:34.167546 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a3d3d-43f1-4e2e-86c1-e904e7a30ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:34.168878 dv-cinder-835553-1-smb devstack@keystone.service[80263]: WARNING py.warnings [None req-652a3d3d-43f1-4e2e-86c1-e904e7a30ecc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 16:30:34.168878 dv-cinder-835553-1-smb devstack@keystone.service[80263]: warnings.warn(msg) May 27 16:30:34.168878 dv-cinder-835553-1-smb devstack@keystone.service[80263]: May 27 16:30:34.169771 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a3d3d-43f1-4e2e-86c1-e904e7a30ecc admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:34.183239 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 749/1500] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:30:34.188054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b05fc3-9e49-482f-b88a-56d1b533247c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:34.202603 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b05fc3-9e49-482f-b88a-56d1b533247c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:34.207548 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b430089-1bfe-4073-a373-1ada419aca9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:34.208482 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b430089-1bfe-4073-a373-1ada419aca9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:34.208764 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b430089-1bfe-4073-a373-1ada419aca9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:34.209042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b430089-1bfe-4073-a373-1ada419aca9d admin admin] PATH_INFO: `/v3/projects/5773ce216b614485a3e1838b147e3223/users/6ae1e75a4bf44edb88f4bb4a15661d97/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:34.226200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b430089-1bfe-4073-a373-1ada419aca9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5773ce216b614485a3e1838b147e3223, user_id=6ae1e75a4bf44edb88f4bb4a15661d97, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:34.227262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: WARNING py.warnings [None req-0b430089-1bfe-4073-a373-1ada419aca9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:30:34.227262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: warnings.warn(msg) May 27 16:30:34.227262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: May 27 16:30:34.229561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b430089-1bfe-4073-a373-1ada419aca9d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:34.246538 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 752/1501] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:30:34 2022] PUT /identity/v3/projects/5773ce216b614485a3e1838b147e3223/users/6ae1e75a4bf44edb88f4bb4a15661d97/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:34.258406 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa4e4a-d0f4-4a7d-9cbf-fff2c6332206 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:34.258701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa4e4a-d0f4-4a7d-9cbf-fff2c6332206 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:34.258970 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa4e4a-d0f4-4a7d-9cbf-fff2c6332206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:34.287379 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-57fa4e4a-d0f4-4a7d-9cbf-fff2c6332206 None None] MFA Rules not processed for user `6ae1e75a4bf44edb88f4bb4a15661d97`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:34.287887 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-57fa4e4a-d0f4-4a7d-9cbf-fff2c6332206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:34.356285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 750/1502] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:30:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:34.370182 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cb82e-372d-44b7-af4e-82e33cd4a47e None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:34.370494 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cb82e-372d-44b7-af4e-82e33cd4a47e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:34.370772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cb82e-372d-44b7-af4e-82e33cd4a47e None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:34.372232 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 753/1503] 10.222.0.41 () {54 vars in 963 bytes} [Fri May 27 16:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:30:34.377297 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62955c22-c395-42f6-a03b-4cb8f929288f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:34.377594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62955c22-c395-42f6-a03b-4cb8f929288f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:34.377870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62955c22-c395-42f6-a03b-4cb8f929288f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:34.397882 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-62955c22-c395-42f6-a03b-4cb8f929288f None None] MFA Rules not processed for user `4561bdacf98d47a6beffbcc400120bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:34.399047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-62955c22-c395-42f6-a03b-4cb8f929288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:34.448324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:34.460852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 751/1504] 10.222.0.41 () {58 vars in 1060 bytes} [Fri May 27 16:30:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:34.578380 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cb82e-372d-44b7-af4e-82e33cd4a47e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:34.594130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cb82e-372d-44b7-af4e-82e33cd4a47e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:34.597923 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e1816-f0e9-4169-af64-605be77cc555 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:34.598572 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e1816-f0e9-4169-af64-605be77cc555 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:34.598852 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e1816-f0e9-4169-af64-605be77cc555 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:34.599125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e1816-f0e9-4169-af64-605be77cc555 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:34.609122 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e1816-f0e9-4169-af64-605be77cc555 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:34.610522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e1816-f0e9-4169-af64-605be77cc555 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:34.619309 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 754/1505] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:30:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:34.666675 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412748f-2661-4c77-b6a1-f407eb6e97cb None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:34.667079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412748f-2661-4c77-b6a1-f407eb6e97cb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:34.667272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412748f-2661-4c77-b6a1-f407eb6e97cb None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:34.668880 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 752/1506] 10.222.0.41 () {52 vars in 829 bytes} [Fri May 27 16:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:30:34.673163 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e1816-f0e9-4169-af64-605be77cc555 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:34.758437 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e1816-f0e9-4169-af64-605be77cc555 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:34.766665 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f0673-4b4b-4dd4-8ba0-120b94aa49d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:34.768290 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f0673-4b4b-4dd4-8ba0-120b94aa49d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:34.768821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f0673-4b4b-4dd4-8ba0-120b94aa49d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:34.769337 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f0673-4b4b-4dd4-8ba0-120b94aa49d0 admin admin] PATH_INFO: `/v3/users/6ae1e75a4bf44edb88f4bb4a15661d97` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:34.771398 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f0673-4b4b-4dd4-8ba0-120b94aa49d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae1e75a4bf44edb88f4bb4a15661d97)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:34.773388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: WARNING py.warnings [None req-b84f0673-4b4b-4dd4-8ba0-120b94aa49d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:30:34.773388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: warnings.warn(msg) May 27 16:30:34.773388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: May 27 16:30:34.775543 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f0673-4b4b-4dd4-8ba0-120b94aa49d0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:34.848724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b84f0673-4b4b-4dd4-8ba0-120b94aa49d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae1e75a4bf44edb88f4bb4a15661d97'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:34.849531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b84f0673-4b4b-4dd4-8ba0-120b94aa49d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae1e75a4bf44edb88f4bb4a15661d97'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:34.850142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b84f0673-4b4b-4dd4-8ba0-120b94aa49d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae1e75a4bf44edb88f4bb4a15661d97'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:34.871886 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b84f0673-4b4b-4dd4-8ba0-120b94aa49d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae1e75a4bf44edb88f4bb4a15661d97'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:34.889167 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b84f0673-4b4b-4dd4-8ba0-120b94aa49d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae1e75a4bf44edb88f4bb4a15661d97'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:34.894092 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:34.909844 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 755/1507] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:30:34 2022] DELETE /identity/v3/users/6ae1e75a4bf44edb88f4bb4a15661d97 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:34.914542 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993acf6-abc2-4cd8-873c-a4cb8f0fa801 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:34.915079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993acf6-abc2-4cd8-873c-a4cb8f0fa801 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:34.915079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993acf6-abc2-4cd8-873c-a4cb8f0fa801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:34.935875 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f993acf6-abc2-4cd8-873c-a4cb8f0fa801 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:30:34.937129 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f993acf6-abc2-4cd8-873c-a4cb8f0fa801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:35.005428 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 753/1508] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:30:35.016929 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f0673-4b4b-4dd4-8ba0-120b94aa49d0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:35.018662 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b84f0673-4b4b-4dd4-8ba0-120b94aa49d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:35.081760 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f0673-4b4b-4dd4-8ba0-120b94aa49d0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:35.085772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a754c-99d2-4453-8034-1b59de6ed2d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:35.086430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a754c-99d2-4453-8034-1b59de6ed2d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:35.086706 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a754c-99d2-4453-8034-1b59de6ed2d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:35.086982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a754c-99d2-4453-8034-1b59de6ed2d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:35.096819 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a754c-99d2-4453-8034-1b59de6ed2d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:35.098303 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a754c-99d2-4453-8034-1b59de6ed2d5 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:35.108188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 756/1509] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:30:35.557698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993acf6-abc2-4cd8-873c-a4cb8f0fa801 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:30:35.559758 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f993acf6-abc2-4cd8-873c-a4cb8f0fa801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:30:35.576473 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993acf6-abc2-4cd8-873c-a4cb8f0fa801 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:30:35.582159 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec54d89-7982-4185-a875-54e205853a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:30:35.583027 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec54d89-7982-4185-a875-54e205853a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:30:35.583325 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec54d89-7982-4185-a875-54e205853a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:30:35.583582 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec54d89-7982-4185-a875-54e205853a9d admin admin] PATH_INFO: `/v3/projects/5773ce216b614485a3e1838b147e3223` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:30:35.586234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec54d89-7982-4185-a875-54e205853a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5773ce216b614485a3e1838b147e3223)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:30:35.587297 dv-cinder-835553-1-smb devstack@keystone.service[80263]: WARNING py.warnings [None req-9ec54d89-7982-4185-a875-54e205853a9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:30:35.587297 dv-cinder-835553-1-smb devstack@keystone.service[80263]: warnings.warn(msg) May 27 16:30:35.587297 dv-cinder-835553-1-smb devstack@keystone.service[80263]: May 27 16:30:35.588575 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec54d89-7982-4185-a875-54e205853a9d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:30:35.658744 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9ec54d89-7982-4185-a875-54e205853a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5773ce216b614485a3e1838b147e3223', 'request_id': 'req-9ec54d89-7982-4185-a875-54e205853a9d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:35.664852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9ec54d89-7982-4185-a875-54e205853a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5773ce216b614485a3e1838b147e3223', 'request_id': 'req-9ec54d89-7982-4185-a875-54e205853a9d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:35.675898 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9ec54d89-7982-4185-a875-54e205853a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5773ce216b614485a3e1838b147e3223', 'request_id': 'req-9ec54d89-7982-4185-a875-54e205853a9d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:35.698365 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9ec54d89-7982-4185-a875-54e205853a9d admin admin] The token cache is being invalidate because project 5773ce216b614485a3e1838b147e3223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:30:35.698578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9ec54d89-7982-4185-a875-54e205853a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:35.699730 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9ec54d89-7982-4185-a875-54e205853a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:30:35.701536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 754/1510] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:30:35 2022] DELETE /identity/v3/projects/5773ce216b614485a3e1838b147e3223 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:30:45.103843 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:30:45.692709 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:25.212317 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a3fc5-4c7c-4d2d-9927-7484f7a4cf36 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:25.212944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a3fc5-4c7c-4d2d-9927-7484f7a4cf36 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:25.212944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a3fc5-4c7c-4d2d-9927-7484f7a4cf36 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:25.214265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:32:25.220311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df057268-97b7-4ee6-a7e1-0e9a36777840 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:25.221046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df057268-97b7-4ee6-a7e1-0e9a36777840 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:25.221154 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df057268-97b7-4ee6-a7e1-0e9a36777840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:25.247761 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-df057268-97b7-4ee6-a7e1-0e9a36777840 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:25.249662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-df057268-97b7-4ee6-a7e1-0e9a36777840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:25.318442 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:25.488645 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a3fc5-4c7c-4d2d-9927-7484f7a4cf36 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:25.494459 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ba3a3fc5-4c7c-4d2d-9927-7484f7a4cf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:25.575503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a3fc5-4c7c-4d2d-9927-7484f7a4cf36 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:25.581650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92019d5-e8dd-4608-ba7d-af7a1132ea0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:25.582325 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92019d5-e8dd-4608-ba7d-af7a1132ea0d service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:25.582578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92019d5-e8dd-4608-ba7d-af7a1132ea0d service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:25.582850 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92019d5-e8dd-4608-ba7d-af7a1132ea0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:25.591715 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92019d5-e8dd-4608-ba7d-af7a1132ea0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:25.593421 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92019d5-e8dd-4608-ba7d-af7a1132ea0d service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:25.603919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 758/1513] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:32:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:32:26.304285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302083a-1a56-409f-9873-16a0f5236ded None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:26.304854 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302083a-1a56-409f-9873-16a0f5236ded None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:26.304854 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302083a-1a56-409f-9873-16a0f5236ded None None] PATH_INFO: `/v3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:26.306175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 756/1514] 10.222.0.82 () {54 vars in 925 bytes} [Fri May 27 16:32:26 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:32:26.313847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a7efd-9f43-443e-ae91-027b16736168 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:26.314379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a7efd-9f43-443e-ae91-027b16736168 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:26.314379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a7efd-9f43-443e-ae91-027b16736168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:26.335445 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-082a7efd-9f43-443e-ae91-027b16736168 None None] MFA Rules not processed for user `1266a87d93da4f8d9a1ccafa03067169`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:26.337165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-082a7efd-9f43-443e-ae91-027b16736168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:26.424127 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 759/1515] 10.222.0.82 () {58 vars in 1015 bytes} [Fri May 27 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:26.533930 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87007e21-97ab-4fd7-9c18-e790d81f7364 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:26.534261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87007e21-97ab-4fd7-9c18-e790d81f7364 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:26.534543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87007e21-97ab-4fd7-9c18-e790d81f7364 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:26.536091 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 757/1516] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:32:26.541167 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010421e-ea6a-4db4-a7d1-5950d66334f8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:26.541461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010421e-ea6a-4db4-a7d1-5950d66334f8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:26.541740 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010421e-ea6a-4db4-a7d1-5950d66334f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:26.568005 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3010421e-ea6a-4db4-a7d1-5950d66334f8 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:26.569776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3010421e-ea6a-4db4-a7d1-5950d66334f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:26.582720 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 760/1517] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:26.737422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87007e21-97ab-4fd7-9c18-e790d81f7364 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:26.752950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87007e21-97ab-4fd7-9c18-e790d81f7364 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:26.758953 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478a98a-7d71-487c-9bb2-617a65324b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:26.759795 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478a98a-7d71-487c-9bb2-617a65324b18 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:26.760184 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478a98a-7d71-487c-9bb2-617a65324b18 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:26.760631 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478a98a-7d71-487c-9bb2-617a65324b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:26.771262 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478a98a-7d71-487c-9bb2-617a65324b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:26.772946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478a98a-7d71-487c-9bb2-617a65324b18 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:26.786024 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 758/1518] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:32:35.417946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ec553-b1c2-4dba-ae64-4603bb8029cd None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:35.418501 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ec553-b1c2-4dba-ae64-4603bb8029cd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:35.418501 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ec553-b1c2-4dba-ae64-4603bb8029cd None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:35.419896 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 761/1519] 10.222.0.41 () {54 vars in 960 bytes} [Fri May 27 16:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:32:35.425101 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f121865-f58b-44fd-9a11-da6bb4afc802 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:35.425631 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f121865-f58b-44fd-9a11-da6bb4afc802 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:35.425758 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f121865-f58b-44fd-9a11-da6bb4afc802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:35.444985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9f121865-f58b-44fd-9a11-da6bb4afc802 None None] MFA Rules not processed for user `1266a87d93da4f8d9a1ccafa03067169`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:35.446209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9f121865-f58b-44fd-9a11-da6bb4afc802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:35.456970 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 759/1520] 10.222.0.41 () {58 vars in 1057 bytes} [Fri May 27 16:32:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:35.465052 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ec553-b1c2-4dba-ae64-4603bb8029cd None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:35.479485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ec553-b1c2-4dba-ae64-4603bb8029cd None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:35.485197 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88700e85-9d52-4d44-ac43-38e3c7947b2d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1266a87d93da4f8d9a1ccafa03067169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:35.485846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88700e85-9d52-4d44-ac43-38e3c7947b2d service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:35.486122 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88700e85-9d52-4d44-ac43-38e3c7947b2d service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:35.486391 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88700e85-9d52-4d44-ac43-38e3c7947b2d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:35.495240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88700e85-9d52-4d44-ac43-38e3c7947b2d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:35.496907 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88700e85-9d52-4d44-ac43-38e3c7947b2d service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:35.506561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 762/1521] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:32:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:32:38.109059 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13c37a-792f-4a4a-8635-e23cce8f5bf3 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:38.109929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13c37a-792f-4a4a-8635-e23cce8f5bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:38.110061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13c37a-792f-4a4a-8635-e23cce8f5bf3 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:38.112238 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:32:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:32:38.119201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dc0c2-10a4-4f78-8ecf-08db9ffa8e53 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:38.119846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dc0c2-10a4-4f78-8ecf-08db9ffa8e53 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:38.119846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dc0c2-10a4-4f78-8ecf-08db9ffa8e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:38.140589 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1c6dc0c2-10a4-4f78-8ecf-08db9ffa8e53 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:38.141974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1c6dc0c2-10a4-4f78-8ecf-08db9ffa8e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:38.151367 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:38.325846 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13c37a-792f-4a4a-8635-e23cce8f5bf3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:38.346902 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13c37a-792f-4a4a-8635-e23cce8f5bf3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:38.352555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb4a4a-aecd-4295-9cd3-f51f0f1ccb76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:38.353214 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb4a4a-aecd-4295-9cd3-f51f0f1ccb76 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:38.353492 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb4a4a-aecd-4295-9cd3-f51f0f1ccb76 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:38.353821 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb4a4a-aecd-4295-9cd3-f51f0f1ccb76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:38.363607 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb4a4a-aecd-4295-9cd3-f51f0f1ccb76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:38.365263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb4a4a-aecd-4295-9cd3-f51f0f1ccb76 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:38.375847 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 761/1524] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:32:39.290718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390ccf0-c99f-4953-8eb3-f4eb69743af5 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:39.291201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390ccf0-c99f-4953-8eb3-f4eb69743af5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:39.291314 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390ccf0-c99f-4953-8eb3-f4eb69743af5 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:39.292730 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 16:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:32:39.298148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ee33e-92d2-4056-a9f5-5acece2c3ba2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:39.298710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ee33e-92d2-4056-a9f5-5acece2c3ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:39.298710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ee33e-92d2-4056-a9f5-5acece2c3ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:39.318758 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b29ee33e-92d2-4056-a9f5-5acece2c3ba2 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:39.319978 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b29ee33e-92d2-4056-a9f5-5acece2c3ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:39.338964 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 16:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:39.491129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390ccf0-c99f-4953-8eb3-f4eb69743af5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:39.506115 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390ccf0-c99f-4953-8eb3-f4eb69743af5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:39.512717 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7e76f-c7a5-4e39-80ab-7b40dee4d6ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:39.513397 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7e76f-c7a5-4e39-80ab-7b40dee4d6ad service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:39.513684 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7e76f-c7a5-4e39-80ab-7b40dee4d6ad service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:39.514026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7e76f-c7a5-4e39-80ab-7b40dee4d6ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:39.525016 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7e76f-c7a5-4e39-80ab-7b40dee4d6ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:39.526685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7e76f-c7a5-4e39-80ab-7b40dee4d6ad service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:39.539267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 765/1527] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:32:43.767030 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5e7a8-fc16-4108-b348-9e0402966e4a None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:43.767661 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5e7a8-fc16-4108-b348-9e0402966e4a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:43.767771 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e5e7a8-fc16-4108-b348-9e0402966e4a None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:43.769991 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:32:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:32:43.775795 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09f913-4bf4-4b08-b9dd-1ae57e4f59b4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:43.776411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09f913-4bf4-4b08-b9dd-1ae57e4f59b4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:43.776411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09f913-4bf4-4b08-b9dd-1ae57e4f59b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:43.795739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0c09f913-4bf4-4b08-b9dd-1ae57e4f59b4 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:43.796985 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0c09f913-4bf4-4b08-b9dd-1ae57e4f59b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:43.805747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:32:43.843790 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5e7a8-fc16-4108-b348-9e0402966e4a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:43.845864 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b8e5e7a8-fc16-4108-b348-9e0402966e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:43.916514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e5e7a8-fc16-4108-b348-9e0402966e4a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:43.920393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b69d3-366b-4c3b-ab6e-6821f93a8449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:43.921054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b69d3-366b-4c3b-ab6e-6821f93a8449 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:43.921331 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b69d3-366b-4c3b-ab6e-6821f93a8449 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:43.921605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b69d3-366b-4c3b-ab6e-6821f93a8449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:43.931659 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b69d3-366b-4c3b-ab6e-6821f93a8449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:43.933173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b69d3-366b-4c3b-ab6e-6821f93a8449 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:43.943576 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 764/1530] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:32:46.289482 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b142e7-ad3d-45a8-9040-a99004428c67 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:46.290561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b142e7-ad3d-45a8-9040-a99004428c67 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:46.290561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b142e7-ad3d-45a8-9040-a99004428c67 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:46.293773 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:32:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:32:46.299664 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720b35a-f2ef-40b9-9b98-95ae6834bdef None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:46.300294 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720b35a-f2ef-40b9-9b98-95ae6834bdef None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:46.300526 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720b35a-f2ef-40b9-9b98-95ae6834bdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:46.307569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=72 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:32:46.323305 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9720b35a-f2ef-40b9-9b98-95ae6834bdef None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:46.324586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9720b35a-f2ef-40b9-9b98-95ae6834bdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:46.333867 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:46.371619 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b142e7-ad3d-45a8-9040-a99004428c67 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:46.384549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b142e7-ad3d-45a8-9040-a99004428c67 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:46.389015 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa52147-fdd3-4460-ad2f-085393885035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:46.389688 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa52147-fdd3-4460-ad2f-085393885035 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:46.389972 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa52147-fdd3-4460-ad2f-085393885035 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:46.390244 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa52147-fdd3-4460-ad2f-085393885035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:46.400867 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa52147-fdd3-4460-ad2f-085393885035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:46.402377 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa52147-fdd3-4460-ad2f-085393885035 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:46.413626 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 768/1533] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:32:50.145896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de653695-af2d-4a23-ad82-fe9bb8ad18fd None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:50.146501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de653695-af2d-4a23-ad82-fe9bb8ad18fd None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:50.146501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de653695-af2d-4a23-ad82-fe9bb8ad18fd None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:50.147842 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:32:50.153673 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9055b-0ce4-44ef-b7c5-db0ff88d8fb3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:50.154142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9055b-0ce4-44ef-b7c5-db0ff88d8fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:50.154250 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9055b-0ce4-44ef-b7c5-db0ff88d8fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:50.174150 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-43b9055b-0ce4-44ef-b7c5-db0ff88d8fb3 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:50.175422 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-43b9055b-0ce4-44ef-b7c5-db0ff88d8fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:50.183766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:50.462490 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de653695-af2d-4a23-ad82-fe9bb8ad18fd None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:50.464290 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-de653695-af2d-4a23-ad82-fe9bb8ad18fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:50.527684 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de653695-af2d-4a23-ad82-fe9bb8ad18fd None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:50.538869 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da85210-9516-4402-848b-35531b23ab61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:50.539557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da85210-9516-4402-848b-35531b23ab61 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:50.539841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da85210-9516-4402-848b-35531b23ab61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:50.540154 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da85210-9516-4402-848b-35531b23ab61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:50.550516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da85210-9516-4402-848b-35531b23ab61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:50.551993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da85210-9516-4402-848b-35531b23ab61 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:50.563039 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 767/1536] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:32:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:32:52.970188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f0d45-a628-4884-96f6-58824d27398b None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:52.970860 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f0d45-a628-4884-96f6-58824d27398b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:52.970860 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f0d45-a628-4884-96f6-58824d27398b None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:52.972244 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 16:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:32:52.978285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fb522-504e-4ecd-b7f2-97cd543192a9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:52.979110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fb522-504e-4ecd-b7f2-97cd543192a9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:52.979110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fb522-504e-4ecd-b7f2-97cd543192a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:53.000732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a75fb522-504e-4ecd-b7f2-97cd543192a9 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:32:53.001967 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a75fb522-504e-4ecd-b7f2-97cd543192a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:53.010653 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 16:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:32:53.296916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f0d45-a628-4884-96f6-58824d27398b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:32:53.298939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9d0f0d45-a628-4884-96f6-58824d27398b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:32:53.316711 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f0d45-a628-4884-96f6-58824d27398b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:32:53.320726 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd8bed-c05c-4110-a589-3cc11af8906f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:32:53.321413 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd8bed-c05c-4110-a589-3cc11af8906f service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:32:53.321691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd8bed-c05c-4110-a589-3cc11af8906f service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:32:53.321965 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd8bed-c05c-4110-a589-3cc11af8906f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:32:53.332336 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd8bed-c05c-4110-a589-3cc11af8906f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:32:53.333803 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd8bed-c05c-4110-a589-3cc11af8906f service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:32:53.344876 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 771/1539] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:32:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:33:02.993009 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=31 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:33:03.339480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:27.210109 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65acb64-48de-4363-8359-d4e07a9f3e9f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:27.210830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65acb64-48de-4363-8359-d4e07a9f3e9f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:27.210830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65acb64-48de-4363-8359-d4e07a9f3e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:27.419704 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e230b-db8d-4e93-a29f-3d0f1272eacb None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:27.420886 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e230b-db8d-4e93-a29f-3d0f1272eacb None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:27.421394 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e230b-db8d-4e93-a29f-3d0f1272eacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:27.449285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f65acb64-48de-4363-8359-d4e07a9f3e9f None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:27.450993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f65acb64-48de-4363-8359-d4e07a9f3e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:27.466009 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 769/1540] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:27.473362 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-bc2e230b-db8d-4e93-a29f-3d0f1272eacb None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:27.475348 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bc2e230b-db8d-4e93-a29f-3d0f1272eacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:27.478136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1006d-dcf9-4ffa-a8a5-fea5fafb842b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:27.478423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1006d-dcf9-4ffa-a8a5-fea5fafb842b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:27.478700 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1006d-dcf9-4ffa-a8a5-fea5fafb842b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:27.489858 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 772/1541] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:34:27.500672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20310a-8d5d-4a7a-a640-7fd90d5b098b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:27.501011 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20310a-8d5d-4a7a-a640-7fd90d5b098b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:27.501230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20310a-8d5d-4a7a-a640-7fd90d5b098b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:27.513143 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-26e1006d-dcf9-4ffa-a8a5-fea5fafb842b None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:27.514355 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-26e1006d-dcf9-4ffa-a8a5-fea5fafb842b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:27.532791 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8c20310a-8d5d-4a7a-a640-7fd90d5b098b None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:27.534103 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8c20310a-8d5d-4a7a-a640-7fd90d5b098b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:27.560119 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 773/1542] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:34:27.569369 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20310a-8d5d-4a7a-a640-7fd90d5b098b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:27.579949 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 770/1543] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:34:27.587271 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1006d-dcf9-4ffa-a8a5-fea5fafb842b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:27.606424 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20310a-8d5d-4a7a-a640-7fd90d5b098b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:27.612621 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1006d-dcf9-4ffa-a8a5-fea5fafb842b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:27.628652 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619dbdfb-0bc5-4c44-94c2-5f261e6963e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:27.630373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dbdfb-0bc5-4c44-94c2-5f261e6963e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:27.634010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86ab1d-f42a-4958-986a-7f8db8fecc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:27.634626 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86ab1d-f42a-4958-986a-7f8db8fecc10 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:27.634911 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86ab1d-f42a-4958-986a-7f8db8fecc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:27.635190 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86ab1d-f42a-4958-986a-7f8db8fecc10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:27.635596 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dbdfb-0bc5-4c44-94c2-5f261e6963e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:27.635936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86ab1d-f42a-4958-986a-7f8db8fecc10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:34:27.636559 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dbdfb-0bc5-4c44-94c2-5f261e6963e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:27.638156 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619dbdfb-0bc5-4c44-94c2-5f261e6963e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:34:27.638902 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619dbdfb-0bc5-4c44-94c2-5f261e6963e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:27.644842 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86ab1d-f42a-4958-986a-7f8db8fecc10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:27.645414 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619dbdfb-0bc5-4c44-94c2-5f261e6963e7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:27.645975 dv-cinder-835553-1-smb devstack@keystone.service[80264]: WARNING py.warnings [None req-4c86ab1d-f42a-4958-986a-7f8db8fecc10 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 16:34:27.645975 dv-cinder-835553-1-smb devstack@keystone.service[80264]: warnings.warn(msg) May 27 16:34:27.645975 dv-cinder-835553-1-smb devstack@keystone.service[80264]: May 27 16:34:27.647028 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86ab1d-f42a-4958-986a-7f8db8fecc10 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:27.672435 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 771/1544] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:34:27.676212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619dbdfb-0bc5-4c44-94c2-5f261e6963e7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:27.694811 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619dbdfb-0bc5-4c44-94c2-5f261e6963e7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:27.700037 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 774/1545] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:34:27.707564 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86ab1d-f42a-4958-986a-7f8db8fecc10 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:27.713422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238edbc-0fc0-4845-9689-0875e799ca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:27.715164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238edbc-0fc0-4845-9689-0875e799ca78 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:27.715480 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238edbc-0fc0-4845-9689-0875e799ca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:27.719070 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238edbc-0fc0-4845-9689-0875e799ca78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:27.719946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238edbc-0fc0-4845-9689-0875e799ca78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:27.723285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: WARNING py.warnings [None req-f238edbc-0fc0-4845-9689-0875e799ca78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:34:27.723285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: warnings.warn(msg) May 27 16:34:27.723285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: May 27 16:34:27.725198 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238edbc-0fc0-4845-9689-0875e799ca78 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:27.742928 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86ab1d-f42a-4958-986a-7f8db8fecc10 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:27.763550 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cd38e-191f-4535-9599-f67c99806d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:27.764269 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cd38e-191f-4535-9599-f67c99806d12 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:27.764562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cd38e-191f-4535-9599-f67c99806d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:27.764822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cd38e-191f-4535-9599-f67c99806d12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:27.765526 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cd38e-191f-4535-9599-f67c99806d12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:27.767509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cd38e-191f-4535-9599-f67c99806d12 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:27.781601 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 772/1546] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:34:27 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:27.786577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238edbc-0fc0-4845-9689-0875e799ca78 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:27.849123 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 775/1547] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:34:27 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:27.853595 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cd38e-191f-4535-9599-f67c99806d12 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:27.906436 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238edbc-0fc0-4845-9689-0875e799ca78 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:28.013747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cd38e-191f-4535-9599-f67c99806d12 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:28.026787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c801c1-4e91-4fca-85ba-4b7d4f00381a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:28.027493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c801c1-4e91-4fca-85ba-4b7d4f00381a admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.027775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c801c1-4e91-4fca-85ba-4b7d4f00381a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.028071 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c801c1-4e91-4fca-85ba-4b7d4f00381a admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.028772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c801c1-4e91-4fca-85ba-4b7d4f00381a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:28.029823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: WARNING py.warnings [None req-09c801c1-4e91-4fca-85ba-4b7d4f00381a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:34:28.029823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: warnings.warn(msg) May 27 16:34:28.029823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: May 27 16:34:28.031064 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c801c1-4e91-4fca-85ba-4b7d4f00381a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:28.054578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11077fa-d9ce-4b1d-b1f8-23b00c794419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:28.055294 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11077fa-d9ce-4b1d-b1f8-23b00c794419 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.055577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11077fa-d9ce-4b1d-b1f8-23b00c794419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.055855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11077fa-d9ce-4b1d-b1f8-23b00c794419 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.056596 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11077fa-d9ce-4b1d-b1f8-23b00c794419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:28.058762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11077fa-d9ce-4b1d-b1f8-23b00c794419 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:28.082914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 776/1548] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:34:27 2022] POST /identity/v3/users => generated 286 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:28.084582 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e696d56-a256-4508-b08c-bbc5f1eb5e58 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.084965 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e696d56-a256-4508-b08c-bbc5f1eb5e58 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.085153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e696d56-a256-4508-b08c-bbc5f1eb5e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.102292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 773/1549] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:34:27 2022] POST /identity/v3/users => generated 288 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:28.106217 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca305e-b55e-4d9b-a260-446ba398608a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.106645 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca305e-b55e-4d9b-a260-446ba398608a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.106935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca305e-b55e-4d9b-a260-446ba398608a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.127242 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0e696d56-a256-4508-b08c-bbc5f1eb5e58 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:28.130053 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0e696d56-a256-4508-b08c-bbc5f1eb5e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:28.140289 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 777/1550] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:28.141339 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e696d56-a256-4508-b08c-bbc5f1eb5e58 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:28.142233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a0ca305e-b55e-4d9b-a260-446ba398608a None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:28.143413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a0ca305e-b55e-4d9b-a260-446ba398608a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:28.151996 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 774/1551] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:28.153000 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e696d56-a256-4508-b08c-bbc5f1eb5e58 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:28.153317 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02012949-d992-4232-aaba-62a5f79287dc None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.153601 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02012949-d992-4232-aaba-62a5f79287dc None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.153869 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02012949-d992-4232-aaba-62a5f79287dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.165881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314b029-a9e4-4c16-bd25-776b241f5bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:28.166573 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314b029-a9e4-4c16-bd25-776b241f5bee admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.166859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314b029-a9e4-4c16-bd25-776b241f5bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.167140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314b029-a9e4-4c16-bd25-776b241f5bee admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.167873 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314b029-a9e4-4c16-bd25-776b241f5bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:28.169557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314b029-a9e4-4c16-bd25-776b241f5bee admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:28.178194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-02012949-d992-4232-aaba-62a5f79287dc None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:28.179536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-02012949-d992-4232-aaba-62a5f79287dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:28.181455 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 778/1552] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:28.182128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314b029-a9e4-4c16-bd25-776b241f5bee admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:28.191950 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314b029-a9e4-4c16-bd25-776b241f5bee admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:28.193121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 775/1553] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:28.194645 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3666b-abc4-480e-81e8-b450f2a00af3 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.194951 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3666b-abc4-480e-81e8-b450f2a00af3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.195334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3666b-abc4-480e-81e8-b450f2a00af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.201633 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8b973-c325-4b9a-8bf0-6d7cdced031a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:28.202888 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8b973-c325-4b9a-8bf0-6d7cdced031a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.203412 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8b973-c325-4b9a-8bf0-6d7cdced031a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.203741 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8b973-c325-4b9a-8bf0-6d7cdced031a admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.204506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8b973-c325-4b9a-8bf0-6d7cdced031a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:28.206210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8b973-c325-4b9a-8bf0-6d7cdced031a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:28.216992 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-74d3666b-abc4-480e-81e8-b450f2a00af3 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:28.218200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 779/1554] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:28.218328 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-74d3666b-abc4-480e-81e8-b450f2a00af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:28.219547 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4605f93-43c6-49ce-87d6-68ccd857806d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.219836 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4605f93-43c6-49ce-87d6-68ccd857806d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.220205 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4605f93-43c6-49ce-87d6-68ccd857806d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.226410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 776/1555] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:28.227622 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a6260-e367-4035-82af-e8b157cbf5a7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.227908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a6260-e367-4035-82af-e8b157cbf5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.228233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a6260-e367-4035-82af-e8b157cbf5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.240692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a4605f93-43c6-49ce-87d6-68ccd857806d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:28.241892 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a4605f93-43c6-49ce-87d6-68ccd857806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:28.247663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0b2a6260-e367-4035-82af-e8b157cbf5a7 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:28.249153 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0b2a6260-e367-4035-82af-e8b157cbf5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:28.249846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 780/1556] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:28.251240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32577a8-5108-4851-8d83-aa88f92b0403 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.251525 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32577a8-5108-4851-8d83-aa88f92b0403 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.251815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32577a8-5108-4851-8d83-aa88f92b0403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.257716 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 777/1557] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:28.261924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a6260-e367-4035-82af-e8b157cbf5a7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:28.269678 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e32577a8-5108-4851-8d83-aa88f92b0403 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:28.270854 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e32577a8-5108-4851-8d83-aa88f92b0403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:28.271834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a6260-e367-4035-82af-e8b157cbf5a7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:28.277657 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc9f99-c193-4802-a587-cda8042c2d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:28.278325 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9f99-c193-4802-a587-cda8042c2d45 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.278633 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9f99-c193-4802-a587-cda8042c2d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.278909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc9f99-c193-4802-a587-cda8042c2d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.279143 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 781/1558] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:28.279642 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc9f99-c193-4802-a587-cda8042c2d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:28.280480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01143fc-0c61-43a7-884d-6e5a8add5b37 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.280764 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01143fc-0c61-43a7-884d-6e5a8add5b37 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.281035 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01143fc-0c61-43a7-884d-6e5a8add5b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.281280 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc9f99-c193-4802-a587-cda8042c2d45 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:28.299578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 778/1559] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:28.299578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3816788-40b2-4343-a3c3-b7ac586f68fd None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.299578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3816788-40b2-4343-a3c3-b7ac586f68fd None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.299578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3816788-40b2-4343-a3c3-b7ac586f68fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.301178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c01143fc-0c61-43a7-884d-6e5a8add5b37 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:28.302382 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c01143fc-0c61-43a7-884d-6e5a8add5b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:28.310841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 782/1560] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:28.311826 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01143fc-0c61-43a7-884d-6e5a8add5b37 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:28.316981 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b3816788-40b2-4343-a3c3-b7ac586f68fd None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:28.318166 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b3816788-40b2-4343-a3c3-b7ac586f68fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:28.321990 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01143fc-0c61-43a7-884d-6e5a8add5b37 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:28.327460 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 779/1561] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:28.327615 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44a96a-12cf-42b7-a30e-2855486f029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:28.328270 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44a96a-12cf-42b7-a30e-2855486f029f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.328507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44a96a-12cf-42b7-a30e-2855486f029f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.328750 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332aeaa4-a1f9-46dc-ad9e-66bc6d9259fe None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.328857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44a96a-12cf-42b7-a30e-2855486f029f admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.329054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332aeaa4-a1f9-46dc-ad9e-66bc6d9259fe None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.329300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332aeaa4-a1f9-46dc-ad9e-66bc6d9259fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.329525 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44a96a-12cf-42b7-a30e-2855486f029f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:28.331674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44a96a-12cf-42b7-a30e-2855486f029f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:28.337998 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:28.349750 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 783/1562] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:28.349750 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3f862-ae1d-46a0-8def-daba443dae06 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.349750 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3f862-ae1d-46a0-8def-daba443dae06 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.349750 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3f862-ae1d-46a0-8def-daba443dae06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.356072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-332aeaa4-a1f9-46dc-ad9e-66bc6d9259fe None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:28.357607 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-332aeaa4-a1f9-46dc-ad9e-66bc6d9259fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:28.366420 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 780/1563] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:28.367351 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332aeaa4-a1f9-46dc-ad9e-66bc6d9259fe None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:28.369437 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-bdd3f862-ae1d-46a0-8def-daba443dae06 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:28.370919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bdd3f862-ae1d-46a0-8def-daba443dae06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:28.378489 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332aeaa4-a1f9-46dc-ad9e-66bc6d9259fe None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:28.378677 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 784/1564] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:28.379591 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3f862-ae1d-46a0-8def-daba443dae06 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:28.384738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfb622-f7bb-4239-88c7-513c49ef693c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:28.385405 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfb622-f7bb-4239-88c7-513c49ef693c admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.385665 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfb622-f7bb-4239-88c7-513c49ef693c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.385946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfb622-f7bb-4239-88c7-513c49ef693c admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.386676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfb622-f7bb-4239-88c7-513c49ef693c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:34:28.386979 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfb622-f7bb-4239-88c7-513c49ef693c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:28.388624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfb622-f7bb-4239-88c7-513c49ef693c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:28.394368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3f862-ae1d-46a0-8def-daba443dae06 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:28.400630 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f770ca-9605-4db1-9a3e-0a625ca1d9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:28.400953 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 781/1565] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:34:28.401389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f770ca-9605-4db1-9a3e-0a625ca1d9fe admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.401673 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f770ca-9605-4db1-9a3e-0a625ca1d9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.401775 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfb622-f7bb-4239-88c7-513c49ef693c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:28.401945 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f770ca-9605-4db1-9a3e-0a625ca1d9fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.402674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f770ca-9605-4db1-9a3e-0a625ca1d9fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:34:28.402978 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f770ca-9605-4db1-9a3e-0a625ca1d9fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:28.404664 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f770ca-9605-4db1-9a3e-0a625ca1d9fe admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:28.418773 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 785/1566] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:34:28.419597 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfb622-f7bb-4239-88c7-513c49ef693c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:28.419736 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f770ca-9605-4db1-9a3e-0a625ca1d9fe admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:28.425241 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb352f-3507-47ab-9fa3-cd00c86f4bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:28.426225 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb352f-3507-47ab-9fa3-cd00c86f4bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.426504 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb352f-3507-47ab-9fa3-cd00c86f4bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.426775 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb352f-3507-47ab-9fa3-cd00c86f4bbc admin admin] PATH_INFO: `/v3/projects/6252ceeeb99d4ff394e18b30c3029a1d/users/c9c685cf34a1491b9d5aeebe47f2fe18/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.431004 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f770ca-9605-4db1-9a3e-0a625ca1d9fe admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:28.435974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e8065-d8c8-4d51-803a-51f035d1e368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:28.436737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e8065-d8c8-4d51-803a-51f035d1e368 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.437024 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e8065-d8c8-4d51-803a-51f035d1e368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.437304 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e8065-d8c8-4d51-803a-51f035d1e368 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.438058 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e8065-d8c8-4d51-803a-51f035d1e368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:34:28.438367 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e8065-d8c8-4d51-803a-51f035d1e368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:28.440047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e8065-d8c8-4d51-803a-51f035d1e368 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:28.444638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb352f-3507-47ab-9fa3-cd00c86f4bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6252ceeeb99d4ff394e18b30c3029a1d, user_id=c9c685cf34a1491b9d5aeebe47f2fe18, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:28.445828 dv-cinder-835553-1-smb devstack@keystone.service[80263]: WARNING py.warnings [None req-30eb352f-3507-47ab-9fa3-cd00c86f4bbc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:34:28.445828 dv-cinder-835553-1-smb devstack@keystone.service[80263]: warnings.warn(msg) May 27 16:34:28.445828 dv-cinder-835553-1-smb devstack@keystone.service[80263]: May 27 16:34:28.447849 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb352f-3507-47ab-9fa3-cd00c86f4bbc admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:28.454143 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 786/1567] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:34:28.455605 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6183b4-c17b-40ea-9baa-b7c963449131 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.455918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6183b4-c17b-40ea-9baa-b7c963449131 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.456229 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6183b4-c17b-40ea-9baa-b7c963449131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.464743 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 782/1568] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:28 2022] PUT /identity/v3/projects/6252ceeeb99d4ff394e18b30c3029a1d/users/c9c685cf34a1491b9d5aeebe47f2fe18/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:28.474425 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb352f-3507-47ab-9fa3-cd00c86f4bbc admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:28.484574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8e6183b4-c17b-40ea-9baa-b7c963449131 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:28.485807 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8e6183b4-c17b-40ea-9baa-b7c963449131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:28.490370 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:28.534415 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb352f-3507-47ab-9fa3-cd00c86f4bbc admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:28.539648 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492e634-1d5d-4054-ad36-ba57c8d0b4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:28.540591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492e634-1d5d-4054-ad36-ba57c8d0b4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.540867 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492e634-1d5d-4054-ad36-ba57c8d0b4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.541225 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492e634-1d5d-4054-ad36-ba57c8d0b4cf admin admin] PATH_INFO: `/v3/projects/3af70ff049aa454d8e11380e0084e949/users/2ecad16f09f54327b78aab5b06f9872a/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.552461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 787/1569] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:28.553505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6183b4-c17b-40ea-9baa-b7c963449131 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:28.561220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492e634-1d5d-4054-ad36-ba57c8d0b4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af70ff049aa454d8e11380e0084e949, user_id=2ecad16f09f54327b78aab5b06f9872a, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:28.563922 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492e634-1d5d-4054-ad36-ba57c8d0b4cf admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:28.564696 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6183b4-c17b-40ea-9baa-b7c963449131 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:28.571207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c555d-f458-4c9c-960e-fd9a49697227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:28.572106 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c555d-f458-4c9c-960e-fd9a49697227 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.572536 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c555d-f458-4c9c-960e-fd9a49697227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.572815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310c555d-f458-4c9c-960e-fd9a49697227 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.573552 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c555d-f458-4c9c-960e-fd9a49697227 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:34:28.573851 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c555d-f458-4c9c-960e-fd9a49697227 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:28.576217 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310c555d-f458-4c9c-960e-fd9a49697227 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:28.580881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 783/1570] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:28 2022] PUT /identity/v3/projects/3af70ff049aa454d8e11380e0084e949/users/2ecad16f09f54327b78aab5b06f9872a/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:28.581808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492e634-1d5d-4054-ad36-ba57c8d0b4cf admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:28.596205 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 788/1571] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:34:28.597791 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c555d-f458-4c9c-960e-fd9a49697227 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:28.609620 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310c555d-f458-4c9c-960e-fd9a49697227 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:28.651887 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492e634-1d5d-4054-ad36-ba57c8d0b4cf admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:28.657095 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305dd81-4488-457f-a2e4-fda6da38ce34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:28.657773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305dd81-4488-457f-a2e4-fda6da38ce34 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.658290 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305dd81-4488-457f-a2e4-fda6da38ce34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.658437 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305dd81-4488-457f-a2e4-fda6da38ce34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.659108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305dd81-4488-457f-a2e4-fda6da38ce34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:34:28.660923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305dd81-4488-457f-a2e4-fda6da38ce34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:28.661060 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305dd81-4488-457f-a2e4-fda6da38ce34 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:28.669651 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78010e6-1b8f-4ac1-a19e-94e6889e7805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:28.670331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78010e6-1b8f-4ac1-a19e-94e6889e7805 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.670668 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78010e6-1b8f-4ac1-a19e-94e6889e7805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.670941 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78010e6-1b8f-4ac1-a19e-94e6889e7805 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.671831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78010e6-1b8f-4ac1-a19e-94e6889e7805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:28.673823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78010e6-1b8f-4ac1-a19e-94e6889e7805 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:28.674114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 784/1572] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:34:28.681044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305dd81-4488-457f-a2e4-fda6da38ce34 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:28.693930 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305dd81-4488-457f-a2e4-fda6da38ce34 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:28.699511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947eb14a-9fc6-4f33-bc0c-3e7d75bdd3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:28.700616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947eb14a-9fc6-4f33-bc0c-3e7d75bdd3ad admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.700884 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947eb14a-9fc6-4f33-bc0c-3e7d75bdd3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.701154 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947eb14a-9fc6-4f33-bc0c-3e7d75bdd3ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.701829 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947eb14a-9fc6-4f33-bc0c-3e7d75bdd3ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:28.703774 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947eb14a-9fc6-4f33-bc0c-3e7d75bdd3ad admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:28.709207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 789/1573] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:34:28 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:28.709207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78010e6-1b8f-4ac1-a19e-94e6889e7805 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:28.739732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 785/1574] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:34:28 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:28.744797 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f28b52-e31a-46e0-9f32-3fdfa78558ae None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.745143 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f28b52-e31a-46e0-9f32-3fdfa78558ae None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.745353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f28b52-e31a-46e0-9f32-3fdfa78558ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.774100 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a9f28b52-e31a-46e0-9f32-3fdfa78558ae None None] MFA Rules not processed for user `c9c685cf34a1491b9d5aeebe47f2fe18`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:28.775644 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a9f28b52-e31a-46e0-9f32-3fdfa78558ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:28.775773 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78010e6-1b8f-4ac1-a19e-94e6889e7805 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:28.779892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:28.807253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:28.854878 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb15bf-e299-4310-9a4a-f415c2a8bf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:28.855566 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb15bf-e299-4310-9a4a-f415c2a8bf59 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.855850 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb15bf-e299-4310-9a4a-f415c2a8bf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.856168 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb15bf-e299-4310-9a4a-f415c2a8bf59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.856857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb15bf-e299-4310-9a4a-f415c2a8bf59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:28.859054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb15bf-e299-4310-9a4a-f415c2a8bf59 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:28.868316 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 786/1575] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:28.869179 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f28b52-e31a-46e0-9f32-3fdfa78558ae None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:28.886421 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f28b52-e31a-46e0-9f32-3fdfa78558ae None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:28.892219 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c4fe0-a087-4904-9459-1caef963c4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:28.892927 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c4fe0-a087-4904-9459-1caef963c4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.893209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c4fe0-a087-4904-9459-1caef963c4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.893564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c4fe0-a087-4904-9459-1caef963c4c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.894310 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c4fe0-a087-4904-9459-1caef963c4c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:34:28.894722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c4fe0-a087-4904-9459-1caef963c4c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:28.896681 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c4fe0-a087-4904-9459-1caef963c4c7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:28.899846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 790/1576] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:34:28 2022] POST /identity/v3/projects => generated 393 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:28.901100 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab734b8b-0846-48a1-ae62-995ad3107952 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:28.901349 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab734b8b-0846-48a1-ae62-995ad3107952 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:28.901629 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab734b8b-0846-48a1-ae62-995ad3107952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:28.920800 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 787/1577] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:34:28.920800 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c4fe0-a087-4904-9459-1caef963c4c7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:28.921519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ab734b8b-0846-48a1-ae62-995ad3107952 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:28.922761 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ab734b8b-0846-48a1-ae62-995ad3107952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:28.931980 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c4fe0-a087-4904-9459-1caef963c4c7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:28.988804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 791/1578] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:28.989821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab734b8b-0846-48a1-ae62-995ad3107952 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:28.999759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab734b8b-0846-48a1-ae62-995ad3107952 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.001591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4510eaa-7a65-4b03-a0ed-fbd32a1ed78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.002366 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4510eaa-7a65-4b03-a0ed-fbd32a1ed78b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.002644 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4510eaa-7a65-4b03-a0ed-fbd32a1ed78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.002915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4510eaa-7a65-4b03-a0ed-fbd32a1ed78b admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.003605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4510eaa-7a65-4b03-a0ed-fbd32a1ed78b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.004573 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909823e3-bada-4e24-9dd0-a52667c5be5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.005238 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909823e3-bada-4e24-9dd0-a52667c5be5f admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.005523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909823e3-bada-4e24-9dd0-a52667c5be5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.005626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4510eaa-7a65-4b03-a0ed-fbd32a1ed78b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.005798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909823e3-bada-4e24-9dd0-a52667c5be5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.006484 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909823e3-bada-4e24-9dd0-a52667c5be5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.008603 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909823e3-bada-4e24-9dd0-a52667c5be5f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.033999 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 788/1579] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:34:28 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:29.034878 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4510eaa-7a65-4b03-a0ed-fbd32a1ed78b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.039853 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 792/1580] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:34:28 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:29.039853 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909823e3-bada-4e24-9dd0-a52667c5be5f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.100737 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4510eaa-7a65-4b03-a0ed-fbd32a1ed78b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.101935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909823e3-bada-4e24-9dd0-a52667c5be5f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.105860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0a1ac-fa2a-4cb4-a456-37a8cc8daf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.106560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0a1ac-fa2a-4cb4-a456-37a8cc8daf2c admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.106909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0a1ac-fa2a-4cb4-a456-37a8cc8daf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.107024 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ceef4-1a19-4fa9-80fb-a6615a69be03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.107219 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0a1ac-fa2a-4cb4-a456-37a8cc8daf2c admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.107585 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ceef4-1a19-4fa9-80fb-a6615a69be03 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.107866 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ceef4-1a19-4fa9-80fb-a6615a69be03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.107963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0a1ac-fa2a-4cb4-a456-37a8cc8daf2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.108170 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ceef4-1a19-4fa9-80fb-a6615a69be03 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.108850 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ceef4-1a19-4fa9-80fb-a6615a69be03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.109898 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0a1ac-fa2a-4cb4-a456-37a8cc8daf2c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.110783 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ceef4-1a19-4fa9-80fb-a6615a69be03 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.134324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 789/1581] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:34:29 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:29.135066 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0a1ac-fa2a-4cb4-a456-37a8cc8daf2c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.141028 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 793/1582] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:34:29 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:29.141028 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da48f0-f119-4bcc-a9a6-9ce2f5ba9fe9 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.141028 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da48f0-f119-4bcc-a9a6-9ce2f5ba9fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.141028 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da48f0-f119-4bcc-a9a6-9ce2f5ba9fe9 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.141457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 794/1583] 10.222.0.41 () {54 vars in 961 bytes} [Fri May 27 16:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:34:29.145206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da48f0-f119-4bcc-a9a6-9ce2f5ba9fe9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.146780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0a1ac-fa2a-4cb4-a456-37a8cc8daf2c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.151501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82948b99-fb73-4a5d-b2e9-c1cb8f20362e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.152236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82948b99-fb73-4a5d-b2e9-c1cb8f20362e admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.152502 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82948b99-fb73-4a5d-b2e9-c1cb8f20362e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.152781 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82948b99-fb73-4a5d-b2e9-c1cb8f20362e admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.153501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82948b99-fb73-4a5d-b2e9-c1cb8f20362e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.155481 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82948b99-fb73-4a5d-b2e9-c1cb8f20362e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.158751 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da48f0-f119-4bcc-a9a6-9ce2f5ba9fe9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.162521 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:29.164447 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d049d6-b95a-4fd0-b3ff-ec29f733c5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.165157 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d049d6-b95a-4fd0-b3ff-ec29f733c5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.165495 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d049d6-b95a-4fd0-b3ff-ec29f733c5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.165816 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d049d6-b95a-4fd0-b3ff-ec29f733c5a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.166563 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d049d6-b95a-4fd0-b3ff-ec29f733c5a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.168568 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d049d6-b95a-4fd0-b3ff-ec29f733c5a1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.180106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 790/1584] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:34:29 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:29.181057 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82948b99-fb73-4a5d-b2e9-c1cb8f20362e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.196282 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:29.203853 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 795/1585] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:34:29 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:29.205175 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d049d6-b95a-4fd0-b3ff-ec29f733c5a1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.245190 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82948b99-fb73-4a5d-b2e9-c1cb8f20362e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.270567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d049d6-b95a-4fd0-b3ff-ec29f733c5a1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.276765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f250af6-b4b4-4bdf-8823-262a43105d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.277449 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f250af6-b4b4-4bdf-8823-262a43105d77 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.277735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f250af6-b4b4-4bdf-8823-262a43105d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.278012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f250af6-b4b4-4bdf-8823-262a43105d77 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.278733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f250af6-b4b4-4bdf-8823-262a43105d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.280742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f250af6-b4b4-4bdf-8823-262a43105d77 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.304154 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4955aa-0e9b-47fc-9423-9595ab159dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.304812 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4955aa-0e9b-47fc-9423-9595ab159dad service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.305096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4955aa-0e9b-47fc-9423-9595ab159dad service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.305383 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4955aa-0e9b-47fc-9423-9595ab159dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.308873 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 796/1586] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:34:29 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:29.310321 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f250af6-b4b4-4bdf-8823-262a43105d77 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.316244 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4955aa-0e9b-47fc-9423-9595ab159dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.317737 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4955aa-0e9b-47fc-9423-9595ab159dad service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.322688 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f250af6-b4b4-4bdf-8823-262a43105d77 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.328602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 791/1587] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:29.329421 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4955aa-0e9b-47fc-9423-9595ab159dad service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.334212 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf284b1f-aaf0-45c0-a182-f6d684a6c173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.335259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf284b1f-aaf0-45c0-a182-f6d684a6c173 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.335517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf284b1f-aaf0-45c0-a182-f6d684a6c173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.335811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf284b1f-aaf0-45c0-a182-f6d684a6c173 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.336656 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf284b1f-aaf0-45c0-a182-f6d684a6c173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.338715 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf284b1f-aaf0-45c0-a182-f6d684a6c173 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.339651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4955aa-0e9b-47fc-9423-9595ab159dad service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.344352 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be3936-4160-4b39-948f-67bc6fff3e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.345031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be3936-4160-4b39-948f-67bc6fff3e18 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.345318 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be3936-4160-4b39-948f-67bc6fff3e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.345595 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be3936-4160-4b39-948f-67bc6fff3e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.346328 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be3936-4160-4b39-948f-67bc6fff3e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.347968 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be3936-4160-4b39-948f-67bc6fff3e18 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.363080 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 792/1588] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:29.363907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be3936-4160-4b39-948f-67bc6fff3e18 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.373202 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 797/1589] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:34:29 2022] POST /identity/v3/users => generated 294 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:29.373202 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8f13a-6a27-4751-9699-facedd7abb68 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.373202 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8f13a-6a27-4751-9699-facedd7abb68 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.373202 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8f13a-6a27-4751-9699-facedd7abb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.380545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be3936-4160-4b39-948f-67bc6fff3e18 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.385991 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277a0ed-6526-4f1e-9bc8-9c888423eb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.386690 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277a0ed-6526-4f1e-9bc8-9c888423eb55 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.386953 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277a0ed-6526-4f1e-9bc8-9c888423eb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.387553 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277a0ed-6526-4f1e-9bc8-9c888423eb55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.388242 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277a0ed-6526-4f1e-9bc8-9c888423eb55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.390234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277a0ed-6526-4f1e-9bc8-9c888423eb55 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.396702 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b1d8f13a-6a27-4751-9699-facedd7abb68 None None] MFA Rules not processed for user `3caa3dbc7bd24ebba28296a1eba9cefe`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:29.398281 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b1d8f13a-6a27-4751-9699-facedd7abb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:29.403887 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 793/1590] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:29.403887 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277a0ed-6526-4f1e-9bc8-9c888423eb55 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.415178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277a0ed-6526-4f1e-9bc8-9c888423eb55 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.421342 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dcbe5-05c6-447d-8875-c20d0c6944fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.422144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dcbe5-05c6-447d-8875-c20d0c6944fd admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.422549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dcbe5-05c6-447d-8875-c20d0c6944fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.422851 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dcbe5-05c6-447d-8875-c20d0c6944fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.423605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dcbe5-05c6-447d-8875-c20d0c6944fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.425458 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dcbe5-05c6-447d-8875-c20d0c6944fd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.442011 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 794/1591] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:29.443085 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dcbe5-05c6-447d-8875-c20d0c6944fd admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.455749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dcbe5-05c6-447d-8875-c20d0c6944fd admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.461309 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c19b7-ddd9-4fa0-8874-32357f4c46a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.462192 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c19b7-ddd9-4fa0-8874-32357f4c46a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.462520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c19b7-ddd9-4fa0-8874-32357f4c46a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.462892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c19b7-ddd9-4fa0-8874-32357f4c46a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.463700 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c19b7-ddd9-4fa0-8874-32357f4c46a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.465798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c19b7-ddd9-4fa0-8874-32357f4c46a9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.484627 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 798/1592] 10.222.0.41 () {58 vars in 1058 bytes} [Fri May 27 16:34:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:29.485733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8f13a-6a27-4751-9699-facedd7abb68 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.494233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 795/1593] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:34:29 2022] POST /identity/v3/users => generated 292 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:29.494233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c19b7-ddd9-4fa0-8874-32357f4c46a9 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.500600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8f13a-6a27-4751-9699-facedd7abb68 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.506448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb76e2-792a-470c-84c6-d2c8c1ec9d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.507141 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb76e2-792a-470c-84c6-d2c8c1ec9d24 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.507686 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb76e2-792a-470c-84c6-d2c8c1ec9d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.508064 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb76e2-792a-470c-84c6-d2c8c1ec9d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.508932 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb76e2-792a-470c-84c6-d2c8c1ec9d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.510642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb76e2-792a-470c-84c6-d2c8c1ec9d24 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.512296 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c19b7-ddd9-4fa0-8874-32357f4c46a9 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.520134 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7af67-439b-4804-a7e0-2c4a3864670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.521220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7af67-439b-4804-a7e0-2c4a3864670e admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.521828 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7af67-439b-4804-a7e0-2c4a3864670e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.522021 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 799/1594] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:29.522491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7af67-439b-4804-a7e0-2c4a3864670e admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.522840 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb76e2-792a-470c-84c6-d2c8c1ec9d24 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.523793 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7af67-439b-4804-a7e0-2c4a3864670e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.525809 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7af67-439b-4804-a7e0-2c4a3864670e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.536120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb76e2-792a-470c-84c6-d2c8c1ec9d24 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.540218 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 796/1595] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:29.542189 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7af67-439b-4804-a7e0-2c4a3864670e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.545422 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b0541-d02a-4e99-9819-4e9f42334144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.546123 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b0541-d02a-4e99-9819-4e9f42334144 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.546414 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b0541-d02a-4e99-9819-4e9f42334144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.546690 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b0541-d02a-4e99-9819-4e9f42334144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.547876 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b0541-d02a-4e99-9819-4e9f42334144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.549645 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b0541-d02a-4e99-9819-4e9f42334144 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.552383 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7af67-439b-4804-a7e0-2c4a3864670e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.558835 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17283a2d-abea-48bf-8206-211e9b839b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.559484 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17283a2d-abea-48bf-8206-211e9b839b44 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.559766 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17283a2d-abea-48bf-8206-211e9b839b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.560072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17283a2d-abea-48bf-8206-211e9b839b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.560909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17283a2d-abea-48bf-8206-211e9b839b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.562897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 800/1596] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:29.563822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b0541-d02a-4e99-9819-4e9f42334144 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.565944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17283a2d-abea-48bf-8206-211e9b839b44 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.578844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 797/1597] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:29.579719 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17283a2d-abea-48bf-8206-211e9b839b44 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.581532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b0541-d02a-4e99-9819-4e9f42334144 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.589592 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc0597-6344-492e-b61c-c419aff3382b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.590744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc0597-6344-492e-b61c-c419aff3382b admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.590857 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17283a2d-abea-48bf-8206-211e9b839b44 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.591911 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc0597-6344-492e-b61c-c419aff3382b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.591911 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc0597-6344-492e-b61c-c419aff3382b admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.593171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc0597-6344-492e-b61c-c419aff3382b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.595988 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc0597-6344-492e-b61c-c419aff3382b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.597039 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2f903-bfee-4022-a840-545a6a96922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.598069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2f903-bfee-4022-a840-545a6a96922c admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.598471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2f903-bfee-4022-a840-545a6a96922c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.598820 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2f903-bfee-4022-a840-545a6a96922c admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.600098 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2f903-bfee-4022-a840-545a6a96922c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.602065 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2f903-bfee-4022-a840-545a6a96922c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.611132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 801/1598] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:29.611132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc0597-6344-492e-b61c-c419aff3382b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.615055 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 798/1599] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:29.617634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2f903-bfee-4022-a840-545a6a96922c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.630127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2f903-bfee-4022-a840-545a6a96922c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.630888 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc0597-6344-492e-b61c-c419aff3382b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.636193 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f803a1b-9876-4d22-928c-6dbac237e360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.636835 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f803a1b-9876-4d22-928c-6dbac237e360 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.637121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f803a1b-9876-4d22-928c-6dbac237e360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.637398 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f803a1b-9876-4d22-928c-6dbac237e360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.638133 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f803a1b-9876-4d22-928c-6dbac237e360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.639914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c1bbe-4b89-4fdf-a3d1-2978332f8b32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.640188 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f803a1b-9876-4d22-928c-6dbac237e360 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.640783 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c1bbe-4b89-4fdf-a3d1-2978332f8b32 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.641143 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c1bbe-4b89-4fdf-a3d1-2978332f8b32 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.641586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c1bbe-4b89-4fdf-a3d1-2978332f8b32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.653126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 799/1600] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:29.654103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f803a1b-9876-4d22-928c-6dbac237e360 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.664463 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f803a1b-9876-4d22-928c-6dbac237e360 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.671328 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7216d6a-e530-4d89-89a1-808644126c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.672409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7216d6a-e530-4d89-89a1-808644126c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.672885 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7216d6a-e530-4d89-89a1-808644126c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.673227 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7216d6a-e530-4d89-89a1-808644126c12 admin admin] PATH_INFO: `/v3/projects/9b5bab75d5954ef4be88addb4148d302/users/a6b94a5619864811a22bdf949e56ee77/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.682219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:29.691829 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:29.697210 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7216d6a-e530-4d89-89a1-808644126c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b5bab75d5954ef4be88addb4148d302, user_id=a6b94a5619864811a22bdf949e56ee77, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.702125 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7216d6a-e530-4d89-89a1-808644126c12 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.720998 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 800/1601] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:29 2022] PUT /identity/v3/projects/9b5bab75d5954ef4be88addb4148d302/users/a6b94a5619864811a22bdf949e56ee77/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:29.722534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7216d6a-e530-4d89-89a1-808644126c12 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.733393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c1bbe-4b89-4fdf-a3d1-2978332f8b32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.735907 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c1bbe-4b89-4fdf-a3d1-2978332f8b32 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.749500 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 802/1602] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:29.750403 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c1bbe-4b89-4fdf-a3d1-2978332f8b32 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.761489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c1bbe-4b89-4fdf-a3d1-2978332f8b32 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.849742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de9d71-e9ee-43b4-9b12-7f08e0adc8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.850714 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de9d71-e9ee-43b4-9b12-7f08e0adc8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.851344 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de9d71-e9ee-43b4-9b12-7f08e0adc8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.852322 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de9d71-e9ee-43b4-9b12-7f08e0adc8d4 admin admin] PATH_INFO: `/v3/projects/2d9c9b9228ce4327a0bc66ef2a7ae570/users/0fff15ee13a54a80828afa5fcc61eef0/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.855141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7216d6a-e530-4d89-89a1-808644126c12 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.861868 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2661d6-a0e2-49eb-ae61-910c7ec6690a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:29.862950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2661d6-a0e2-49eb-ae61-910c7ec6690a admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:29.863389 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2661d6-a0e2-49eb-ae61-910c7ec6690a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:29.863841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2661d6-a0e2-49eb-ae61-910c7ec6690a admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:29.865048 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2661d6-a0e2-49eb-ae61-910c7ec6690a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.867638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2661d6-a0e2-49eb-ae61-910c7ec6690a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.870505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de9d71-e9ee-43b4-9b12-7f08e0adc8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9c9b9228ce4327a0bc66ef2a7ae570, user_id=0fff15ee13a54a80828afa5fcc61eef0, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:29.873581 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de9d71-e9ee-43b4-9b12-7f08e0adc8d4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:29.881682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 801/1603] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:29.882839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2661d6-a0e2-49eb-ae61-910c7ec6690a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:29.906115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2661d6-a0e2-49eb-ae61-910c7ec6690a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:29.908477 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 803/1604] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:29 2022] PUT /identity/v3/projects/2d9c9b9228ce4327a0bc66ef2a7ae570/users/0fff15ee13a54a80828afa5fcc61eef0/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:29.910007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de9d71-e9ee-43b4-9b12-7f08e0adc8d4 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:30.000160 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e224a49-6e8b-4560-923e-d65f712ec430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:30.001564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e224a49-6e8b-4560-923e-d65f712ec430 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:30.002053 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e224a49-6e8b-4560-923e-d65f712ec430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:30.002186 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de9d71-e9ee-43b4-9b12-7f08e0adc8d4 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:30.002717 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e224a49-6e8b-4560-923e-d65f712ec430 admin admin] PATH_INFO: `/v3/projects/05ea724506e84778ba750711c932db9d/users/2a318e87c9d6497ead119623fbf0dcc1/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:30.007194 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a406b-16d0-435c-b0f2-0f8d4fbfa3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:30.008241 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a406b-16d0-435c-b0f2-0f8d4fbfa3ae admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:30.008476 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a406b-16d0-435c-b0f2-0f8d4fbfa3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:30.008866 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a406b-16d0-435c-b0f2-0f8d4fbfa3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:30.009715 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a406b-16d0-435c-b0f2-0f8d4fbfa3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:30.011386 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80a406b-16d0-435c-b0f2-0f8d4fbfa3ae admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:30.032670 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 804/1605] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:30.034519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a406b-16d0-435c-b0f2-0f8d4fbfa3ae admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:30.042260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e224a49-6e8b-4560-923e-d65f712ec430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ea724506e84778ba750711c932db9d, user_id=2a318e87c9d6497ead119623fbf0dcc1, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:30.047381 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a406b-16d0-435c-b0f2-0f8d4fbfa3ae admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:30.047912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e224a49-6e8b-4560-923e-d65f712ec430 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:30.053119 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b5df0-a02a-438b-9035-23fa14b6bea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:30.054837 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b5df0-a02a-438b-9035-23fa14b6bea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:30.054837 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b5df0-a02a-438b-9035-23fa14b6bea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:30.054837 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b5df0-a02a-438b-9035-23fa14b6bea7 admin admin] PATH_INFO: `/v3/projects/1056e9a5477c4bf39d0af147b1d62895/users/9d0d70db4a5d449289b340dd5c5ffaf5/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:30.074150 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 802/1606] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:29 2022] PUT /identity/v3/projects/05ea724506e84778ba750711c932db9d/users/2a318e87c9d6497ead119623fbf0dcc1/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:30.076433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba64db9-be3a-4220-a470-09d662188319 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:30.076720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba64db9-be3a-4220-a470-09d662188319 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:30.076995 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba64db9-be3a-4220-a470-09d662188319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:30.078147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b5df0-a02a-438b-9035-23fa14b6bea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1056e9a5477c4bf39d0af147b1d62895, user_id=9d0d70db4a5d449289b340dd5c5ffaf5, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:30.081318 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b5df0-a02a-438b-9035-23fa14b6bea7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:30.098939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 805/1607] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:30 2022] PUT /identity/v3/projects/1056e9a5477c4bf39d0af147b1d62895/users/9d0d70db4a5d449289b340dd5c5ffaf5/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:30.100058 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b5df0-a02a-438b-9035-23fa14b6bea7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:30.102837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1ba64db9-be3a-4220-a470-09d662188319 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:30.104128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1ba64db9-be3a-4220-a470-09d662188319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:30.163039 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:30.214848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b5df0-a02a-438b-9035-23fa14b6bea7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:30.220726 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f62c65-3bc0-4ffd-997d-eb064c846f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:30.222359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f62c65-3bc0-4ffd-997d-eb064c846f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:30.222881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f62c65-3bc0-4ffd-997d-eb064c846f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:30.223500 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f62c65-3bc0-4ffd-997d-eb064c846f60 admin admin] PATH_INFO: `/v3/projects/b36a8dc3f1e146ae99e0ca843e1bc93a/users/6d3dd7ad5436451a919ef8aaf9623f83/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:30.235369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 803/1608] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:30.237255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a06570-8060-4d04-ae13-f8bd0a5c8a77 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:30.237860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a06570-8060-4d04-ae13-f8bd0a5c8a77 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:30.238328 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a06570-8060-4d04-ae13-f8bd0a5c8a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:30.255711 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f62c65-3bc0-4ffd-997d-eb064c846f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36a8dc3f1e146ae99e0ca843e1bc93a, user_id=6d3dd7ad5436451a919ef8aaf9623f83, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:30.259107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f62c65-3bc0-4ffd-997d-eb064c846f60 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:30.272841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:30.286396 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-42a06570-8060-4d04-ae13-f8bd0a5c8a77 None None] MFA Rules not processed for user `0fff15ee13a54a80828afa5fcc61eef0`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:30.287392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 806/1609] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:30 2022] PUT /identity/v3/projects/b36a8dc3f1e146ae99e0ca843e1bc93a/users/6d3dd7ad5436451a919ef8aaf9623f83/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:30.288791 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f62c65-3bc0-4ffd-997d-eb064c846f60 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:30.291785 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-42a06570-8060-4d04-ae13-f8bd0a5c8a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:30.380273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f62c65-3bc0-4ffd-997d-eb064c846f60 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:30.386333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad366f-4e1c-4f79-b435-a62594381c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:30.387537 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad366f-4e1c-4f79-b435-a62594381c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:30.387905 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad366f-4e1c-4f79-b435-a62594381c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:30.388592 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad366f-4e1c-4f79-b435-a62594381c58 admin admin] PATH_INFO: `/v3/projects/6de78dab5be54052a428ec5424f4ac5c/users/61a66001e3aa4780adae5ffe693b1832/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:30.396881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 804/1610] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:30.399344 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346afc9f-bf22-4c31-854b-b330ff59db73 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:30.399639 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346afc9f-bf22-4c31-854b-b330ff59db73 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:30.399915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346afc9f-bf22-4c31-854b-b330ff59db73 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:30.402355 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 805/1611] 10.222.0.41 () {54 vars in 912 bytes} [Fri May 27 16:34:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:34:30.403731 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f5829-1e16-4f03-95ef-e7bd7669c633 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:30.404034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f5829-1e16-4f03-95ef-e7bd7669c633 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:30.404318 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f5829-1e16-4f03-95ef-e7bd7669c633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:30.413196 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad366f-4e1c-4f79-b435-a62594381c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de78dab5be54052a428ec5424f4ac5c, user_id=61a66001e3aa4780adae5ffe693b1832, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:30.418031 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad366f-4e1c-4f79-b435-a62594381c58 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:30.425670 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-fa4f5829-1e16-4f03-95ef-e7bd7669c633 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:30.427079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fa4f5829-1e16-4f03-95ef-e7bd7669c633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:30.447739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 807/1612] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:30 2022] PUT /identity/v3/projects/6de78dab5be54052a428ec5424f4ac5c/users/61a66001e3aa4780adae5ffe693b1832/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:30.447739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185e0e1-96f6-4832-8119-a9b3b7dad5fc None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:30.447739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185e0e1-96f6-4832-8119-a9b3b7dad5fc None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:30.447739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185e0e1-96f6-4832-8119-a9b3b7dad5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:30.474813 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3185e0e1-96f6-4832-8119-a9b3b7dad5fc None None] MFA Rules not processed for user `9d0d70db4a5d449289b340dd5c5ffaf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:30.476586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3185e0e1-96f6-4832-8119-a9b3b7dad5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:30.513144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 806/1613] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:30.514806 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f5829-1e16-4f03-95ef-e7bd7669c633 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:30.517663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fa4f5829-1e16-4f03-95ef-e7bd7669c633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:30.573191 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 808/1614] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:30.574557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f09e9-8e7f-4f5f-8b57-ff0a2ba7b11a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:30.575453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f09e9-8e7f-4f5f-8b57-ff0a2ba7b11a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:30.576544 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f09e9-8e7f-4f5f-8b57-ff0a2ba7b11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:30.601353 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a47f09e9-8e7f-4f5f-8b57-ff0a2ba7b11a None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:30.603593 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a47f09e9-8e7f-4f5f-8b57-ff0a2ba7b11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:30.606977 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f5829-1e16-4f03-95ef-e7bd7669c633 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:30.611365 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2e0f1-d993-4c7b-86b1-6098ebc43d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:30.612454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2e0f1-d993-4c7b-86b1-6098ebc43d0b service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:30.612890 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2e0f1-d993-4c7b-86b1-6098ebc43d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:30.613355 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2e0f1-d993-4c7b-86b1-6098ebc43d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:30.616166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 809/1615] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:30.618986 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f09e9-8e7f-4f5f-8b57-ff0a2ba7b11a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:30.624780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2e0f1-d993-4c7b-86b1-6098ebc43d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:30.626267 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2e0f1-d993-4c7b-86b1-6098ebc43d0b service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:30.636723 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f09e9-8e7f-4f5f-8b57-ff0a2ba7b11a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:30.639853 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 807/1616] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:30.640952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51eddc-5637-478d-ac19-112d34ae72aa None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:30.641218 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51eddc-5637-478d-ac19-112d34ae72aa None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:30.641491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51eddc-5637-478d-ac19-112d34ae72aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:30.645618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e2d7c-0883-4c11-95f0-149f0c021010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:30.646642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e2d7c-0883-4c11-95f0-149f0c021010 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:30.647026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e2d7c-0883-4c11-95f0-149f0c021010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:30.647443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e2d7c-0883-4c11-95f0-149f0c021010 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:30.649155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e2d7c-0883-4c11-95f0-149f0c021010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:30.651318 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e2d7c-0883-4c11-95f0-149f0c021010 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:30.664160 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:30.668466 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-bb51eddc-5637-478d-ac19-112d34ae72aa None None] MFA Rules not processed for user `3caa3dbc7bd24ebba28296a1eba9cefe`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:30.671256 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bb51eddc-5637-478d-ac19-112d34ae72aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:30.700623 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 810/1617] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:34:30 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:30.703064 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb554e1-d48d-4c3d-97dc-d84b1f08629e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:30.703616 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb554e1-d48d-4c3d-97dc-d84b1f08629e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:30.703999 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb554e1-d48d-4c3d-97dc-d84b1f08629e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:30.728865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:30.746542 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9bb554e1-d48d-4c3d-97dc-d84b1f08629e None None] MFA Rules not processed for user `61a66001e3aa4780adae5ffe693b1832`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:30.748884 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9bb554e1-d48d-4c3d-97dc-d84b1f08629e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:30.805352 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 808/1618] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 16:34:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:30.806250 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51eddc-5637-478d-ac19-112d34ae72aa None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:30.835981 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51eddc-5637-478d-ac19-112d34ae72aa None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:30.891422 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 811/1619] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:30.892471 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb554e1-d48d-4c3d-97dc-d84b1f08629e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:30.934717 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3ef0e-fae0-41fe-8852-dea013ca7487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:30.935409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3ef0e-fae0-41fe-8852-dea013ca7487 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:30.935680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3ef0e-fae0-41fe-8852-dea013ca7487 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:30.935957 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3ef0e-fae0-41fe-8852-dea013ca7487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:31.014855 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb554e1-d48d-4c3d-97dc-d84b1f08629e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:31.022546 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcaab3-a680-423e-9014-fb1fd993090a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:31.025088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcaab3-a680-423e-9014-fb1fd993090a admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:31.026101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcaab3-a680-423e-9014-fb1fd993090a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:31.026674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcaab3-a680-423e-9014-fb1fd993090a admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:31.028666 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcaab3-a680-423e-9014-fb1fd993090a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:31.039627 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcaab3-a680-423e-9014-fb1fd993090a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:31.081780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3ef0e-fae0-41fe-8852-dea013ca7487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:31.082978 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3ef0e-fae0-41fe-8852-dea013ca7487 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:31.097752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 809/1620] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:31.097752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3ef0e-fae0-41fe-8852-dea013ca7487 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:31.105623 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 812/1621] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:34:30 2022] POST /identity/v3/projects => generated 379 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:31.110326 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcaab3-a680-423e-9014-fb1fd993090a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:31.113731 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3ef0e-fae0-41fe-8852-dea013ca7487 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:31.233150 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcaab3-a680-423e-9014-fb1fd993090a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:31.244225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cc853-0f03-4b9b-a83a-5e91df2b61b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:31.245102 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cc853-0f03-4b9b-a83a-5e91df2b61b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:31.245397 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cc853-0f03-4b9b-a83a-5e91df2b61b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:31.245849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cc853-0f03-4b9b-a83a-5e91df2b61b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:31.247030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cc853-0f03-4b9b-a83a-5e91df2b61b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:31.259228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec80928-f7db-4efb-a4bd-c8334d2350c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:31.260058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec80928-f7db-4efb-a4bd-c8334d2350c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:31.260451 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec80928-f7db-4efb-a4bd-c8334d2350c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:31.260890 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec80928-f7db-4efb-a4bd-c8334d2350c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:31.263163 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cc853-0f03-4b9b-a83a-5e91df2b61b3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:31.273980 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec80928-f7db-4efb-a4bd-c8334d2350c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:31.276236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec80928-f7db-4efb-a4bd-c8334d2350c8 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:31.296418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:31.298025 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 810/1622] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:31.299644 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec80928-f7db-4efb-a4bd-c8334d2350c8 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:31.316729 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 813/1623] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:34:31 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:31.321886 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a9173-1209-4c4f-97b9-824157d83276 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:31.322175 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a9173-1209-4c4f-97b9-824157d83276 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:31.322459 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a9173-1209-4c4f-97b9-824157d83276 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:31.323966 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 814/1624] 10.222.0.41 () {54 vars in 961 bytes} [Fri May 27 16:34:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:34:31.324718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a9173-1209-4c4f-97b9-824157d83276 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:31.344814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a9173-1209-4c4f-97b9-824157d83276 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:31.351521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f2a61-d109-4e72-a523-fa95eccbf12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:31.353057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f2a61-d109-4e72-a523-fa95eccbf12b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:31.353057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f2a61-d109-4e72-a523-fa95eccbf12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:31.353346 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f2a61-d109-4e72-a523-fa95eccbf12b admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:31.354235 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f2a61-d109-4e72-a523-fa95eccbf12b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:31.359512 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f2a61-d109-4e72-a523-fa95eccbf12b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:31.365596 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:31.398431 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 815/1625] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:34:31 2022] POST /identity/v3/users => generated 296 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:31.398431 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f2a61-d109-4e72-a523-fa95eccbf12b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:31.410610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f2a61-d109-4e72-a523-fa95eccbf12b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:31.416885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e66d4-c42b-42f3-84f8-813bae295064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:31.417711 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e66d4-c42b-42f3-84f8-813bae295064 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:31.418107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e66d4-c42b-42f3-84f8-813bae295064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:31.418938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e66d4-c42b-42f3-84f8-813bae295064 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:31.420400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e66d4-c42b-42f3-84f8-813bae295064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:31.423808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e66d4-c42b-42f3-84f8-813bae295064 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:31.428631 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec80928-f7db-4efb-a4bd-c8334d2350c8 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:31.449397 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 816/1626] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:31.449997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8844321-2b25-4251-afe6-81ac02f54822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:31.452061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8844321-2b25-4251-afe6-81ac02f54822 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:31.452487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8844321-2b25-4251-afe6-81ac02f54822 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:31.452905 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8844321-2b25-4251-afe6-81ac02f54822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:31.453973 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ececb-167e-457a-9cd6-53602eb337d7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:31.454352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ececb-167e-457a-9cd6-53602eb337d7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:31.454593 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ececb-167e-457a-9cd6-53602eb337d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:31.482063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-061ececb-167e-457a-9cd6-53602eb337d7 None None] MFA Rules not processed for user `3caa3dbc7bd24ebba28296a1eba9cefe`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:31.483278 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-061ececb-167e-457a-9cd6-53602eb337d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:31.623640 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 817/1627] 10.222.0.41 () {58 vars in 1058 bytes} [Fri May 27 16:34:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:31.624832 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ececb-167e-457a-9cd6-53602eb337d7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:31.639249 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ececb-167e-457a-9cd6-53602eb337d7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:31.645143 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737f59d-e8bf-4b71-ae38-0141fc20ce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:31.645811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737f59d-e8bf-4b71-ae38-0141fc20ce60 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:31.646142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737f59d-e8bf-4b71-ae38-0141fc20ce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:31.646424 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737f59d-e8bf-4b71-ae38-0141fc20ce60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:31.647250 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737f59d-e8bf-4b71-ae38-0141fc20ce60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:31.649431 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737f59d-e8bf-4b71-ae38-0141fc20ce60 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:31.658993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8844321-2b25-4251-afe6-81ac02f54822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:31.660948 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8844321-2b25-4251-afe6-81ac02f54822 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:31.662359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 818/1628] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:31.665817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737f59d-e8bf-4b71-ae38-0141fc20ce60 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:31.679370 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737f59d-e8bf-4b71-ae38-0141fc20ce60 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:31.688778 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804bc16-5b77-428a-88a2-82783a6fedb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:31.688958 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 811/1629] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:31.689976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8844321-2b25-4251-afe6-81ac02f54822 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:31.690924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804bc16-5b77-428a-88a2-82783a6fedb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:31.691391 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804bc16-5b77-428a-88a2-82783a6fedb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:31.691988 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804bc16-5b77-428a-88a2-82783a6fedb8 admin admin] PATH_INFO: `/v3/projects/88a2f886407e4fe29aab58f2765e5c48/users/1c334459a7754c8884d405496c1085a4/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:31.707287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8844321-2b25-4251-afe6-81ac02f54822 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:31.719900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac19845-f872-4d80-8596-45f55234507c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:31.720839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac19845-f872-4d80-8596-45f55234507c service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:31.721190 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac19845-f872-4d80-8596-45f55234507c service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:31.721534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac19845-f872-4d80-8596-45f55234507c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:31.723843 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804bc16-5b77-428a-88a2-82783a6fedb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a2f886407e4fe29aab58f2765e5c48, user_id=1c334459a7754c8884d405496c1085a4, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:31.729390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804bc16-5b77-428a-88a2-82783a6fedb8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:31.763502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 819/1630] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:31 2022] PUT /identity/v3/projects/88a2f886407e4fe29aab58f2765e5c48/users/1c334459a7754c8884d405496c1085a4/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:31.763502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804bc16-5b77-428a-88a2-82783a6fedb8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:31.797348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac19845-f872-4d80-8596-45f55234507c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:31.799439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac19845-f872-4d80-8596-45f55234507c service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:31.812070 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 812/1631] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:31.813039 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac19845-f872-4d80-8596-45f55234507c service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:31.824499 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac19845-f872-4d80-8596-45f55234507c service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:31.893735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804bc16-5b77-428a-88a2-82783a6fedb8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:31.909621 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbd0ac-3333-4a4b-b134-59183e43f965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:31.910426 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbd0ac-3333-4a4b-b134-59183e43f965 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:31.910608 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbd0ac-3333-4a4b-b134-59183e43f965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:31.910891 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbd0ac-3333-4a4b-b134-59183e43f965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:31.911639 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbd0ac-3333-4a4b-b134-59183e43f965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:31.913729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbd0ac-3333-4a4b-b134-59183e43f965 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:31.936409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa8906-a636-4f33-a0a5-02e0d60ff72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:31.939277 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa8906-a636-4f33-a0a5-02e0d60ff72c admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:31.939508 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 813/1632] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:31.939991 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa8906-a636-4f33-a0a5-02e0d60ff72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:31.942443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa8906-a636-4f33-a0a5-02e0d60ff72c admin admin] PATH_INFO: `/v3/projects/24febadc747146f7b40f972c2ec3c8be/users/506273d8191c4421b91ae36204445f33/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:31.944285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbd0ac-3333-4a4b-b134-59183e43f965 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:31.950904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:31.966464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbd0ac-3333-4a4b-b134-59183e43f965 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:31.978931 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f43567-dc29-4ee9-a384-b8d21295379a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:31.979859 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f43567-dc29-4ee9-a384-b8d21295379a admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:31.980251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f43567-dc29-4ee9-a384-b8d21295379a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:31.980532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f43567-dc29-4ee9-a384-b8d21295379a admin admin] PATH_INFO: `/v3/projects/88a2f886407e4fe29aab58f2765e5c48/users/1c334459a7754c8884d405496c1085a4/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:31.982617 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f43567-dc29-4ee9-a384-b8d21295379a admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a2f886407e4fe29aab58f2765e5c48, user_id=1c334459a7754c8884d405496c1085a4, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:31.985422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f43567-dc29-4ee9-a384-b8d21295379a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:31.988332 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa8906-a636-4f33-a0a5-02e0d60ff72c admin admin] RBAC: Authorizing `identity:create_grant(project_id=24febadc747146f7b40f972c2ec3c8be, user_id=506273d8191c4421b91ae36204445f33, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:31.995935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa8906-a636-4f33-a0a5-02e0d60ff72c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:32.023444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 814/1633] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:31 2022] PUT /identity/v3/projects/88a2f886407e4fe29aab58f2765e5c48/users/1c334459a7754c8884d405496c1085a4/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:34:32.030151 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 820/1634] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:31 2022] PUT /identity/v3/projects/24febadc747146f7b40f972c2ec3c8be/users/506273d8191c4421b91ae36204445f33/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:32.030373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed40f1-460e-4b28-ae41-48afe0808c6a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:32.030373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed40f1-460e-4b28-ae41-48afe0808c6a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:32.030373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed40f1-460e-4b28-ae41-48afe0808c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:32.031949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa8906-a636-4f33-a0a5-02e0d60ff72c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:32.048696 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:32.078182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-43ed40f1-460e-4b28-ae41-48afe0808c6a None None] MFA Rules not processed for user `1c334459a7754c8884d405496c1085a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:32.079469 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-43ed40f1-460e-4b28-ae41-48afe0808c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:32.188143 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 815/1635] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:32.201369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed40f1-460e-4b28-ae41-48afe0808c6a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:32.237592 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa8906-a636-4f33-a0a5-02e0d60ff72c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:32.254321 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79488be9-9ebb-4590-a0f4-8f6ed12d3ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:32.255051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79488be9-9ebb-4590-a0f4-8f6ed12d3ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:32.255289 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79488be9-9ebb-4590-a0f4-8f6ed12d3ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:32.255567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79488be9-9ebb-4590-a0f4-8f6ed12d3ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:32.256315 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79488be9-9ebb-4590-a0f4-8f6ed12d3ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:32.258491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79488be9-9ebb-4590-a0f4-8f6ed12d3ec6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:32.286432 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 821/1636] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:34:32.289811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79488be9-9ebb-4590-a0f4-8f6ed12d3ec6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:32.313774 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79488be9-9ebb-4590-a0f4-8f6ed12d3ec6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:32.320413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed40f1-460e-4b28-ae41-48afe0808c6a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:32.323809 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0aaf45-91f1-41f3-99ee-a2db4e7cedc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:32.324762 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aaf45-91f1-41f3-99ee-a2db4e7cedc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:32.325039 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aaf45-91f1-41f3-99ee-a2db4e7cedc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:32.325658 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0aaf45-91f1-41f3-99ee-a2db4e7cedc1 admin admin] PATH_INFO: `/v3/projects/24febadc747146f7b40f972c2ec3c8be/users/506273d8191c4421b91ae36204445f33/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:32.328857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0aaf45-91f1-41f3-99ee-a2db4e7cedc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24febadc747146f7b40f972c2ec3c8be, user_id=506273d8191c4421b91ae36204445f33, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:32.330190 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d2989-f4f6-45b2-9f8f-d0dc02269e74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:32.330676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d2989-f4f6-45b2-9f8f-d0dc02269e74 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:32.330964 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d2989-f4f6-45b2-9f8f-d0dc02269e74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:32.331239 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d2989-f4f6-45b2-9f8f-d0dc02269e74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:32.331558 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0aaf45-91f1-41f3-99ee-a2db4e7cedc1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:32.358655 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d2989-f4f6-45b2-9f8f-d0dc02269e74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:32.362606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d2989-f4f6-45b2-9f8f-d0dc02269e74 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:32.364975 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 822/1637] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:32 2022] PUT /identity/v3/projects/24febadc747146f7b40f972c2ec3c8be/users/506273d8191c4421b91ae36204445f33/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:34:32.384513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a69e94-9676-4b6d-95a1-c5c5be090ace None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:32.384888 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a69e94-9676-4b6d-95a1-c5c5be090ace None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:32.385198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a69e94-9676-4b6d-95a1-c5c5be090ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:32.385749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 816/1638] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:32 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:34:32.487733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa72b63-d377-48be-8c23-8bd5da3d34a9 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:32.487986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa72b63-d377-48be-8c23-8bd5da3d34a9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:32.488214 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa72b63-d377-48be-8c23-8bd5da3d34a9 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:32.492472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 817/1639] 10.222.0.41 () {54 vars in 912 bytes} [Fri May 27 16:34:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:34:32.496583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadcbf2-5cb6-46a4-8dc1-9631c95fa6a4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:32.496882 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadcbf2-5cb6-46a4-8dc1-9631c95fa6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:32.497165 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadcbf2-5cb6-46a4-8dc1-9631c95fa6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:32.499094 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-57a69e94-9676-4b6d-95a1-c5c5be090ace None None] MFA Rules not processed for user `506273d8191c4421b91ae36204445f33`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:32.508578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-57a69e94-9676-4b6d-95a1-c5c5be090ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:32.584168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-acadcbf2-5cb6-46a4-8dc1-9631c95fa6a4 None None] MFA Rules not processed for user `3caa3dbc7bd24ebba28296a1eba9cefe`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:32.588205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-acadcbf2-5cb6-46a4-8dc1-9631c95fa6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:32.708908 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 823/1640] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:32.747378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a69e94-9676-4b6d-95a1-c5c5be090ace None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:32.824300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 818/1641] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:32.886686 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a69e94-9676-4b6d-95a1-c5c5be090ace None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:32.890598 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765e092-82a8-435c-9232-04df5a020c24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:32.891285 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765e092-82a8-435c-9232-04df5a020c24 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:32.891573 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765e092-82a8-435c-9232-04df5a020c24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:32.891849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765e092-82a8-435c-9232-04df5a020c24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:32.903156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765e092-82a8-435c-9232-04df5a020c24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:32.904892 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765e092-82a8-435c-9232-04df5a020c24 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:32.936119 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 824/1642] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:33.002343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadcbf2-5cb6-46a4-8dc1-9631c95fa6a4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:33.019117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadcbf2-5cb6-46a4-8dc1-9631c95fa6a4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:33.024290 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ecfc2-6979-43db-b476-b1fab74bd12c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:33.025038 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ecfc2-6979-43db-b476-b1fab74bd12c service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:33.025477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ecfc2-6979-43db-b476-b1fab74bd12c service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:33.025771 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ecfc2-6979-43db-b476-b1fab74bd12c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:33.037091 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:33.042682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ecfc2-6979-43db-b476-b1fab74bd12c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:33.044662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ecfc2-6979-43db-b476-b1fab74bd12c service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:33.073144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 819/1643] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:34:33.338599 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765e092-82a8-435c-9232-04df5a020c24 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:33.353448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765e092-82a8-435c-9232-04df5a020c24 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:33.375661 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b7320-a2c3-4f4e-a2a1-bc37fa9406cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:33.376918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b7320-a2c3-4f4e-a2a1-bc37fa9406cd service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:33.377294 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b7320-a2c3-4f4e-a2a1-bc37fa9406cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:33.377628 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b7320-a2c3-4f4e-a2a1-bc37fa9406cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:33.420419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:33.525222 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b7320-a2c3-4f4e-a2a1-bc37fa9406cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:33.526937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b7320-a2c3-4f4e-a2a1-bc37fa9406cd service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:33.547130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 825/1644] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:34.201495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ae17f-8a4c-45cd-b6e5-16f9b5dc2032 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:34.202088 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ae17f-8a4c-45cd-b6e5-16f9b5dc2032 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:34.202088 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ae17f-8a4c-45cd-b6e5-16f9b5dc2032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:34.261229 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f46ae17f-8a4c-45cd-b6e5-16f9b5dc2032 None None] MFA Rules not processed for user `a6b94a5619864811a22bdf949e56ee77`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:34.262497 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f46ae17f-8a4c-45cd-b6e5-16f9b5dc2032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:34.423027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b7320-a2c3-4f4e-a2a1-bc37fa9406cd service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:34.452207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 820/1645] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:34.466841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed9103-e4ad-4426-ba25-87be8fd6debb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:34.469100 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed9103-e4ad-4426-ba25-87be8fd6debb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:34.469621 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed9103-e4ad-4426-ba25-87be8fd6debb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:34.503647 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-28ed9103-e4ad-4426-ba25-87be8fd6debb None None] MFA Rules not processed for user `a6b94a5619864811a22bdf949e56ee77`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:34.505316 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-28ed9103-e4ad-4426-ba25-87be8fd6debb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:34.517083 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 821/1646] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:34.528925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed9103-e4ad-4426-ba25-87be8fd6debb None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:34.567965 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed9103-e4ad-4426-ba25-87be8fd6debb None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:34.598474 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad1db7-54ce-4ccc-989d-58eab1d977cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:34.601176 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad1db7-54ce-4ccc-989d-58eab1d977cc service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:34.602462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad1db7-54ce-4ccc-989d-58eab1d977cc service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:34.604766 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad1db7-54ce-4ccc-989d-58eab1d977cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:34.622641 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad1db7-54ce-4ccc-989d-58eab1d977cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:34.624856 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad1db7-54ce-4ccc-989d-58eab1d977cc service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:34.628433 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b7320-a2c3-4f4e-a2a1-bc37fa9406cd service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:34.642066 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3569baa-a305-45a5-9949-56f10f232ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:34.642982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3569baa-a305-45a5-9949-56f10f232ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:34.643268 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3569baa-a305-45a5-9949-56f10f232ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:34.643544 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3569baa-a305-45a5-9949-56f10f232ee9 admin admin] PATH_INFO: `/v3/users/0fff15ee13a54a80828afa5fcc61eef0` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:34.646404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3569baa-a305-45a5-9949-56f10f232ee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fff15ee13a54a80828afa5fcc61eef0)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:34.651940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3569baa-a305-45a5-9949-56f10f232ee9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:34.655172 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 822/1647] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:34:34.801136 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a3569baa-a305-45a5-9949-56f10f232ee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fff15ee13a54a80828afa5fcc61eef0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:34.803293 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a3569baa-a305-45a5-9949-56f10f232ee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fff15ee13a54a80828afa5fcc61eef0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:34.805204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a3569baa-a305-45a5-9949-56f10f232ee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fff15ee13a54a80828afa5fcc61eef0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:34.850671 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a3569baa-a305-45a5-9949-56f10f232ee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fff15ee13a54a80828afa5fcc61eef0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:34.863759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a3569baa-a305-45a5-9949-56f10f232ee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fff15ee13a54a80828afa5fcc61eef0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:34.922558 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 826/1648] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:34:34 2022] DELETE /identity/v3/users/0fff15ee13a54a80828afa5fcc61eef0 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:34:34.926746 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e57a3b-da3e-4c79-9717-e6d26036b899 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:34.927260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e57a3b-da3e-4c79-9717-e6d26036b899 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:34.929921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e57a3b-da3e-4c79-9717-e6d26036b899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:34.975316 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-31e57a3b-da3e-4c79-9717-e6d26036b899 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:34.977267 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-31e57a3b-da3e-4c79-9717-e6d26036b899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:35.263879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 823/1649] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:35.279614 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3569baa-a305-45a5-9949-56f10f232ee9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:35.281150 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a3569baa-a305-45a5-9949-56f10f232ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:35.379353 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:35.458563 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3569baa-a305-45a5-9949-56f10f232ee9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:35.480850 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb106c0-a390-42cd-b467-170a6ebe9566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:35.481913 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb106c0-a390-42cd-b467-170a6ebe9566 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:35.482106 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb106c0-a390-42cd-b467-170a6ebe9566 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:35.482387 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb106c0-a390-42cd-b467-170a6ebe9566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:35.497044 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb106c0-a390-42cd-b467-170a6ebe9566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:35.498533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb106c0-a390-42cd-b467-170a6ebe9566 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:35.530859 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eb8e5-8922-4035-8495-60ff0cfe6d25 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:35.531091 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eb8e5-8922-4035-8495-60ff0cfe6d25 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:35.531332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eb8e5-8922-4035-8495-60ff0cfe6d25 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:35.532263 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 827/1650] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:35.533818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 824/1651] 10.222.0.41 () {54 vars in 912 bytes} [Fri May 27 16:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:34:35.540097 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ac293-8665-4112-8670-c6bad28b125d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:35.540391 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ac293-8665-4112-8670-c6bad28b125d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:35.540675 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ac293-8665-4112-8670-c6bad28b125d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:35.634695 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d20ac293-8665-4112-8670-c6bad28b125d None None] MFA Rules not processed for user `6f3fe9e871b34a8faed94550e27fefd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:35.641322 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d20ac293-8665-4112-8670-c6bad28b125d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:35.671476 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 828/1652] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 16:34:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:34:35.685969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989eb8e5-8922-4035-8495-60ff0cfe6d25 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:35.704664 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989eb8e5-8922-4035-8495-60ff0cfe6d25 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:35.712241 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e637123-0511-42e5-ac82-cc9e8ba2d638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:35.713231 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e637123-0511-42e5-ac82-cc9e8ba2d638 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:35.713231 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e637123-0511-42e5-ac82-cc9e8ba2d638 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:35.714518 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e637123-0511-42e5-ac82-cc9e8ba2d638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:35.736741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e637123-0511-42e5-ac82-cc9e8ba2d638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:35.740412 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e637123-0511-42e5-ac82-cc9e8ba2d638 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:35.760743 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 825/1653] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:36.122375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ac293-8665-4112-8670-c6bad28b125d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:36.125597 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d20ac293-8665-4112-8670-c6bad28b125d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:36.169548 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ac293-8665-4112-8670-c6bad28b125d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:36.181520 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aef259-55dd-4ee2-b6c1-a0ddcb5f9e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:36.182849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aef259-55dd-4ee2-b6c1-a0ddcb5f9e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:36.183376 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aef259-55dd-4ee2-b6c1-a0ddcb5f9e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:36.184510 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aef259-55dd-4ee2-b6c1-a0ddcb5f9e3f admin admin] PATH_INFO: `/v3/users/c9c685cf34a1491b9d5aeebe47f2fe18` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:36.186277 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aef259-55dd-4ee2-b6c1-a0ddcb5f9e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9c685cf34a1491b9d5aeebe47f2fe18)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:36.189689 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aef259-55dd-4ee2-b6c1-a0ddcb5f9e3f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:36.349353 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-19aef259-55dd-4ee2-b6c1-a0ddcb5f9e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9c685cf34a1491b9d5aeebe47f2fe18'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:36.351137 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-19aef259-55dd-4ee2-b6c1-a0ddcb5f9e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9c685cf34a1491b9d5aeebe47f2fe18'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:36.355159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-19aef259-55dd-4ee2-b6c1-a0ddcb5f9e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9c685cf34a1491b9d5aeebe47f2fe18'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:36.394106 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-19aef259-55dd-4ee2-b6c1-a0ddcb5f9e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9c685cf34a1491b9d5aeebe47f2fe18'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:36.433355 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-19aef259-55dd-4ee2-b6c1-a0ddcb5f9e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9c685cf34a1491b9d5aeebe47f2fe18'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:36.499917 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5ec95-4831-4deb-9b24-967904467d5e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:36.500426 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5ec95-4831-4deb-9b24-967904467d5e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:36.500495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5ec95-4831-4deb-9b24-967904467d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:36.501923 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 829/1654] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:34:36 2022] DELETE /identity/v3/users/c9c685cf34a1491b9d5aeebe47f2fe18 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:36.548434 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-cde5ec95-4831-4deb-9b24-967904467d5e None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:36.551825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cde5ec95-4831-4deb-9b24-967904467d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:36.650535 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:36.680450 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 826/1655] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:36.707313 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aef259-55dd-4ee2-b6c1-a0ddcb5f9e3f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:36.708946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-19aef259-55dd-4ee2-b6c1-a0ddcb5f9e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:36.843490 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aef259-55dd-4ee2-b6c1-a0ddcb5f9e3f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:36.851995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1602e09a-9ff9-46d9-a8fc-7762e0600a1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:36.853309 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602e09a-9ff9-46d9-a8fc-7762e0600a1d service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:36.853603 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602e09a-9ff9-46d9-a8fc-7762e0600a1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:36.853885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602e09a-9ff9-46d9-a8fc-7762e0600a1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:36.875912 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602e09a-9ff9-46d9-a8fc-7762e0600a1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:36.877969 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1602e09a-9ff9-46d9-a8fc-7762e0600a1d service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:36.903849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 830/1656] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:37.343638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640e233-f541-4a02-ae19-d190c0216593 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:37.343908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640e233-f541-4a02-ae19-d190c0216593 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:37.344351 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640e233-f541-4a02-ae19-d190c0216593 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:37.346272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 827/1657] 10.222.0.41 () {54 vars in 960 bytes} [Fri May 27 16:34:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:34:37.353686 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecec113-519b-4a1b-83c5-4861bb23c508 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:37.354344 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecec113-519b-4a1b-83c5-4861bb23c508 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:37.354845 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecec113-519b-4a1b-83c5-4861bb23c508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:37.412749 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9ecec113-519b-4a1b-83c5-4861bb23c508 None None] MFA Rules not processed for user `1266a87d93da4f8d9a1ccafa03067169`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:37.415778 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9ecec113-519b-4a1b-83c5-4861bb23c508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:37.588695 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640e233-f541-4a02-ae19-d190c0216593 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:37.591196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d640e233-f541-4a02-ae19-d190c0216593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:37.619880 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640e233-f541-4a02-ae19-d190c0216593 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:37.637400 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b2b54-bac9-4051-9acc-a44d6e25edb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:37.641064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b2b54-bac9-4051-9acc-a44d6e25edb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:37.642904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b2b54-bac9-4051-9acc-a44d6e25edb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:37.643408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b2b54-bac9-4051-9acc-a44d6e25edb8 admin admin] PATH_INFO: `/v3/projects/2d9c9b9228ce4327a0bc66ef2a7ae570` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:37.650461 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b2b54-bac9-4051-9acc-a44d6e25edb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d9c9b9228ce4327a0bc66ef2a7ae570)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:37.654300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b2b54-bac9-4051-9acc-a44d6e25edb8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:37.669184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:37.808151 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 831/1658] 10.222.0.41 () {58 vars in 1057 bytes} [Fri May 27 16:34:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 27 16:34:37.815572 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecec113-519b-4a1b-83c5-4861bb23c508 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:37.852803 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecec113-519b-4a1b-83c5-4861bb23c508 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:37.888372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ad9b2b54-bac9-4051-9acc-a44d6e25edb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d9c9b9228ce4327a0bc66ef2a7ae570', 'request_id': 'req-ad9b2b54-bac9-4051-9acc-a44d6e25edb8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:37.898099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ad9b2b54-bac9-4051-9acc-a44d6e25edb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d9c9b9228ce4327a0bc66ef2a7ae570', 'request_id': 'req-ad9b2b54-bac9-4051-9acc-a44d6e25edb8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:37.946429 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ad9b2b54-bac9-4051-9acc-a44d6e25edb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d9c9b9228ce4327a0bc66ef2a7ae570', 'request_id': 'req-ad9b2b54-bac9-4051-9acc-a44d6e25edb8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:37.986360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ad9b2b54-bac9-4051-9acc-a44d6e25edb8 admin admin] The token cache is being invalidate because project 2d9c9b9228ce4327a0bc66ef2a7ae570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:34:37.988103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ad9b2b54-bac9-4051-9acc-a44d6e25edb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:37.989393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ad9b2b54-bac9-4051-9acc-a44d6e25edb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:37.991763 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 828/1659] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:34:37 2022] DELETE /identity/v3/projects/2d9c9b9228ce4327a0bc66ef2a7ae570 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:34:38.001676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b2b54-bac9-4051-9acc-a44d6e25edb8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:38.003815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ad9b2b54-bac9-4051-9acc-a44d6e25edb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:38.077274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f1997-2814-47df-b879-1c96e813997f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1266a87d93da4f8d9a1ccafa03067169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:38.078856 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f1997-2814-47df-b879-1c96e813997f service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:38.079985 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f1997-2814-47df-b879-1c96e813997f service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:38.080763 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f1997-2814-47df-b879-1c96e813997f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:38.083321 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2a6f1997-2814-47df-b879-1c96e813997f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:38.120445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b2b54-bac9-4051-9acc-a44d6e25edb8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:38.129074 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d52dc-58aa-42d4-b1f9-abd543bd233e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:38.130737 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d52dc-58aa-42d4-b1f9-abd543bd233e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:38.131264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d52dc-58aa-42d4-b1f9-abd543bd233e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:38.131626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d52dc-58aa-42d4-b1f9-abd543bd233e admin admin] PATH_INFO: `/v3/users/1c334459a7754c8884d405496c1085a4` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:38.143336 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d52dc-58aa-42d4-b1f9-abd543bd233e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c334459a7754c8884d405496c1085a4)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:38.144089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: WARNING py.warnings [None req-543d52dc-58aa-42d4-b1f9-abd543bd233e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:34:38.144089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: warnings.warn(msg) May 27 16:34:38.144089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: May 27 16:34:38.145674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d52dc-58aa-42d4-b1f9-abd543bd233e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:38.150828 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f1997-2814-47df-b879-1c96e813997f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:38.154717 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f1997-2814-47df-b879-1c96e813997f service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:38.182001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 832/1660] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:38.269714 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-543d52dc-58aa-42d4-b1f9-abd543bd233e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c334459a7754c8884d405496c1085a4'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:38.288860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-543d52dc-58aa-42d4-b1f9-abd543bd233e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c334459a7754c8884d405496c1085a4'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:38.349238 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-543d52dc-58aa-42d4-b1f9-abd543bd233e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c334459a7754c8884d405496c1085a4'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:38.371541 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:38.374008 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-543d52dc-58aa-42d4-b1f9-abd543bd233e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c334459a7754c8884d405496c1085a4'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:38.374935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-543d52dc-58aa-42d4-b1f9-abd543bd233e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c334459a7754c8884d405496c1085a4'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:38.405130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 829/1661] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:34:38 2022] DELETE /identity/v3/users/1c334459a7754c8884d405496c1085a4 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:38.850319 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f1997-2814-47df-b879-1c96e813997f service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:38.852653 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2a6f1997-2814-47df-b879-1c96e813997f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:38.879256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f1997-2814-47df-b879-1c96e813997f service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:39.106335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f56c3f-a99e-4e6f-8928-75f54bdfd851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:39.107505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f56c3f-a99e-4e6f-8928-75f54bdfd851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:39.107945 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f56c3f-a99e-4e6f-8928-75f54bdfd851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:39.108403 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f56c3f-a99e-4e6f-8928-75f54bdfd851 admin admin] PATH_INFO: `/v3/projects/6252ceeeb99d4ff394e18b30c3029a1d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:39.119603 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f56c3f-a99e-4e6f-8928-75f54bdfd851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6252ceeeb99d4ff394e18b30c3029a1d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:39.121150 dv-cinder-835553-1-smb devstack@keystone.service[80264]: WARNING py.warnings [None req-d9f56c3f-a99e-4e6f-8928-75f54bdfd851 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 16:34:39.121150 dv-cinder-835553-1-smb devstack@keystone.service[80264]: warnings.warn(msg) May 27 16:34:39.121150 dv-cinder-835553-1-smb devstack@keystone.service[80264]: May 27 16:34:39.122965 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f56c3f-a99e-4e6f-8928-75f54bdfd851 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:39.313932 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d9f56c3f-a99e-4e6f-8928-75f54bdfd851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6252ceeeb99d4ff394e18b30c3029a1d', 'request_id': 'req-d9f56c3f-a99e-4e6f-8928-75f54bdfd851'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:39.348408 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d9f56c3f-a99e-4e6f-8928-75f54bdfd851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6252ceeeb99d4ff394e18b30c3029a1d', 'request_id': 'req-d9f56c3f-a99e-4e6f-8928-75f54bdfd851'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:39.406672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d9f56c3f-a99e-4e6f-8928-75f54bdfd851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6252ceeeb99d4ff394e18b30c3029a1d', 'request_id': 'req-d9f56c3f-a99e-4e6f-8928-75f54bdfd851'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:39.412139 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:39.446561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d9f56c3f-a99e-4e6f-8928-75f54bdfd851 admin admin] The token cache is being invalidate because project 6252ceeeb99d4ff394e18b30c3029a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:34:39.447823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d9f56c3f-a99e-4e6f-8928-75f54bdfd851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:39.449233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d9f56c3f-a99e-4e6f-8928-75f54bdfd851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:39.451592 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 833/1662] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:34:38 2022] DELETE /identity/v3/projects/6252ceeeb99d4ff394e18b30c3029a1d => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:39.457508 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b64cb-cf23-4319-97e3-92935ab264e8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:39.458069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b64cb-cf23-4319-97e3-92935ab264e8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:39.458069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b64cb-cf23-4319-97e3-92935ab264e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:39.500367 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-237b64cb-cf23-4319-97e3-92935ab264e8 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:39.501822 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-237b64cb-cf23-4319-97e3-92935ab264e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:39.688677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 830/1663] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:39.702062 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca167fe-1be3-4eb3-a370-0780c2186580 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:39.702521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca167fe-1be3-4eb3-a370-0780c2186580 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:39.704527 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca167fe-1be3-4eb3-a370-0780c2186580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:39.755371 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0ca167fe-1be3-4eb3-a370-0780c2186580 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:39.756718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0ca167fe-1be3-4eb3-a370-0780c2186580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:39.776145 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 834/1664] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:39.777547 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b64cb-cf23-4319-97e3-92935ab264e8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:39.794955 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b64cb-cf23-4319-97e3-92935ab264e8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:39.802059 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bb216-d03d-4dcb-a4e2-0f627ffa7fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:39.802990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bb216-d03d-4dcb-a4e2-0f627ffa7fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:39.803463 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bb216-d03d-4dcb-a4e2-0f627ffa7fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:39.803906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bb216-d03d-4dcb-a4e2-0f627ffa7fd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:39.804899 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52bb216-d03d-4dcb-a4e2-0f627ffa7fd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:34:39.805574 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52bb216-d03d-4dcb-a4e2-0f627ffa7fd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:39.807724 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52bb216-d03d-4dcb-a4e2-0f627ffa7fd1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:39.847767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 831/1665] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:34:39.852986 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca167fe-1be3-4eb3-a370-0780c2186580 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:39.874310 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca167fe-1be3-4eb3-a370-0780c2186580 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:39.880557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2243881-b5d8-4fae-aa9d-b7b8a3c469a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:39.881826 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2243881-b5d8-4fae-aa9d-b7b8a3c469a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:39.883569 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2243881-b5d8-4fae-aa9d-b7b8a3c469a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:39.885091 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2243881-b5d8-4fae-aa9d-b7b8a3c469a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:39.886686 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2243881-b5d8-4fae-aa9d-b7b8a3c469a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:39.894069 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2243881-b5d8-4fae-aa9d-b7b8a3c469a8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:39.969473 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 835/1666] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:34:39 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:39.974821 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bb216-d03d-4dcb-a4e2-0f627ffa7fd1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:39.992485 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bb216-d03d-4dcb-a4e2-0f627ffa7fd1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:40.204055 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a26887-d1fb-4a52-9043-14c6c5b8c5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:40.204915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26887-d1fb-4a52-9043-14c6c5b8c5bf admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:40.205310 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26887-d1fb-4a52-9043-14c6c5b8c5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:40.205686 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26887-d1fb-4a52-9043-14c6c5b8c5bf admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:40.207023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a26887-d1fb-4a52-9043-14c6c5b8c5bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:40.223659 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a26887-d1fb-4a52-9043-14c6c5b8c5bf admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:40.300749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 832/1667] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:34:39 2022] POST /identity/v3/users => generated 288 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:40.301237 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2243881-b5d8-4fae-aa9d-b7b8a3c469a8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:40.323788 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2243881-b5d8-4fae-aa9d-b7b8a3c469a8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:40.350123 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f8b65-e089-48f4-83db-329a30a9ff8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:40.353902 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f8b65-e089-48f4-83db-329a30a9ff8b admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:40.355406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f8b65-e089-48f4-83db-329a30a9ff8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:40.355834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f8b65-e089-48f4-83db-329a30a9ff8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:40.361887 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f8b65-e089-48f4-83db-329a30a9ff8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:40.364083 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f8b65-e089-48f4-83db-329a30a9ff8b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:40.384070 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 836/1668] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:34:40.388215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a26887-d1fb-4a52-9043-14c6c5b8c5bf admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:40.404988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a26887-d1fb-4a52-9043-14c6c5b8c5bf admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:40.418105 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f9152-1488-44d9-b865-d3b4e53117bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:40.419443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f9152-1488-44d9-b865-d3b4e53117bd admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:40.419651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f9152-1488-44d9-b865-d3b4e53117bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:40.420293 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f9152-1488-44d9-b865-d3b4e53117bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:40.421247 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f9152-1488-44d9-b865-d3b4e53117bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:40.429474 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f9152-1488-44d9-b865-d3b4e53117bd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:40.467261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 833/1669] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:40.471979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f8b65-e089-48f4-83db-329a30a9ff8b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:40.486569 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f8b65-e089-48f4-83db-329a30a9ff8b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:40.498394 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ab08f-41a8-4b5d-97c2-8f955f1a672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:40.499618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ab08f-41a8-4b5d-97c2-8f955f1a672c admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:40.499975 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ab08f-41a8-4b5d-97c2-8f955f1a672c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:40.500356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ab08f-41a8-4b5d-97c2-8f955f1a672c admin admin] PATH_INFO: `/v3/projects/e1ab1ffed0fd45d88dd93f4dc35f1388/users/4e362778126b439b92569fa16b5d030e/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:40.538206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ab08f-41a8-4b5d-97c2-8f955f1a672c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ab1ffed0fd45d88dd93f4dc35f1388, user_id=4e362778126b439b92569fa16b5d030e, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:40.541914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ab08f-41a8-4b5d-97c2-8f955f1a672c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:40.591796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 837/1670] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:40 2022] PUT /identity/v3/projects/e1ab1ffed0fd45d88dd93f4dc35f1388/users/4e362778126b439b92569fa16b5d030e/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:34:40.604558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f81378-1155-490d-b845-472416c6814a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:40.606752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f81378-1155-490d-b845-472416c6814a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:40.608747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f81378-1155-490d-b845-472416c6814a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:40.690048 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-27f81378-1155-490d-b845-472416c6814a None None] MFA Rules not processed for user `4e362778126b439b92569fa16b5d030e`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:40.691568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-27f81378-1155-490d-b845-472416c6814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:40.883888 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:40.884892 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ab08f-41a8-4b5d-97c2-8f955f1a672c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:40.888191 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ef1ab08f-41a8-4b5d-97c2-8f955f1a672c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:40.919029 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 834/1671] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:40.920836 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f81378-1155-490d-b845-472416c6814a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:40.922944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-27f81378-1155-490d-b845-472416c6814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:41.029779 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ab08f-41a8-4b5d-97c2-8f955f1a672c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:41.056569 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe67bb-e9a2-4d1d-81ca-a5acc15614c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:41.058034 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe67bb-e9a2-4d1d-81ca-a5acc15614c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:41.058477 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe67bb-e9a2-4d1d-81ca-a5acc15614c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:41.059025 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe67bb-e9a2-4d1d-81ca-a5acc15614c9 admin admin] PATH_INFO: `/v3/users/61a66001e3aa4780adae5ffe693b1832` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:41.064486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe67bb-e9a2-4d1d-81ca-a5acc15614c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a66001e3aa4780adae5ffe693b1832)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:41.066963 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe67bb-e9a2-4d1d-81ca-a5acc15614c9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:41.128877 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f81378-1155-490d-b845-472416c6814a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:41.145802 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a452ff6-1bfb-4f41-94fa-b8058d351df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:41.149643 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a452ff6-1bfb-4f41-94fa-b8058d351df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:41.152410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a452ff6-1bfb-4f41-94fa-b8058d351df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:41.153084 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a452ff6-1bfb-4f41-94fa-b8058d351df1 admin admin] PATH_INFO: `/v3/projects/88a2f886407e4fe29aab58f2765e5c48` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:41.158072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a452ff6-1bfb-4f41-94fa-b8058d351df1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a2f886407e4fe29aab58f2765e5c48)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:41.162918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a452ff6-1bfb-4f41-94fa-b8058d351df1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:41.181230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8dfe67bb-e9a2-4d1d-81ca-a5acc15614c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a66001e3aa4780adae5ffe693b1832'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:41.183503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8dfe67bb-e9a2-4d1d-81ca-a5acc15614c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a66001e3aa4780adae5ffe693b1832'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:41.184207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8dfe67bb-e9a2-4d1d-81ca-a5acc15614c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a66001e3aa4780adae5ffe693b1832'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:41.224146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8dfe67bb-e9a2-4d1d-81ca-a5acc15614c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a66001e3aa4780adae5ffe693b1832'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:41.250293 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8dfe67bb-e9a2-4d1d-81ca-a5acc15614c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a66001e3aa4780adae5ffe693b1832'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:41.277725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2a452ff6-1bfb-4f41-94fa-b8058d351df1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a2f886407e4fe29aab58f2765e5c48', 'request_id': 'req-2a452ff6-1bfb-4f41-94fa-b8058d351df1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:41.293660 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 838/1672] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:34:40 2022] DELETE /identity/v3/users/61a66001e3aa4780adae5ffe693b1832 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:34:41.295755 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe67bb-e9a2-4d1d-81ca-a5acc15614c9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:41.299175 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8dfe67bb-e9a2-4d1d-81ca-a5acc15614c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:41.308870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2a452ff6-1bfb-4f41-94fa-b8058d351df1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a2f886407e4fe29aab58f2765e5c48', 'request_id': 'req-2a452ff6-1bfb-4f41-94fa-b8058d351df1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:41.313752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:41.334435 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2a452ff6-1bfb-4f41-94fa-b8058d351df1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a2f886407e4fe29aab58f2765e5c48', 'request_id': 'req-2a452ff6-1bfb-4f41-94fa-b8058d351df1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:41.371980 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2a452ff6-1bfb-4f41-94fa-b8058d351df1 admin admin] The token cache is being invalidate because project 88a2f886407e4fe29aab58f2765e5c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:34:41.372345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2a452ff6-1bfb-4f41-94fa-b8058d351df1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:41.372970 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2a452ff6-1bfb-4f41-94fa-b8058d351df1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:41.376888 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 835/1673] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:34:40 2022] DELETE /identity/v3/projects/88a2f886407e4fe29aab58f2765e5c48 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:41.378473 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13f8df-b6ea-445b-82c4-c698cc4626c5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:41.382228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13f8df-b6ea-445b-82c4-c698cc4626c5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:41.382566 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13f8df-b6ea-445b-82c4-c698cc4626c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:41.431942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-5c13f8df-b6ea-445b-82c4-c698cc4626c5 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:41.433172 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5c13f8df-b6ea-445b-82c4-c698cc4626c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:41.548279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe67bb-e9a2-4d1d-81ca-a5acc15614c9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:41.562466 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad8367-f0ef-4c10-8c6c-0c17b5ae30f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:41.563157 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad8367-f0ef-4c10-8c6c-0c17b5ae30f6 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:41.563446 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad8367-f0ef-4c10-8c6c-0c17b5ae30f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:41.566821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad8367-f0ef-4c10-8c6c-0c17b5ae30f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:41.572568 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f0ad8367-f0ef-4c10-8c6c-0c17b5ae30f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:41.621474 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 836/1674] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:41.625038 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58598ee6-d608-4b12-9e5f-42b40a5dd395 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:41.625487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58598ee6-d608-4b12-9e5f-42b40a5dd395 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:41.625770 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58598ee6-d608-4b12-9e5f-42b40a5dd395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:41.666931 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-58598ee6-d608-4b12-9e5f-42b40a5dd395 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:41.668750 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-58598ee6-d608-4b12-9e5f-42b40a5dd395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:41.678434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad8367-f0ef-4c10-8c6c-0c17b5ae30f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:41.681066 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad8367-f0ef-4c10-8c6c-0c17b5ae30f6 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:41.694306 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 839/1675] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:41.694570 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 837/1676] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:41.709885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da907ac0-86e2-480c-ba99-c148bcbae653 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:41.710327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da907ac0-86e2-480c-ba99-c148bcbae653 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:41.710638 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da907ac0-86e2-480c-ba99-c148bcbae653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:41.769524 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-da907ac0-86e2-480c-ba99-c148bcbae653 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:41.794908 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-da907ac0-86e2-480c-ba99-c148bcbae653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:41.828466 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 840/1677] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:41.829320 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58598ee6-d608-4b12-9e5f-42b40a5dd395 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:41.843780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58598ee6-d608-4b12-9e5f-42b40a5dd395 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:41.860296 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b689dc-ef7e-434f-902b-bbaf109bfd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:41.860996 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b689dc-ef7e-434f-902b-bbaf109bfd70 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:41.861277 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b689dc-ef7e-434f-902b-bbaf109bfd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:41.861570 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b689dc-ef7e-434f-902b-bbaf109bfd70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:41.862573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b689dc-ef7e-434f-902b-bbaf109bfd70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:34:41.862966 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b689dc-ef7e-434f-902b-bbaf109bfd70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:41.865335 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b689dc-ef7e-434f-902b-bbaf109bfd70 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:41.898577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da907ac0-86e2-480c-ba99-c148bcbae653 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:41.901026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-da907ac0-86e2-480c-ba99-c148bcbae653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:41.908130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 838/1678] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:34:41.919806 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaa5d5-65e7-465b-9620-ade866977de5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:41.919806 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaa5d5-65e7-465b-9620-ade866977de5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:41.919806 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaa5d5-65e7-465b-9620-ade866977de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:41.937485 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:42.007496 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8aaaa5d5-65e7-465b-9620-ade866977de5 None None] MFA Rules not processed for user `2ccee0bc7e2b41f4a2fe2a891a95b318`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:42.008517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8aaaa5d5-65e7-465b-9620-ade866977de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:42.166371 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 839/1679] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 16:34:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:42.168931 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaa5d5-65e7-465b-9620-ade866977de5 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:42.213539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaa5d5-65e7-465b-9620-ade866977de5 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:42.244836 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb994aa-a6c1-4e96-90e8-79022ac0e9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:42.252289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb994aa-a6c1-4e96-90e8-79022ac0e9fa admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:42.252621 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb994aa-a6c1-4e96-90e8-79022ac0e9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:42.252857 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb994aa-a6c1-4e96-90e8-79022ac0e9fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:42.254225 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb994aa-a6c1-4e96-90e8-79022ac0e9fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:42.260134 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb994aa-a6c1-4e96-90e8-79022ac0e9fa admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:42.367314 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 840/1680] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:34:42 2022] POST /identity/v3/projects => generated 375 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:42.369006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20b09c-0778-4d77-bef9-901010d3c529 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:42.370755 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20b09c-0778-4d77-bef9-901010d3c529 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:42.370755 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe20b09c-0778-4d77-bef9-901010d3c529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:42.436886 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-fe20b09c-0778-4d77-bef9-901010d3c529 None None] MFA Rules not processed for user `2ecad16f09f54327b78aab5b06f9872a`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:42.440544 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fe20b09c-0778-4d77-bef9-901010d3c529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:42.571389 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 841/1681] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:42.576163 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20b09c-0778-4d77-bef9-901010d3c529 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:42.578497 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fe20b09c-0778-4d77-bef9-901010d3c529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:42.592760 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da907ac0-86e2-480c-ba99-c148bcbae653 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:42.711284 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b190b9-5fd5-489c-977c-842a6a313c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:42.712206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b190b9-5fd5-489c-977c-842a6a313c34 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:42.712889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b190b9-5fd5-489c-977c-842a6a313c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:42.713331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b190b9-5fd5-489c-977c-842a6a313c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:42.719271 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:42.785415 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe20b09c-0778-4d77-bef9-901010d3c529 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:42.795959 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b190b9-5fd5-489c-977c-842a6a313c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:42.797696 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b190b9-5fd5-489c-977c-842a6a313c34 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:42.801137 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1d285-dedb-4ea3-a06a-668330a5797d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:42.802696 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1d285-dedb-4ea3-a06a-668330a5797d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:42.803184 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1d285-dedb-4ea3-a06a-668330a5797d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:42.803683 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1d285-dedb-4ea3-a06a-668330a5797d admin admin] PATH_INFO: `/v3/users/4e362778126b439b92569fa16b5d030e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:42.810918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 841/1682] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 914 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:42.812182 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b190b9-5fd5-489c-977c-842a6a313c34 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:42.814312 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1d285-dedb-4ea3-a06a-668330a5797d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e362778126b439b92569fa16b5d030e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:42.818242 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1d285-dedb-4ea3-a06a-668330a5797d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:42.825725 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b190b9-5fd5-489c-977c-842a6a313c34 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:42.831190 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da272d89-8b74-45b8-a76d-7fd68cd5efab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:42.832312 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da272d89-8b74-45b8-a76d-7fd68cd5efab admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:42.832887 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da272d89-8b74-45b8-a76d-7fd68cd5efab admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:42.833338 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da272d89-8b74-45b8-a76d-7fd68cd5efab admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:42.834842 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da272d89-8b74-45b8-a76d-7fd68cd5efab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:42.837581 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da272d89-8b74-45b8-a76d-7fd68cd5efab admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:42.869727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 842/1683] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:34:42 2022] POST /identity/v3/users => generated 288 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:42.871151 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da272d89-8b74-45b8-a76d-7fd68cd5efab admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:42.873889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-da272d89-8b74-45b8-a76d-7fd68cd5efab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:42.888800 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da272d89-8b74-45b8-a76d-7fd68cd5efab admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:42.892313 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:42.896195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca2d9f-5606-42a2-b10f-4fa699c1f45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:42.897855 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca2d9f-5606-42a2-b10f-4fa699c1f45a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:42.898314 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca2d9f-5606-42a2-b10f-4fa699c1f45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:42.898738 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca2d9f-5606-42a2-b10f-4fa699c1f45a admin admin] PATH_INFO: `/v3/users/9d0d70db4a5d449289b340dd5c5ffaf5` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:42.902181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca2d9f-5606-42a2-b10f-4fa699c1f45a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0d70db4a5d449289b340dd5c5ffaf5)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:42.905179 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca2d9f-5606-42a2-b10f-4fa699c1f45a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:42.971592 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3fb1d285-dedb-4ea3-a06a-668330a5797d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e362778126b439b92569fa16b5d030e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:42.989571 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3fb1d285-dedb-4ea3-a06a-668330a5797d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e362778126b439b92569fa16b5d030e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:43.007535 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-41ca2d9f-5606-42a2-b10f-4fa699c1f45a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0d70db4a5d449289b340dd5c5ffaf5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:43.008495 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-41ca2d9f-5606-42a2-b10f-4fa699c1f45a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0d70db4a5d449289b340dd5c5ffaf5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:43.009155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-41ca2d9f-5606-42a2-b10f-4fa699c1f45a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0d70db4a5d449289b340dd5c5ffaf5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:43.016698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3fb1d285-dedb-4ea3-a06a-668330a5797d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e362778126b439b92569fa16b5d030e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:43.031563 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-41ca2d9f-5606-42a2-b10f-4fa699c1f45a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0d70db4a5d449289b340dd5c5ffaf5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:43.034889 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3fb1d285-dedb-4ea3-a06a-668330a5797d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e362778126b439b92569fa16b5d030e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:43.037374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3fb1d285-dedb-4ea3-a06a-668330a5797d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e362778126b439b92569fa16b5d030e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:43.043178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-41ca2d9f-5606-42a2-b10f-4fa699c1f45a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0d70db4a5d449289b340dd5c5ffaf5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:43.057284 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 842/1684] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:34:42 2022] DELETE /identity/v3/users/4e362778126b439b92569fa16b5d030e => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:43.064708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1d285-dedb-4ea3-a06a-668330a5797d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:43.069063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3fb1d285-dedb-4ea3-a06a-668330a5797d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:43.073055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 843/1685] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:34:42 2022] DELETE /identity/v3/users/9d0d70db4a5d449289b340dd5c5ffaf5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:43.074442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca2d9f-5606-42a2-b10f-4fa699c1f45a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:43.077176 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-41ca2d9f-5606-42a2-b10f-4fa699c1f45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:43.184345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:43.208925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1d285-dedb-4ea3-a06a-668330a5797d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:43.212439 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca2d9f-5606-42a2-b10f-4fa699c1f45a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:43.222015 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ead54a-86fb-40b9-95bb-ff39dcaa980c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:43.222985 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ead54a-86fb-40b9-95bb-ff39dcaa980c service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:43.223586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ead54a-86fb-40b9-95bb-ff39dcaa980c service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:43.224151 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ead54a-86fb-40b9-95bb-ff39dcaa980c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:43.227642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-54ead54a-86fb-40b9-95bb-ff39dcaa980c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:43.311489 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f53b2-d648-4441-8e6f-e4eb449c66d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbfcca96ad754692b3fb7f891013dafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:43.312593 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f53b2-d648-4441-8e6f-e4eb449c66d8 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:43.312886 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f53b2-d648-4441-8e6f-e4eb449c66d8 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:43.313164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f53b2-d648-4441-8e6f-e4eb449c66d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:43.315665 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7a7f53b2-d648-4441-8e6f-e4eb449c66d8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:43.340748 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ead54a-86fb-40b9-95bb-ff39dcaa980c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:43.345423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ead54a-86fb-40b9-95bb-ff39dcaa980c service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:43.362405 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 844/1686] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:43.364289 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ead54a-86fb-40b9-95bb-ff39dcaa980c service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:43.366435 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-54ead54a-86fb-40b9-95bb-ff39dcaa980c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:43.386537 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:43.421604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f53b2-d648-4441-8e6f-e4eb449c66d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:43.423446 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f53b2-d648-4441-8e6f-e4eb449c66d8 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:43.439686 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 843/1687] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 16:34:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:34:43.441341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caeb31-5279-41e5-9cb1-23fd87396f96 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:43.442275 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caeb31-5279-41e5-9cb1-23fd87396f96 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:43.442275 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17caeb31-5279-41e5-9cb1-23fd87396f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:43.479556 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-17caeb31-5279-41e5-9cb1-23fd87396f96 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:43.482030 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-17caeb31-5279-41e5-9cb1-23fd87396f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:43.501524 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ead54a-86fb-40b9-95bb-ff39dcaa980c service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:43.505791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 844/1688] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:43.517960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1476555-59d5-4dd9-87df-85592fec2eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:43.518813 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1476555-59d5-4dd9-87df-85592fec2eed admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:43.519170 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be29aa-a607-496a-95b1-c42a4f904b98 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:43.519383 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1476555-59d5-4dd9-87df-85592fec2eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:43.520379 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be29aa-a607-496a-95b1-c42a4f904b98 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:43.520505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1476555-59d5-4dd9-87df-85592fec2eed admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:43.521517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be29aa-a607-496a-95b1-c42a4f904b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:43.522179 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1476555-59d5-4dd9-87df-85592fec2eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:43.533790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1476555-59d5-4dd9-87df-85592fec2eed admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:43.559676 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 845/1689] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:43.562987 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1476555-59d5-4dd9-87df-85592fec2eed admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:43.568350 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e1476555-59d5-4dd9-87df-85592fec2eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:43.624229 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d8be29aa-a607-496a-95b1-c42a4f904b98 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:43.634362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d8be29aa-a607-496a-95b1-c42a4f904b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:43.694513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 845/1690] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:43.696944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be29aa-a607-496a-95b1-c42a4f904b98 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:43.714764 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be29aa-a607-496a-95b1-c42a4f904b98 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:43.726347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa4271-e446-4b26-b259-384ffce5a570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:43.727483 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa4271-e446-4b26-b259-384ffce5a570 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:43.727951 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa4271-e446-4b26-b259-384ffce5a570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:43.728541 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa4271-e446-4b26-b259-384ffce5a570 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:43.729808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa4271-e446-4b26-b259-384ffce5a570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:43.731737 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa4271-e446-4b26-b259-384ffce5a570 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:43.753394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 846/1691] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:43.754965 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa4271-e446-4b26-b259-384ffce5a570 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:43.770066 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa4271-e446-4b26-b259-384ffce5a570 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:43.781918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1476555-59d5-4dd9-87df-85592fec2eed admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:43.791165 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179ebb7-f4f8-4b60-a575-09fdd59f2d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:43.793961 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179ebb7-f4f8-4b60-a575-09fdd59f2d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:43.794121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179ebb7-f4f8-4b60-a575-09fdd59f2d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:43.794559 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179ebb7-f4f8-4b60-a575-09fdd59f2d67 admin admin] PATH_INFO: `/v3/projects/4c553e44bf18441cbc5babe21b1991d6/users/e1d95e4a54c649c8b6ef9477405c6557/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:43.811801 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405719a-2887-4d4e-8bf2-b879808caf6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:43.815210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405719a-2887-4d4e-8bf2-b879808caf6d service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:43.816116 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405719a-2887-4d4e-8bf2-b879808caf6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:43.817524 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405719a-2887-4d4e-8bf2-b879808caf6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:43.837603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179ebb7-f4f8-4b60-a575-09fdd59f2d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c553e44bf18441cbc5babe21b1991d6, user_id=e1d95e4a54c649c8b6ef9477405c6557, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:43.842636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179ebb7-f4f8-4b60-a575-09fdd59f2d67 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:43.848303 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405719a-2887-4d4e-8bf2-b879808caf6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:43.854385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405719a-2887-4d4e-8bf2-b879808caf6d service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:43.881718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 847/1692] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:43 2022] PUT /identity/v3/projects/4c553e44bf18441cbc5babe21b1991d6/users/e1d95e4a54c649c8b6ef9477405c6557/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:43.883625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 846/1693] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:43.885567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1ad28-b206-4f1c-9a63-3133622309a1 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:43.886029 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1ad28-b206-4f1c-9a63-3133622309a1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:43.887032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1ad28-b206-4f1c-9a63-3133622309a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:43.910260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405719a-2887-4d4e-8bf2-b879808caf6d service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:43.914572 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a405719a-2887-4d4e-8bf2-b879808caf6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:43.939342 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405719a-2887-4d4e-8bf2-b879808caf6d service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:43.965349 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-92f1ad28-b206-4f1c-9a63-3133622309a1 None None] MFA Rules not processed for user `e1d95e4a54c649c8b6ef9477405c6557`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:43.967915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-92f1ad28-b206-4f1c-9a63-3133622309a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:43.993914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:44.026601 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1aae8-d916-4793-a10f-7139f5b07e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:44.027888 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1aae8-d916-4793-a10f-7139f5b07e20 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:44.028417 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1aae8-d916-4793-a10f-7139f5b07e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:44.028877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1aae8-d916-4793-a10f-7139f5b07e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:44.151446 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1aae8-d916-4793-a10f-7139f5b07e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:44.153849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1aae8-d916-4793-a10f-7139f5b07e20 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:44.170878 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 847/1694] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:44.240550 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 848/1695] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:44.247739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1aae8-d916-4793-a10f-7139f5b07e20 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:44.260855 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1aae8-d916-4793-a10f-7139f5b07e20 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:44.272392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4172c-eec0-46a1-8aca-0eee8789959a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:44.273577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4172c-eec0-46a1-8aca-0eee8789959a admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:44.274020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4172c-eec0-46a1-8aca-0eee8789959a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:44.274400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4172c-eec0-46a1-8aca-0eee8789959a admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:44.276073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4172c-eec0-46a1-8aca-0eee8789959a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:44.299019 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4172c-eec0-46a1-8aca-0eee8789959a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:44.346811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 848/1696] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:34:44 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:44.351535 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1ad28-b206-4f1c-9a63-3133622309a1 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:44.382610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1ad28-b206-4f1c-9a63-3133622309a1 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:44.490699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92123d2-5564-4680-a641-f2c7f94a5c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:44.491796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92123d2-5564-4680-a641-f2c7f94a5c98 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:44.492267 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92123d2-5564-4680-a641-f2c7f94a5c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:44.492648 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92123d2-5564-4680-a641-f2c7f94a5c98 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:44.493522 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92123d2-5564-4680-a641-f2c7f94a5c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:44.496039 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92123d2-5564-4680-a641-f2c7f94a5c98 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:44.536097 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 849/1697] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:34:44 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:34:44.541354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4172c-eec0-46a1-8aca-0eee8789959a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:44.567672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4172c-eec0-46a1-8aca-0eee8789959a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:44.592951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d72a75-1e2f-4817-bf71-116f676b9488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:44.594034 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d72a75-1e2f-4817-bf71-116f676b9488 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:44.594034 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d72a75-1e2f-4817-bf71-116f676b9488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:44.594970 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d72a75-1e2f-4817-bf71-116f676b9488 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:44.595082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d72a75-1e2f-4817-bf71-116f676b9488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:44.603735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d72a75-1e2f-4817-bf71-116f676b9488 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:44.636503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 849/1698] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:34:44.638271 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92123d2-5564-4680-a641-f2c7f94a5c98 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:44.657475 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92123d2-5564-4680-a641-f2c7f94a5c98 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:44.668764 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc94740-9f9f-418e-8ec4-537640148c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:44.669926 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc94740-9f9f-418e-8ec4-537640148c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:44.672501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc94740-9f9f-418e-8ec4-537640148c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:44.672940 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc94740-9f9f-418e-8ec4-537640148c34 admin admin] PATH_INFO: `/v3/projects/086fc1b6e14443b6b55cbe4c3adb6dad/users/1bb52534cc5d45b4bad34aed498c7d3c/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:44.682514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:44.720611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc94740-9f9f-418e-8ec4-537640148c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=086fc1b6e14443b6b55cbe4c3adb6dad, user_id=1bb52534cc5d45b4bad34aed498c7d3c, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:44.723860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc94740-9f9f-418e-8ec4-537640148c34 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:44.757565 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 850/1699] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:44 2022] PUT /identity/v3/projects/086fc1b6e14443b6b55cbe4c3adb6dad/users/1bb52534cc5d45b4bad34aed498c7d3c/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:44.760308 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d72a75-1e2f-4817-bf71-116f676b9488 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:44.780346 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d72a75-1e2f-4817-bf71-116f676b9488 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:44.970086 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622ed32-b62a-470c-95a2-42008420ce30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:44.970086 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622ed32-b62a-470c-95a2-42008420ce30 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:44.970086 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622ed32-b62a-470c-95a2-42008420ce30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:44.970086 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622ed32-b62a-470c-95a2-42008420ce30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:44.971030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622ed32-b62a-470c-95a2-42008420ce30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:44.974181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622ed32-b62a-470c-95a2-42008420ce30 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:45.009214 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 850/1700] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:45.012635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc94740-9f9f-418e-8ec4-537640148c34 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:45.030920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc94740-9f9f-418e-8ec4-537640148c34 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:45.042322 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdae801-dab3-43d5-aa64-c3a8c8a3bcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:45.043403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdae801-dab3-43d5-aa64-c3a8c8a3bcdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:45.043692 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdae801-dab3-43d5-aa64-c3a8c8a3bcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:45.043967 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdae801-dab3-43d5-aa64-c3a8c8a3bcdb admin admin] PATH_INFO: `/v3/projects/086fc1b6e14443b6b55cbe4c3adb6dad/users/1bb52534cc5d45b4bad34aed498c7d3c/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:45.050375 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdae801-dab3-43d5-aa64-c3a8c8a3bcdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=086fc1b6e14443b6b55cbe4c3adb6dad, user_id=1bb52534cc5d45b4bad34aed498c7d3c, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:45.060493 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdae801-dab3-43d5-aa64-c3a8c8a3bcdb admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:45.092903 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 851/1701] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:45 2022] PUT /identity/v3/projects/086fc1b6e14443b6b55cbe4c3adb6dad/users/1bb52534cc5d45b4bad34aed498c7d3c/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:45.106536 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdea9f-0a73-4a3d-b520-03151ade3588 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:45.107237 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdea9f-0a73-4a3d-b520-03151ade3588 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:45.107710 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdea9f-0a73-4a3d-b520-03151ade3588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:45.192851 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-01cdea9f-0a73-4a3d-b520-03151ade3588 None None] MFA Rules not processed for user `1bb52534cc5d45b4bad34aed498c7d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:45.195200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-01cdea9f-0a73-4a3d-b520-03151ade3588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:45.363802 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdae801-dab3-43d5-aa64-c3a8c8a3bcdb admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:45.367855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-afdae801-dab3-43d5-aa64-c3a8c8a3bcdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:45.380713 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:45.503179 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 851/1702] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:45.516051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdea9f-0a73-4a3d-b520-03151ade3588 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:45.518613 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-01cdea9f-0a73-4a3d-b520-03151ade3588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:45.564080 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdae801-dab3-43d5-aa64-c3a8c8a3bcdb admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:45.580350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da9923-220c-4110-88c0-c203a5d064dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:45.581407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da9923-220c-4110-88c0-c203a5d064dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:45.581696 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da9923-220c-4110-88c0-c203a5d064dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:45.584684 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da9923-220c-4110-88c0-c203a5d064dd admin admin] PATH_INFO: `/v3/projects/6de78dab5be54052a428ec5424f4ac5c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:45.588922 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da9923-220c-4110-88c0-c203a5d064dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de78dab5be54052a428ec5424f4ac5c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:45.591619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da9923-220c-4110-88c0-c203a5d064dd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:45.701668 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdea9f-0a73-4a3d-b520-03151ade3588 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:45.704514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-22da9923-220c-4110-88c0-c203a5d064dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de78dab5be54052a428ec5424f4ac5c', 'request_id': 'req-22da9923-220c-4110-88c0-c203a5d064dd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:45.723643 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-22da9923-220c-4110-88c0-c203a5d064dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de78dab5be54052a428ec5424f4ac5c', 'request_id': 'req-22da9923-220c-4110-88c0-c203a5d064dd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:45.742912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-22da9923-220c-4110-88c0-c203a5d064dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de78dab5be54052a428ec5424f4ac5c', 'request_id': 'req-22da9923-220c-4110-88c0-c203a5d064dd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:45.790878 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-22da9923-220c-4110-88c0-c203a5d064dd admin admin] The token cache is being invalidate because project 6de78dab5be54052a428ec5424f4ac5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:34:45.795079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-22da9923-220c-4110-88c0-c203a5d064dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:45.795879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-22da9923-220c-4110-88c0-c203a5d064dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:45.806892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 852/1703] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:34:45 2022] DELETE /identity/v3/projects/6de78dab5be54052a428ec5424f4ac5c => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:45.808598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654ed7f-87d1-4961-95f6-977fcbf8306e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:45.813875 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654ed7f-87d1-4961-95f6-977fcbf8306e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:45.814333 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654ed7f-87d1-4961-95f6-977fcbf8306e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:45.913957 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b654ed7f-87d1-4961-95f6-977fcbf8306e None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:45.920153 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b654ed7f-87d1-4961-95f6-977fcbf8306e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:45.933114 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d689dd-d8ef-4376-9dd7-3bb8d3127c4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:45.936499 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d689dd-d8ef-4376-9dd7-3bb8d3127c4b service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:45.938134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d689dd-d8ef-4376-9dd7-3bb8d3127c4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:45.940878 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d689dd-d8ef-4376-9dd7-3bb8d3127c4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:45.949677 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d0d689dd-d8ef-4376-9dd7-3bb8d3127c4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:46.230913 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d689dd-d8ef-4376-9dd7-3bb8d3127c4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:46.235622 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d689dd-d8ef-4376-9dd7-3bb8d3127c4b service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:46.237744 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 853/1704] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:46.244183 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f2faf-646d-420d-a297-2eae76c12e8f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:46.244517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f2faf-646d-420d-a297-2eae76c12e8f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:46.244806 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f2faf-646d-420d-a297-2eae76c12e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:46.269635 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 852/1705] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:46.292953 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:46.364823 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-446f2faf-646d-420d-a297-2eae76c12e8f None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:46.369376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-446f2faf-646d-420d-a297-2eae76c12e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:46.398801 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d689dd-d8ef-4376-9dd7-3bb8d3127c4b service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:46.399102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 854/1706] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:46.429827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d689dd-d8ef-4376-9dd7-3bb8d3127c4b service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:46.451385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b2642-5355-4b15-b1d1-23523da59202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:46.457681 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b2642-5355-4b15-b1d1-23523da59202 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:46.458357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b2642-5355-4b15-b1d1-23523da59202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:46.460882 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b2642-5355-4b15-b1d1-23523da59202 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:46.466408 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b2642-5355-4b15-b1d1-23523da59202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:34:46.466958 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b2642-5355-4b15-b1d1-23523da59202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:46.474303 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b2642-5355-4b15-b1d1-23523da59202 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:46.512785 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 853/1707] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:34:46.517664 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f2faf-646d-420d-a297-2eae76c12e8f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:46.533992 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f2faf-646d-420d-a297-2eae76c12e8f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:46.567236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdd246-a0e1-470f-9617-0109207063f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:46.567952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd246-a0e1-470f-9617-0109207063f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:46.570934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd246-a0e1-470f-9617-0109207063f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:46.571231 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd246-a0e1-470f-9617-0109207063f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:46.572200 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdd246-a0e1-470f-9617-0109207063f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:46.574027 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdd246-a0e1-470f-9617-0109207063f3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:46.676108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 855/1708] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:34:46 2022] POST /identity/v3/projects => generated 403 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:46.689494 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b2642-5355-4b15-b1d1-23523da59202 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:46.714062 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b2642-5355-4b15-b1d1-23523da59202 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:46.924964 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:47.161331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fa08f-89d3-4081-bbf1-3eaa3504c80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:47.161437 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fa08f-89d3-4081-bbf1-3eaa3504c80d admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:47.161696 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fa08f-89d3-4081-bbf1-3eaa3504c80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:47.161972 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fa08f-89d3-4081-bbf1-3eaa3504c80d admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:47.166178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fa08f-89d3-4081-bbf1-3eaa3504c80d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:47.166384 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdd246-a0e1-470f-9617-0109207063f3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:47.167051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fa08f-89d3-4081-bbf1-3eaa3504c80d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:47.168096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-14cdd246-a0e1-470f-9617-0109207063f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:47.199093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdd246-a0e1-470f-9617-0109207063f3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:47.218646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1875daf-698f-4f2d-bd24-c76aaf8c98c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:47.228842 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1875daf-698f-4f2d-bd24-c76aaf8c98c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:47.228842 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1875daf-698f-4f2d-bd24-c76aaf8c98c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:47.228842 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1875daf-698f-4f2d-bd24-c76aaf8c98c7 admin admin] PATH_INFO: `/v3/projects/1056e9a5477c4bf39d0af147b1d62895` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:47.228842 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1875daf-698f-4f2d-bd24-c76aaf8c98c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1056e9a5477c4bf39d0af147b1d62895)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:47.238507 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1875daf-698f-4f2d-bd24-c76aaf8c98c7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:47.276671 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 854/1709] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:34:46 2022] POST /identity/v3/users => generated 302 bytes in 589 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:47.278128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fa08f-89d3-4081-bbf1-3eaa3504c80d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:47.320210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fa08f-89d3-4081-bbf1-3eaa3504c80d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:47.376354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e846b92-f1f5-4046-acd5-28af4a1169be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:47.377375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e846b92-f1f5-4046-acd5-28af4a1169be admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:47.377669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e846b92-f1f5-4046-acd5-28af4a1169be admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:47.377981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e846b92-f1f5-4046-acd5-28af4a1169be admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:47.378803 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e846b92-f1f5-4046-acd5-28af4a1169be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:47.380568 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e846b92-f1f5-4046-acd5-28af4a1169be admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:47.434017 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1875daf-698f-4f2d-bd24-c76aaf8c98c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1056e9a5477c4bf39d0af147b1d62895', 'request_id': 'req-d1875daf-698f-4f2d-bd24-c76aaf8c98c7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:47.443732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 855/1710] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:47.456128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1875daf-698f-4f2d-bd24-c76aaf8c98c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1056e9a5477c4bf39d0af147b1d62895', 'request_id': 'req-d1875daf-698f-4f2d-bd24-c76aaf8c98c7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:47.477105 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1875daf-698f-4f2d-bd24-c76aaf8c98c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1056e9a5477c4bf39d0af147b1d62895', 'request_id': 'req-d1875daf-698f-4f2d-bd24-c76aaf8c98c7'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:47.477948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e846b92-f1f5-4046-acd5-28af4a1169be admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:47.520269 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1875daf-698f-4f2d-bd24-c76aaf8c98c7 admin admin] The token cache is being invalidate because project 1056e9a5477c4bf39d0af147b1d62895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:34:47.520777 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1875daf-698f-4f2d-bd24-c76aaf8c98c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:47.522016 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1875daf-698f-4f2d-bd24-c76aaf8c98c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:47.526624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 856/1711] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:34:47 2022] DELETE /identity/v3/projects/1056e9a5477c4bf39d0af147b1d62895 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:34:47.530759 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1875daf-698f-4f2d-bd24-c76aaf8c98c7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:47.536386 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e846b92-f1f5-4046-acd5-28af4a1169be admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:47.537346 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d1875daf-698f-4f2d-bd24-c76aaf8c98c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:47.745817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1875daf-698f-4f2d-bd24-c76aaf8c98c7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:47.765223 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c86db9-dc23-458c-be2c-2c29cf039d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:47.765223 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c86db9-dc23-458c-be2c-2c29cf039d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:47.765223 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c86db9-dc23-458c-be2c-2c29cf039d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:47.765223 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c86db9-dc23-458c-be2c-2c29cf039d3f admin admin] PATH_INFO: `/v3/users/506273d8191c4421b91ae36204445f33` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:47.768708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c86db9-dc23-458c-be2c-2c29cf039d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=506273d8191c4421b91ae36204445f33)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:47.781310 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c86db9-dc23-458c-be2c-2c29cf039d3f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:47.922701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-43c86db9-dc23-458c-be2c-2c29cf039d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '506273d8191c4421b91ae36204445f33'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:47.939412 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852adcc-9ad4-42af-ad7a-8793031ecbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:47.940160 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852adcc-9ad4-42af-ad7a-8793031ecbaf admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:47.940439 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852adcc-9ad4-42af-ad7a-8793031ecbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:47.945701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-43c86db9-dc23-458c-be2c-2c29cf039d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '506273d8191c4421b91ae36204445f33'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:47.947016 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852adcc-9ad4-42af-ad7a-8793031ecbaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:47.948938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852adcc-9ad4-42af-ad7a-8793031ecbaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:47.953928 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852adcc-9ad4-42af-ad7a-8793031ecbaf admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:47.966079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:47.981101 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-43c86db9-dc23-458c-be2c-2c29cf039d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '506273d8191c4421b91ae36204445f33'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:48.004893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-43c86db9-dc23-458c-be2c-2c29cf039d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '506273d8191c4421b91ae36204445f33'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:48.005720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-43c86db9-dc23-458c-be2c-2c29cf039d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '506273d8191c4421b91ae36204445f33'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:48.013025 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 856/1712] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 536 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:48.027448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d99bd9-488e-468f-be1a-0758e7e0494f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:48.027964 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d99bd9-488e-468f-be1a-0758e7e0494f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:48.029048 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 857/1713] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:34:47 2022] DELETE /identity/v3/users/506273d8191c4421b91ae36204445f33 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:48.030277 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c86db9-dc23-458c-be2c-2c29cf039d3f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:48.032670 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d99bd9-488e-468f-be1a-0758e7e0494f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:48.036240 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-43c86db9-dc23-458c-be2c-2c29cf039d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:48.121391 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-58d99bd9-488e-468f-be1a-0758e7e0494f None None] MFA Rules not processed for user `6f3fe9e871b34a8faed94550e27fefd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:48.122777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-58d99bd9-488e-468f-be1a-0758e7e0494f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:48.323460 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c86db9-dc23-458c-be2c-2c29cf039d3f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:48.330242 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 857/1714] 10.222.0.82 () {58 vars in 1015 bytes} [Fri May 27 16:34:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:48.331205 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d99bd9-488e-468f-be1a-0758e7e0494f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:48.338974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-58d99bd9-488e-468f-be1a-0758e7e0494f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:48.351514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e818d-2d45-42ed-93b9-862feaeb5297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:48.352497 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e818d-2d45-42ed-93b9-862feaeb5297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:48.352790 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e818d-2d45-42ed-93b9-862feaeb5297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:48.353073 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e818d-2d45-42ed-93b9-862feaeb5297 admin admin] PATH_INFO: `/v3/projects/e1ab1ffed0fd45d88dd93f4dc35f1388` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:48.356430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e818d-2d45-42ed-93b9-862feaeb5297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ab1ffed0fd45d88dd93f4dc35f1388)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:48.362499 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016e818d-2d45-42ed-93b9-862feaeb5297 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:48.401310 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d99bd9-488e-468f-be1a-0758e7e0494f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:48.418957 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b349a3-7b09-45f4-9e3d-63b1540119b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:48.419913 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b349a3-7b09-45f4-9e3d-63b1540119b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:48.420225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b349a3-7b09-45f4-9e3d-63b1540119b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:48.420502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b349a3-7b09-45f4-9e3d-63b1540119b6 admin admin] PATH_INFO: `/v3/projects/a1fa2f4e2565432383cb03b0039c80dd/users/65c2f42b9884441198ae5fe0087e373e/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:48.464916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b349a3-7b09-45f4-9e3d-63b1540119b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1fa2f4e2565432383cb03b0039c80dd, user_id=65c2f42b9884441198ae5fe0087e373e, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:48.484449 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b349a3-7b09-45f4-9e3d-63b1540119b6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:48.539045 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 858/1715] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:48 2022] PUT /identity/v3/projects/a1fa2f4e2565432383cb03b0039c80dd/users/65c2f42b9884441198ae5fe0087e373e/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:48.541540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c330c-d08e-4e1e-841b-0f5f85b37138 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:48.546720 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c330c-d08e-4e1e-841b-0f5f85b37138 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:48.547126 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c330c-d08e-4e1e-841b-0f5f85b37138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:48.551997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-016e818d-2d45-42ed-93b9-862feaeb5297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ab1ffed0fd45d88dd93f4dc35f1388', 'request_id': 'req-016e818d-2d45-42ed-93b9-862feaeb5297'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:48.585399 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-016e818d-2d45-42ed-93b9-862feaeb5297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ab1ffed0fd45d88dd93f4dc35f1388', 'request_id': 'req-016e818d-2d45-42ed-93b9-862feaeb5297'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:48.614158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-016e818d-2d45-42ed-93b9-862feaeb5297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ab1ffed0fd45d88dd93f4dc35f1388', 'request_id': 'req-016e818d-2d45-42ed-93b9-862feaeb5297'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:48.675225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8a8c330c-d08e-4e1e-841b-0f5f85b37138 None None] MFA Rules not processed for user `2a318e87c9d6497ead119623fbf0dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:48.679334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-016e818d-2d45-42ed-93b9-862feaeb5297 admin admin] The token cache is being invalidate because project e1ab1ffed0fd45d88dd93f4dc35f1388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:34:48.680130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-016e818d-2d45-42ed-93b9-862feaeb5297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:48.681687 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-016e818d-2d45-42ed-93b9-862feaeb5297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:48.682077 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8a8c330c-d08e-4e1e-841b-0f5f85b37138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:48.686662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 858/1716] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:34:48 2022] DELETE /identity/v3/projects/e1ab1ffed0fd45d88dd93f4dc35f1388 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:48.707426 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e818d-2d45-42ed-93b9-862feaeb5297 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:48.731509 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-016e818d-2d45-42ed-93b9-862feaeb5297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:48.757518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:49.032863 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e818d-2d45-42ed-93b9-862feaeb5297 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:49.060045 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 859/1717] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:49.061966 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a7bdd-3fe6-49ab-8963-5aaa916cdd85 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:49.062422 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a7bdd-3fe6-49ab-8963-5aaa916cdd85 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:49.062983 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a7bdd-3fe6-49ab-8963-5aaa916cdd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:49.102986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:49.106689 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-454a7bdd-3fe6-49ab-8963-5aaa916cdd85 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:49.109952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-454a7bdd-3fe6-49ab-8963-5aaa916cdd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:49.266939 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53964f-5382-4452-a591-8c3347fc5028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:49.267616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53964f-5382-4452-a591-8c3347fc5028 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:49.267900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53964f-5382-4452-a591-8c3347fc5028 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:49.268206 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53964f-5382-4452-a591-8c3347fc5028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:49.279272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2d53964f-5382-4452-a591-8c3347fc5028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:49.312747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53964f-5382-4452-a591-8c3347fc5028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:49.313629 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 860/1718] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:49.314137 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53964f-5382-4452-a591-8c3347fc5028 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:49.315689 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11470d11-350a-459a-9741-d8408a3ff4d0 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:49.316360 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11470d11-350a-459a-9741-d8408a3ff4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:49.317480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11470d11-350a-459a-9741-d8408a3ff4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:49.358513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 859/1719] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:49.361562 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7cb79-7612-40d8-be80-bb3e600f62b5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:49.362099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7cb79-7612-40d8-be80-bb3e600f62b5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:49.362655 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7cb79-7612-40d8-be80-bb3e600f62b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:49.367799 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-11470d11-350a-459a-9741-d8408a3ff4d0 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:49.371392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-11470d11-350a-459a-9741-d8408a3ff4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:49.395097 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 861/1720] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:49.395097 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11470d11-350a-459a-9741-d8408a3ff4d0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:49.436530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11470d11-350a-459a-9741-d8408a3ff4d0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:49.442398 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f957830-9f4e-4b7c-b203-a84a832868c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:49.443410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f957830-9f4e-4b7c-b203-a84a832868c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:49.443995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f957830-9f4e-4b7c-b203-a84a832868c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:49.444595 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f957830-9f4e-4b7c-b203-a84a832868c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:49.450669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9ab7cb79-7612-40d8-be80-bb3e600f62b5 None None] MFA Rules not processed for user `2a318e87c9d6497ead119623fbf0dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:49.452472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9ab7cb79-7612-40d8-be80-bb3e600f62b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:49.460370 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f957830-9f4e-4b7c-b203-a84a832868c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:49.462167 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f957830-9f4e-4b7c-b203-a84a832868c7 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:49.477387 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 860/1721] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:49.478770 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7977bdf-f99c-4681-9add-81e998d2d087 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:49.479065 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7977bdf-f99c-4681-9add-81e998d2d087 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:49.479339 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7977bdf-f99c-4681-9add-81e998d2d087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:49.480365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 862/1722] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:49.492733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f957830-9f4e-4b7c-b203-a84a832868c7 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:49.498172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5f957830-9f4e-4b7c-b203-a84a832868c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:49.534686 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f7977bdf-f99c-4681-9add-81e998d2d087 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:49.539069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f7977bdf-f99c-4681-9add-81e998d2d087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:49.560955 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 861/1723] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:49.564165 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7977bdf-f99c-4681-9add-81e998d2d087 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:49.587435 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7977bdf-f99c-4681-9add-81e998d2d087 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:49.599154 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df63af-7d11-4adc-9d8a-f67da6014e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:49.599792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df63af-7d11-4adc-9d8a-f67da6014e7e admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:49.600705 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df63af-7d11-4adc-9d8a-f67da6014e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:49.602119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df63af-7d11-4adc-9d8a-f67da6014e7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:49.603315 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df63af-7d11-4adc-9d8a-f67da6014e7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:34:49.603636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df63af-7d11-4adc-9d8a-f67da6014e7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:49.609513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df63af-7d11-4adc-9d8a-f67da6014e7e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:49.645547 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 862/1724] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:34:49.651751 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df63af-7d11-4adc-9d8a-f67da6014e7e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:49.683706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df63af-7d11-4adc-9d8a-f67da6014e7e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:49.702115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276904ac-0939-46f4-bfd4-d1b59914686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:49.704167 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276904ac-0939-46f4-bfd4-d1b59914686c admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:49.705150 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276904ac-0939-46f4-bfd4-d1b59914686c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:49.706185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276904ac-0939-46f4-bfd4-d1b59914686c admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:49.708450 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276904ac-0939-46f4-bfd4-d1b59914686c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:49.716679 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276904ac-0939-46f4-bfd4-d1b59914686c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:49.721735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f957830-9f4e-4b7c-b203-a84a832868c7 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:49.743244 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8ccfd-f393-4512-9f14-9de466733b00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:49.758508 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8ccfd-f393-4512-9f14-9de466733b00 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:49.758913 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8ccfd-f393-4512-9f14-9de466733b00 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:49.759157 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8ccfd-f393-4512-9f14-9de466733b00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:49.780821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8ccfd-f393-4512-9f14-9de466733b00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:49.786076 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8ccfd-f393-4512-9f14-9de466733b00 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:49.814169 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 863/1725] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:34:49 2022] POST /identity/v3/projects => generated 371 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:49.823103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276904ac-0939-46f4-bfd4-d1b59914686c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:49.838340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 863/1726] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:49.850092 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8ccfd-f393-4512-9f14-9de466733b00 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:49.853900 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cde8ccfd-f393-4512-9f14-9de466733b00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:49.897685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8ccfd-f393-4512-9f14-9de466733b00 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:49.944675 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:50.081308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276904ac-0939-46f4-bfd4-d1b59914686c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:50.117158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b89d2-6f81-4aeb-81db-000968782255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:50.117854 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b89d2-6f81-4aeb-81db-000968782255 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:50.118030 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b89d2-6f81-4aeb-81db-000968782255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:50.118311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b89d2-6f81-4aeb-81db-000968782255 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:50.119397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b89d2-6f81-4aeb-81db-000968782255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:50.128530 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b89d2-6f81-4aeb-81db-000968782255 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:50.167579 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394988f9-56b5-4652-bb6c-00e0c29aef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:50.168608 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394988f9-56b5-4652-bb6c-00e0c29aef07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:50.168988 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394988f9-56b5-4652-bb6c-00e0c29aef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:50.169109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394988f9-56b5-4652-bb6c-00e0c29aef07 admin admin] PATH_INFO: `/v3/projects/24febadc747146f7b40f972c2ec3c8be` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:50.177971 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394988f9-56b5-4652-bb6c-00e0c29aef07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24febadc747146f7b40f972c2ec3c8be)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:50.192419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394988f9-56b5-4652-bb6c-00e0c29aef07 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:50.244387 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 864/1727] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:34:49 2022] POST /identity/v3/users => generated 286 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:50.246062 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22f4d9-2ffc-4376-be39-8053c68425c2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:50.250539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22f4d9-2ffc-4376-be39-8053c68425c2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:50.251175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22f4d9-2ffc-4376-be39-8053c68425c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:50.353928 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-db22f4d9-2ffc-4376-be39-8053c68425c2 None None] MFA Rules not processed for user `6d3dd7ad5436451a919ef8aaf9623f83`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:50.356131 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-db22f4d9-2ffc-4376-be39-8053c68425c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:50.386783 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-394988f9-56b5-4652-bb6c-00e0c29aef07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24febadc747146f7b40f972c2ec3c8be', 'request_id': 'req-394988f9-56b5-4652-bb6c-00e0c29aef07'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:50.417710 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-394988f9-56b5-4652-bb6c-00e0c29aef07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24febadc747146f7b40f972c2ec3c8be', 'request_id': 'req-394988f9-56b5-4652-bb6c-00e0c29aef07'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:50.429951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-394988f9-56b5-4652-bb6c-00e0c29aef07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24febadc747146f7b40f972c2ec3c8be', 'request_id': 'req-394988f9-56b5-4652-bb6c-00e0c29aef07'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:50.463774 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-394988f9-56b5-4652-bb6c-00e0c29aef07 admin admin] The token cache is being invalidate because project 24febadc747146f7b40f972c2ec3c8be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:34:50.464124 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-394988f9-56b5-4652-bb6c-00e0c29aef07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:50.473697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-394988f9-56b5-4652-bb6c-00e0c29aef07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:34:50.482817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 864/1728] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:34:49 2022] DELETE /identity/v3/projects/24febadc747146f7b40f972c2ec3c8be => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:50.483884 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394988f9-56b5-4652-bb6c-00e0c29aef07 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:50.497923 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-394988f9-56b5-4652-bb6c-00e0c29aef07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:50.535912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:50.581912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 865/1729] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:50.582905 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22f4d9-2ffc-4376-be39-8053c68425c2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:50.584523 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-db22f4d9-2ffc-4376-be39-8053c68425c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:50.761093 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394988f9-56b5-4652-bb6c-00e0c29aef07 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:50.777131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5232a04-85bb-4806-a614-9ae82d7c3b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:50.777863 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5232a04-85bb-4806-a614-9ae82d7c3b2a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:50.778153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5232a04-85bb-4806-a614-9ae82d7c3b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:50.778419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5232a04-85bb-4806-a614-9ae82d7c3b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:50.779170 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5232a04-85bb-4806-a614-9ae82d7c3b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:50.780912 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5232a04-85bb-4806-a614-9ae82d7c3b2a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:50.827701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 865/1730] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:50.829270 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4e8d5-3ffe-4bcd-bcf7-7cba6707d7e8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:50.829563 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4e8d5-3ffe-4bcd-bcf7-7cba6707d7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:50.829841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4e8d5-3ffe-4bcd-bcf7-7cba6707d7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:50.874304 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22f4d9-2ffc-4376-be39-8053c68425c2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:50.901652 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226f22c-447c-42b3-ae01-aaef71b1b9fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:50.904689 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226f22c-447c-42b3-ae01-aaef71b1b9fe service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:50.905181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226f22c-447c-42b3-ae01-aaef71b1b9fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:50.915315 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-04e4e8d5-3ffe-4bcd-bcf7-7cba6707d7e8 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:50.915841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226f22c-447c-42b3-ae01-aaef71b1b9fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:50.916617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-04e4e8d5-3ffe-4bcd-bcf7-7cba6707d7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:50.918896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2226f22c-447c-42b3-ae01-aaef71b1b9fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:50.935479 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 866/1731] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:50.947797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4e8d5-3ffe-4bcd-bcf7-7cba6707d7e8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:50.950651 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-04e4e8d5-3ffe-4bcd-bcf7-7cba6707d7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:51.195907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226f22c-447c-42b3-ae01-aaef71b1b9fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:51.197488 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226f22c-447c-42b3-ae01-aaef71b1b9fe service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:51.216162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:51.253313 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 866/1732] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:51.254354 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226f22c-447c-42b3-ae01-aaef71b1b9fe service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:51.292209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226f22c-447c-42b3-ae01-aaef71b1b9fe service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:51.298414 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e8aed-5af6-41ff-b5ec-cd2d5c5d6b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:51.299106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e8aed-5af6-41ff-b5ec-cd2d5c5d6b36 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:51.299776 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e8aed-5af6-41ff-b5ec-cd2d5c5d6b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:51.299776 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e8aed-5af6-41ff-b5ec-cd2d5c5d6b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:51.300408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e8aed-5af6-41ff-b5ec-cd2d5c5d6b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:51.302051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e8aed-5af6-41ff-b5ec-cd2d5c5d6b36 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:51.327954 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 867/1733] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:51.329477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b04e6-c211-49e0-8f46-f214e44b937b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:51.329767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b04e6-c211-49e0-8f46-f214e44b937b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:51.330073 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b04e6-c211-49e0-8f46-f214e44b937b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:51.338503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4e8d5-3ffe-4bcd-bcf7-7cba6707d7e8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:51.352979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d736276-18ea-421d-b809-56f98d9ba44f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:51.353802 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d736276-18ea-421d-b809-56f98d9ba44f service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:51.353971 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d736276-18ea-421d-b809-56f98d9ba44f service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:51.354366 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d736276-18ea-421d-b809-56f98d9ba44f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:51.383554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d736276-18ea-421d-b809-56f98d9ba44f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:51.385142 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-531b04e6-c211-49e0-8f46-f214e44b937b None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:51.386391 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-531b04e6-c211-49e0-8f46-f214e44b937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:51.388543 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d736276-18ea-421d-b809-56f98d9ba44f service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:51.419258 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 868/1734] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:51.419976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b04e6-c211-49e0-8f46-f214e44b937b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:51.427504 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 867/1735] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:51.436269 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d736276-18ea-421d-b809-56f98d9ba44f service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:51.473343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b04e6-c211-49e0-8f46-f214e44b937b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:51.477882 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d736276-18ea-421d-b809-56f98d9ba44f service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:51.483786 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc64f93-fa0c-45d2-94a3-f12caafc5680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:51.486284 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc64f93-fa0c-45d2-94a3-f12caafc5680 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:51.486284 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc64f93-fa0c-45d2-94a3-f12caafc5680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:51.486284 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc64f93-fa0c-45d2-94a3-f12caafc5680 admin admin] PATH_INFO: `/v3/projects/5e9631bcf12f4cc5bc0e71d0a0b0a932/users/98582ba48a95412e89fc973405bbe1e8/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:51.494740 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48039ab2-7bbc-4d7a-832b-a3e195182c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:51.495440 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48039ab2-7bbc-4d7a-832b-a3e195182c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:51.495719 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48039ab2-7bbc-4d7a-832b-a3e195182c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:51.495991 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48039ab2-7bbc-4d7a-832b-a3e195182c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:51.496745 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48039ab2-7bbc-4d7a-832b-a3e195182c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:34:51.497050 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48039ab2-7bbc-4d7a-832b-a3e195182c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:51.498727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48039ab2-7bbc-4d7a-832b-a3e195182c87 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:51.548689 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc64f93-fa0c-45d2-94a3-f12caafc5680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9631bcf12f4cc5bc0e71d0a0b0a932, user_id=98582ba48a95412e89fc973405bbe1e8, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:51.551242 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 868/1736] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:34:51.552230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48039ab2-7bbc-4d7a-832b-a3e195182c87 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:51.554485 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc64f93-fa0c-45d2-94a3-f12caafc5680 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:51.587769 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48039ab2-7bbc-4d7a-832b-a3e195182c87 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:51.596148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 869/1737] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:51 2022] PUT /identity/v3/projects/5e9631bcf12f4cc5bc0e71d0a0b0a932/users/98582ba48a95412e89fc973405bbe1e8/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:51.608496 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cf15e-43fa-44a8-8599-c9a099e83750 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:51.608792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cf15e-43fa-44a8-8599-c9a099e83750 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:51.609059 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cf15e-43fa-44a8-8599-c9a099e83750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:51.693626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-511cf15e-43fa-44a8-8599-c9a099e83750 None None] MFA Rules not processed for user `98582ba48a95412e89fc973405bbe1e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:51.695399 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-511cf15e-43fa-44a8-8599-c9a099e83750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:51.873875 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a7d7b-148d-4f34-93f3-512017dc368b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:51.874589 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a7d7b-148d-4f34-93f3-512017dc368b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:51.874870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a7d7b-148d-4f34-93f3-512017dc368b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:51.875144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a7d7b-148d-4f34-93f3-512017dc368b admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:51.875863 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a7d7b-148d-4f34-93f3-512017dc368b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:51.888178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a7d7b-148d-4f34-93f3-512017dc368b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:52.005976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:52.008520 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 869/1738] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:34:51 2022] POST /identity/v3/projects => generated 385 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:52.013402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a7d7b-148d-4f34-93f3-512017dc368b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:52.034837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 870/1739] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:34:52.039390 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cf15e-43fa-44a8-8599-c9a099e83750 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:52.072088 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cf15e-43fa-44a8-8599-c9a099e83750 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:52.158054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a7d7b-148d-4f34-93f3-512017dc368b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:52.165966 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222112c9-5b77-4d69-9032-c5292216acc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:52.169190 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222112c9-5b77-4d69-9032-c5292216acc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:52.169439 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222112c9-5b77-4d69-9032-c5292216acc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:52.169734 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222112c9-5b77-4d69-9032-c5292216acc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:52.170763 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222112c9-5b77-4d69-9032-c5292216acc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:52.183751 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222112c9-5b77-4d69-9032-c5292216acc3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:52.219777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 870/1740] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:34:52 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:52.225931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222112c9-5b77-4d69-9032-c5292216acc3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:52.251268 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222112c9-5b77-4d69-9032-c5292216acc3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:52.261572 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9521b-fca2-4f58-924e-61b3b421921c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:52.262576 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9521b-fca2-4f58-924e-61b3b421921c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:52.263157 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9521b-fca2-4f58-924e-61b3b421921c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:52.263488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9521b-fca2-4f58-924e-61b3b421921c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:52.264336 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9521b-fca2-4f58-924e-61b3b421921c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:52.266235 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9521b-fca2-4f58-924e-61b3b421921c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:52.281737 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbbdfe-ff67-4f45-a107-e258971d559c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:52.282510 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbbdfe-ff67-4f45-a107-e258971d559c admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:52.282852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbbdfe-ff67-4f45-a107-e258971d559c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:52.283188 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbbdfe-ff67-4f45-a107-e258971d559c admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:52.283938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 871/1741] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:52.284050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbbdfe-ff67-4f45-a107-e258971d559c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:52.286228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbbdfe-ff67-4f45-a107-e258971d559c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:52.289817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9521b-fca2-4f58-924e-61b3b421921c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:52.355052 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9521b-fca2-4f58-924e-61b3b421921c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:52.383775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a805f0-a280-4bf2-9827-86b2d854fc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:52.385233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a805f0-a280-4bf2-9827-86b2d854fc3f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:52.385524 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a805f0-a280-4bf2-9827-86b2d854fc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:52.394831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a805f0-a280-4bf2-9827-86b2d854fc3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:52.400375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a805f0-a280-4bf2-9827-86b2d854fc3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:52.400588 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 871/1742] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:34:52 2022] POST /identity/v3/projects => generated 373 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:52.403669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a805f0-a280-4bf2-9827-86b2d854fc3f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:52.404289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbbdfe-ff67-4f45-a107-e258971d559c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:52.460532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 872/1743] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:52.469052 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a805f0-a280-4bf2-9827-86b2d854fc3f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:52.525810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a805f0-a280-4bf2-9827-86b2d854fc3f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:52.561876 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:52.718734 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbbdfe-ff67-4f45-a107-e258971d559c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:52.734667 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6ada6-a980-44a2-b3a3-bcc8caca3f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:52.735399 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6ada6-a980-44a2-b3a3-bcc8caca3f4a admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:52.736211 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6ada6-a980-44a2-b3a3-bcc8caca3f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:52.736339 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92548798-4d90-479f-bc76-52bee3903f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:52.736450 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6ada6-a980-44a2-b3a3-bcc8caca3f4a admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:52.736668 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6ada6-a980-44a2-b3a3-bcc8caca3f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:52.737042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92548798-4d90-479f-bc76-52bee3903f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:52.737431 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92548798-4d90-479f-bc76-52bee3903f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:52.737795 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92548798-4d90-479f-bc76-52bee3903f29 admin admin] PATH_INFO: `/v3/projects/2c44e33a814d4043b03753b1e31cdfa3/users/83caeb8e66e4439bb0beda4493eba0ab/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:52.738719 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6ada6-a980-44a2-b3a3-bcc8caca3f4a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:52.779071 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92548798-4d90-479f-bc76-52bee3903f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c44e33a814d4043b03753b1e31cdfa3, user_id=83caeb8e66e4439bb0beda4493eba0ab, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:52.788974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92548798-4d90-479f-bc76-52bee3903f29 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:52.809541 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 872/1744] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:34:52 2022] POST /identity/v3/users => generated 293 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:52.811065 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6ada6-a980-44a2-b3a3-bcc8caca3f4a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:52.837687 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 873/1745] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:52 2022] PUT /identity/v3/projects/2c44e33a814d4043b03753b1e31cdfa3/users/83caeb8e66e4439bb0beda4493eba0ab/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:52.849669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137c49e-d108-4cad-b847-49ba623df68b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:52.850601 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137c49e-d108-4cad-b847-49ba623df68b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:52.851113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137c49e-d108-4cad-b847-49ba623df68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:52.861990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6ada6-a980-44a2-b3a3-bcc8caca3f4a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:52.945923 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7137c49e-d108-4cad-b847-49ba623df68b None None] MFA Rules not processed for user `83caeb8e66e4439bb0beda4493eba0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:52.947179 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7137c49e-d108-4cad-b847-49ba623df68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:53.044318 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5007795-dca7-495b-9ce4-02a2b93bae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:53.044733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5007795-dca7-495b-9ce4-02a2b93bae13 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:53.045019 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5007795-dca7-495b-9ce4-02a2b93bae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:53.045294 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5007795-dca7-495b-9ce4-02a2b93bae13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:53.049766 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5007795-dca7-495b-9ce4-02a2b93bae13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:53.055685 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5007795-dca7-495b-9ce4-02a2b93bae13 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:53.080754 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 873/1746] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:52 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:53.081748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5007795-dca7-495b-9ce4-02a2b93bae13 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:53.095147 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:53.108694 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5007795-dca7-495b-9ce4-02a2b93bae13 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:53.133148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db564c07-567a-4f6d-9fe9-5c1e44dd7925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:53.134101 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db564c07-567a-4f6d-9fe9-5c1e44dd7925 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:53.134397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db564c07-567a-4f6d-9fe9-5c1e44dd7925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:53.134677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db564c07-567a-4f6d-9fe9-5c1e44dd7925 admin admin] PATH_INFO: `/v3/projects/cef45afe60da436a87281946b9446b85/users/5bc21fb411214a6eb187371962077f89/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:53.148721 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 874/1747] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:34:53.160549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137c49e-d108-4cad-b847-49ba623df68b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:53.172644 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db564c07-567a-4f6d-9fe9-5c1e44dd7925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef45afe60da436a87281946b9446b85, user_id=5bc21fb411214a6eb187371962077f89, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:53.175570 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db564c07-567a-4f6d-9fe9-5c1e44dd7925 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:53.209663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 874/1748] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:53 2022] PUT /identity/v3/projects/cef45afe60da436a87281946b9446b85/users/5bc21fb411214a6eb187371962077f89/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:53.215698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db564c07-567a-4f6d-9fe9-5c1e44dd7925 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:53.218024 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137c49e-d108-4cad-b847-49ba623df68b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:53.409397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db564c07-567a-4f6d-9fe9-5c1e44dd7925 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:53.449821 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c590e54-ba0d-405a-8751-e71aed27d1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:53.455261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c590e54-ba0d-405a-8751-e71aed27d1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:53.455261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c590e54-ba0d-405a-8751-e71aed27d1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:53.455261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c590e54-ba0d-405a-8751-e71aed27d1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:53.455261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c590e54-ba0d-405a-8751-e71aed27d1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:53.483950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c590e54-ba0d-405a-8751-e71aed27d1c9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:53.517478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a22f69-9784-48fc-ab72-6e2b2da3afce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:53.518206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a22f69-9784-48fc-ab72-6e2b2da3afce admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:53.518455 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a22f69-9784-48fc-ab72-6e2b2da3afce admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:53.518735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a22f69-9784-48fc-ab72-6e2b2da3afce admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:53.527880 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 875/1749] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:53 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:34:53.531847 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c590e54-ba0d-405a-8751-e71aed27d1c9 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:53.550487 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a22f69-9784-48fc-ab72-6e2b2da3afce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:53.562623 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a22f69-9784-48fc-ab72-6e2b2da3afce admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:53.568153 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c590e54-ba0d-405a-8751-e71aed27d1c9 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:53.610276 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f10123-8412-4c55-a16e-bd24f0d84600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:53.614596 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f10123-8412-4c55-a16e-bd24f0d84600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:53.621354 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f10123-8412-4c55-a16e-bd24f0d84600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:53.624167 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f10123-8412-4c55-a16e-bd24f0d84600 admin admin] PATH_INFO: `/v3/projects/cef45afe60da436a87281946b9446b85/users/5bc21fb411214a6eb187371962077f89/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:53.642313 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f10123-8412-4c55-a16e-bd24f0d84600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef45afe60da436a87281946b9446b85, user_id=5bc21fb411214a6eb187371962077f89, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:53.647370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f10123-8412-4c55-a16e-bd24f0d84600 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:53.682184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 875/1750] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:34:53 2022] POST /identity/v3/projects => generated 385 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:53.683434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a22f69-9784-48fc-ab72-6e2b2da3afce admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:53.694432 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:53.731011 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 876/1751] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:53 2022] PUT /identity/v3/projects/cef45afe60da436a87281946b9446b85/users/5bc21fb411214a6eb187371962077f89/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:53.742416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136138d-93ae-437a-9e4f-5fb89a721628 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:53.743269 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136138d-93ae-437a-9e4f-5fb89a721628 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:53.743983 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136138d-93ae-437a-9e4f-5fb89a721628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:53.845611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b136138d-93ae-437a-9e4f-5fb89a721628 None None] MFA Rules not processed for user `5bc21fb411214a6eb187371962077f89`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:53.853218 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b136138d-93ae-437a-9e4f-5fb89a721628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:53.939791 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a22f69-9784-48fc-ab72-6e2b2da3afce admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:54.207158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd394c50-4b52-436b-abf4-dd55792dfcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:54.208257 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd394c50-4b52-436b-abf4-dd55792dfcb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:54.208730 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd394c50-4b52-436b-abf4-dd55792dfcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:54.209228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd394c50-4b52-436b-abf4-dd55792dfcb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:54.210414 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd394c50-4b52-436b-abf4-dd55792dfcb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:54.225057 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 877/1752] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:54.241305 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd394c50-4b52-436b-abf4-dd55792dfcb5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:54.247724 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136138d-93ae-437a-9e4f-5fb89a721628 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:54.254377 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b136138d-93ae-437a-9e4f-5fb89a721628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:54.375477 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 876/1753] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:34:53 2022] POST /identity/v3/users => generated 299 bytes in 692 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:54.378432 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd394c50-4b52-436b-abf4-dd55792dfcb5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:54.410257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:54.436439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136138d-93ae-437a-9e4f-5fb89a721628 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:54.445043 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5656d-4ca3-4546-a5e7-2ad2f5c659d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:54.446862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5656d-4ca3-4546-a5e7-2ad2f5c659d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:54.447749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5656d-4ca3-4546-a5e7-2ad2f5c659d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:54.448940 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5656d-4ca3-4546-a5e7-2ad2f5c659d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:54.463380 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd394c50-4b52-436b-abf4-dd55792dfcb5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:54.479711 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5656d-4ca3-4546-a5e7-2ad2f5c659d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:54.483606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5656d-4ca3-4546-a5e7-2ad2f5c659d2 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:54.500505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92106a8a-4467-432f-979d-5712350078c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:54.501801 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92106a8a-4467-432f-979d-5712350078c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:54.502521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92106a8a-4467-432f-979d-5712350078c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:54.503192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92106a8a-4467-432f-979d-5712350078c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:54.504967 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 878/1754] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:54.507360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b1e02-b456-4188-b293-4df1d1037fe7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:54.507961 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b1e02-b456-4188-b293-4df1d1037fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:54.508537 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b1e02-b456-4188-b293-4df1d1037fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:54.518815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92106a8a-4467-432f-979d-5712350078c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:54.523414 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92106a8a-4467-432f-979d-5712350078c9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:54.565577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d73b1e02-b456-4188-b293-4df1d1037fe7 None None] MFA Rules not processed for user `2ecad16f09f54327b78aab5b06f9872a`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:54.567669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d73b1e02-b456-4188-b293-4df1d1037fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:54.600809 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 877/1755] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:54.602650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92106a8a-4467-432f-979d-5712350078c9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:54.668035 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92106a8a-4467-432f-979d-5712350078c9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:54.710772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db77bce-578d-4f55-b9a1-8452721dcca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:54.712414 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db77bce-578d-4f55-b9a1-8452721dcca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:54.712995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db77bce-578d-4f55-b9a1-8452721dcca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:54.719014 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db77bce-578d-4f55-b9a1-8452721dcca9 admin admin] PATH_INFO: `/v3/projects/050a3440c69d46c6a270eb1f9a4a79ac/users/4ee0e930e2544972a4ad631e7b4058e2/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:54.790671 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db77bce-578d-4f55-b9a1-8452721dcca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=050a3440c69d46c6a270eb1f9a4a79ac, user_id=4ee0e930e2544972a4ad631e7b4058e2, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:54.795931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db77bce-578d-4f55-b9a1-8452721dcca9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:54.810919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 879/1756] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:54.812062 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b1e02-b456-4188-b293-4df1d1037fe7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:54.861719 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 878/1757] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:54 2022] PUT /identity/v3/projects/050a3440c69d46c6a270eb1f9a4a79ac/users/4ee0e930e2544972a4ad631e7b4058e2/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:54.867772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db77bce-578d-4f55-b9a1-8452721dcca9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:54.868809 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b1e02-b456-4188-b293-4df1d1037fe7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:55.165386 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad96908-3ce2-412a-917b-0baddd80ebc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:55.166570 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad96908-3ce2-412a-917b-0baddd80ebc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:55.167099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad96908-3ce2-412a-917b-0baddd80ebc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:55.167601 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad96908-3ce2-412a-917b-0baddd80ebc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:55.216671 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db77bce-578d-4f55-b9a1-8452721dcca9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:55.237617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e83cc5-9867-498a-afcb-1a814056ad65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:55.241178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e83cc5-9867-498a-afcb-1a814056ad65 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:55.242024 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e83cc5-9867-498a-afcb-1a814056ad65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:55.243556 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e83cc5-9867-498a-afcb-1a814056ad65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:55.249515 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e83cc5-9867-498a-afcb-1a814056ad65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:55.258787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e83cc5-9867-498a-afcb-1a814056ad65 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:55.303837 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 879/1758] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:34:55.307363 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e83cc5-9867-498a-afcb-1a814056ad65 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:55.334159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:55.353861 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e83cc5-9867-498a-afcb-1a814056ad65 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:55.374639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f7534-c8c6-461c-ba3a-fcfac6faa27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:55.378658 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f7534-c8c6-461c-ba3a-fcfac6faa27a admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:55.378984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f7534-c8c6-461c-ba3a-fcfac6faa27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:55.380670 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f7534-c8c6-461c-ba3a-fcfac6faa27a admin admin] PATH_INFO: `/v3/projects/050a3440c69d46c6a270eb1f9a4a79ac/users/4ee0e930e2544972a4ad631e7b4058e2/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:55.387201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f7534-c8c6-461c-ba3a-fcfac6faa27a admin admin] RBAC: Authorizing `identity:create_grant(project_id=050a3440c69d46c6a270eb1f9a4a79ac, user_id=4ee0e930e2544972a4ad631e7b4058e2, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:55.396250 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f7534-c8c6-461c-ba3a-fcfac6faa27a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:55.437114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad96908-3ce2-412a-917b-0baddd80ebc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:55.442324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad96908-3ce2-412a-917b-0baddd80ebc1 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:55.454607 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 880/1759] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:55 2022] PUT /identity/v3/projects/050a3440c69d46c6a270eb1f9a4a79ac/users/4ee0e930e2544972a4ad631e7b4058e2/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:55.457522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8f758-7be0-4d85-a28a-d1e9c8e616ce None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:55.457828 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8f758-7be0-4d85-a28a-d1e9c8e616ce None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:55.458113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8f758-7be0-4d85-a28a-d1e9c8e616ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:55.483583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 880/1760] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:55.595001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2eb8f758-7be0-4d85-a28a-d1e9c8e616ce None None] MFA Rules not processed for user `4ee0e930e2544972a4ad631e7b4058e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:55.597134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2eb8f758-7be0-4d85-a28a-d1e9c8e616ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:55.996366 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 881/1761] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 540 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:56.057705 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad96908-3ce2-412a-917b-0baddd80ebc1 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:56.073581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad96908-3ce2-412a-917b-0baddd80ebc1 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:56.367973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b9bf7-f25b-4cfd-8968-07085ad9de00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:56.369046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b9bf7-f25b-4cfd-8968-07085ad9de00 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:56.369483 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b9bf7-f25b-4cfd-8968-07085ad9de00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:56.369944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b9bf7-f25b-4cfd-8968-07085ad9de00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:56.381790 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:56.521395 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b9bf7-f25b-4cfd-8968-07085ad9de00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:56.524673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b9bf7-f25b-4cfd-8968-07085ad9de00 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:56.553508 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 881/1762] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:57.446548 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9b2c3-734d-44c0-871d-0c8b6f7e2510 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:57.447733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9b2c3-734d-44c0-871d-0c8b6f7e2510 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:57.449541 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9b2c3-734d-44c0-871d-0c8b6f7e2510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:57.557504 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e363d-0a2e-4d7a-9ca5-22c9295b8569 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:57.561720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e363d-0a2e-4d7a-9ca5-22c9295b8569 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:57.562547 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e363d-0a2e-4d7a-9ca5-22c9295b8569 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:57.565081 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 882/1763] 10.222.0.41 () {54 vars in 912 bytes} [Fri May 27 16:34:57 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:34:57.580416 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-78a9b2c3-734d-44c0-871d-0c8b6f7e2510 None None] MFA Rules not processed for user `65c2f42b9884441198ae5fe0087e373e`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:57.594609 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-78a9b2c3-734d-44c0-871d-0c8b6f7e2510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:57.614743 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda06aa-a5cc-4a4d-a875-3c3cb792d3b1 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:57.615300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda06aa-a5cc-4a4d-a875-3c3cb792d3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:57.615709 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda06aa-a5cc-4a4d-a875-3c3cb792d3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:57.661338 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7eda06aa-a5cc-4a4d-a875-3c3cb792d3b1 None None] MFA Rules not processed for user `6f3fe9e871b34a8faed94550e27fefd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:57.666724 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7eda06aa-a5cc-4a4d-a875-3c3cb792d3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:57.876253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 883/1764] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:34:57.957180 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda06aa-a5cc-4a4d-a875-3c3cb792d3b1 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:57.959100 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7eda06aa-a5cc-4a4d-a875-3c3cb792d3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:57.998092 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda06aa-a5cc-4a4d-a875-3c3cb792d3b1 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:58.015784 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68af6b-9406-4c02-b5c1-e583741f88cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:58.017565 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68af6b-9406-4c02-b5c1-e583741f88cf service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:58.019215 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 882/1765] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 574 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:58.021282 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68af6b-9406-4c02-b5c1-e583741f88cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:58.023580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68af6b-9406-4c02-b5c1-e583741f88cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:58.024346 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9b2c3-734d-44c0-871d-0c8b6f7e2510 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:58.029099 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-78a9b2c3-734d-44c0-871d-0c8b6f7e2510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:58.068711 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68af6b-9406-4c02-b5c1-e583741f88cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:58.076047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68af6b-9406-4c02-b5c1-e583741f88cf service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:58.179904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 884/1766] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:34:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:34:58.331360 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9b2c3-734d-44c0-871d-0c8b6f7e2510 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:58.356707 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b881c-4059-42a5-b921-2fe3db0c93a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:58.357301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b881c-4059-42a5-b921-2fe3db0c93a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:58.357588 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b881c-4059-42a5-b921-2fe3db0c93a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:58.357863 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b881c-4059-42a5-b921-2fe3db0c93a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:58.358592 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b881c-4059-42a5-b921-2fe3db0c93a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:58.369053 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b881c-4059-42a5-b921-2fe3db0c93a1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:58.431901 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:58.516119 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 883/1767] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:34:58 2022] POST /identity/v3/projects => generated 403 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:58.519169 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68af6b-9406-4c02-b5c1-e583741f88cf service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:58.575480 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68af6b-9406-4c02-b5c1-e583741f88cf service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:58.579548 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35fbcb-ef16-4fd8-b0bb-72515b86e3f2 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:58.580981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35fbcb-ef16-4fd8-b0bb-72515b86e3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:58.581568 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35fbcb-ef16-4fd8-b0bb-72515b86e3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:58.677333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fb35fbcb-ef16-4fd8-b0bb-72515b86e3f2 None None] MFA Rules not processed for user `6d3dd7ad5436451a919ef8aaf9623f83`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:58.682288 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fb35fbcb-ef16-4fd8-b0bb-72515b86e3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:58.814969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0a2f3-4827-42e8-bb4e-f256b18241e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:58.817564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0a2f3-4827-42e8-bb4e-f256b18241e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:58.819609 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0a2f3-4827-42e8-bb4e-f256b18241e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:58.820141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0a2f3-4827-42e8-bb4e-f256b18241e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:58.821330 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0a2f3-4827-42e8-bb4e-f256b18241e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:58.825156 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0a2f3-4827-42e8-bb4e-f256b18241e3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:58.905382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 885/1768] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:34:58 2022] POST /identity/v3/users => generated 308 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:34:58.909132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e097573-f4bf-48f7-b350-065cd1eea3f9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:58.909772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e097573-f4bf-48f7-b350-065cd1eea3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:58.910275 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e097573-f4bf-48f7-b350-065cd1eea3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:58.963867 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 884/1769] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:58.965375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d845d-e102-4ebd-bb85-1bc382549ca7 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:58.972135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d845d-e102-4ebd-bb85-1bc382549ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:58.972647 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d845d-e102-4ebd-bb85-1bc382549ca7 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:58.974835 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 885/1770] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 16:34:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:34:58.978693 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d845d-e102-4ebd-bb85-1bc382549ca7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:59.033840 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1e097573-f4bf-48f7-b350-065cd1eea3f9 None None] MFA Rules not processed for user `2a318e87c9d6497ead119623fbf0dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:59.039719 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1e097573-f4bf-48f7-b350-065cd1eea3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:59.042553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d845d-e102-4ebd-bb85-1bc382549ca7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:59.082554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef1e5b-705b-4898-8261-b5be5e4314ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:59.083253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef1e5b-705b-4898-8261-b5be5e4314ca admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:59.083533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef1e5b-705b-4898-8261-b5be5e4314ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:59.083842 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef1e5b-705b-4898-8261-b5be5e4314ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:59.084894 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef1e5b-705b-4898-8261-b5be5e4314ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:59.087013 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef1e5b-705b-4898-8261-b5be5e4314ca admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:59.123278 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 886/1771] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:59.127669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66431e-1c3e-45bf-aaa7-43fc97859be9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:59.130959 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66431e-1c3e-45bf-aaa7-43fc97859be9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:59.133005 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66431e-1c3e-45bf-aaa7-43fc97859be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:59.167417 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:34:59.176290 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-da66431e-1c3e-45bf-aaa7-43fc97859be9 None None] MFA Rules not processed for user `3caa3dbc7bd24ebba28296a1eba9cefe`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:34:59.179218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-da66431e-1c3e-45bf-aaa7-43fc97859be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:34:59.325495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 886/1772] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:34:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:59.326674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e097573-f4bf-48f7-b350-065cd1eea3f9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:59.379037 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 887/1773] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 16:34:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:34:59.380437 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e097573-f4bf-48f7-b350-065cd1eea3f9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:59.403678 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef9aa4-c6c0-43c4-9c92-b14dd1e15143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:59.404795 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef9aa4-c6c0-43c4-9c92-b14dd1e15143 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:59.405171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef9aa4-c6c0-43c4-9c92-b14dd1e15143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:59.405559 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef9aa4-c6c0-43c4-9c92-b14dd1e15143 admin admin] PATH_INFO: `/v3/projects/84845ae4e7f84e729deaf0b63568632d/users/b5d875574a5d483db34eab21e0b33b66/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:59.457326 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef9aa4-c6c0-43c4-9c92-b14dd1e15143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84845ae4e7f84e729deaf0b63568632d, user_id=b5d875574a5d483db34eab21e0b33b66, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:59.460127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef9aa4-c6c0-43c4-9c92-b14dd1e15143 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:59.494035 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 887/1774] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:59 2022] PUT /identity/v3/projects/84845ae4e7f84e729deaf0b63568632d/users/b5d875574a5d483db34eab21e0b33b66/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:34:59.495216 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66431e-1c3e-45bf-aaa7-43fc97859be9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:59.530825 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66431e-1c3e-45bf-aaa7-43fc97859be9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:59.771524 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360ce9c-5970-4baf-9489-2a954fbfb245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:59.772455 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360ce9c-5970-4baf-9489-2a954fbfb245 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:59.772911 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360ce9c-5970-4baf-9489-2a954fbfb245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:59.773406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360ce9c-5970-4baf-9489-2a954fbfb245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:59.782805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360ce9c-5970-4baf-9489-2a954fbfb245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:59.784851 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360ce9c-5970-4baf-9489-2a954fbfb245 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:59.821955 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 888/1775] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:34:59.828160 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef9aa4-c6c0-43c4-9c92-b14dd1e15143 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:34:59.863191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef9aa4-c6c0-43c4-9c92-b14dd1e15143 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:34:59.896913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1af39-0c4d-41c2-95a5-a16947097275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:34:59.899126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1af39-0c4d-41c2-95a5-a16947097275 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:34:59.902657 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1af39-0c4d-41c2-95a5-a16947097275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:34:59.903149 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1af39-0c4d-41c2-95a5-a16947097275 admin admin] PATH_INFO: `/v3/projects/84845ae4e7f84e729deaf0b63568632d/users/b5d875574a5d483db34eab21e0b33b66/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:34:59.907174 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1af39-0c4d-41c2-95a5-a16947097275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84845ae4e7f84e729deaf0b63568632d, user_id=b5d875574a5d483db34eab21e0b33b66, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:34:59.910221 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1af39-0c4d-41c2-95a5-a16947097275 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:34:59.953689 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 888/1776] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:34:59 2022] PUT /identity/v3/projects/84845ae4e7f84e729deaf0b63568632d/users/b5d875574a5d483db34eab21e0b33b66/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:02.732186 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360ce9c-5970-4baf-9489-2a954fbfb245 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:02.735570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8360ce9c-5970-4baf-9489-2a954fbfb245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:02.772429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:02.939357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360ce9c-5970-4baf-9489-2a954fbfb245 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:03.025443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaae793-dd99-4b25-b0a4-1f92c8a56052 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:03.026441 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaae793-dd99-4b25-b0a4-1f92c8a56052 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:03.027166 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaae793-dd99-4b25-b0a4-1f92c8a56052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:03.097365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228fc98-cb13-4595-83ab-ff3185186f1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:03.098058 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228fc98-cb13-4595-83ab-ff3185186f1c service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:03.098341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228fc98-cb13-4595-83ab-ff3185186f1c service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:03.098798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228fc98-cb13-4595-83ab-ff3185186f1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:03.120353 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228fc98-cb13-4595-83ab-ff3185186f1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:03.122038 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228fc98-cb13-4595-83ab-ff3185186f1c service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:03.162941 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 889/1777] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:03.195049 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-cdaae793-dd99-4b25-b0a4-1f92c8a56052 None None] MFA Rules not processed for user `b5d875574a5d483db34eab21e0b33b66`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:03.198304 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cdaae793-dd99-4b25-b0a4-1f92c8a56052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:03.451897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 889/1778] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:03 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:04.047183 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228fc98-cb13-4595-83ab-ff3185186f1c service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:04.195752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228fc98-cb13-4595-83ab-ff3185186f1c service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:04.208729 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aaf515-effc-4850-8ddc-81c623579a93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:04.210169 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aaf515-effc-4850-8ddc-81c623579a93 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:04.214400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aaf515-effc-4850-8ddc-81c623579a93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:04.216871 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aaf515-effc-4850-8ddc-81c623579a93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:04.429580 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:04.486986 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aaf515-effc-4850-8ddc-81c623579a93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:04.494739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aaf515-effc-4850-8ddc-81c623579a93 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:04.530261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 890/1779] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:35:07.046046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e6b77-e854-48b2-9fb7-db6593ae638b None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:07.046810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e6b77-e854-48b2-9fb7-db6593ae638b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:07.046810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e6b77-e854-48b2-9fb7-db6593ae638b None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:07.052418 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 890/1780] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 16:35:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:35:07.090833 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2120e7b-c8bc-4f47-8e67-dd3576ae912c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:07.090833 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2120e7b-c8bc-4f47-8e67-dd3576ae912c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:07.090833 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2120e7b-c8bc-4f47-8e67-dd3576ae912c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:07.129808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d2120e7b-c8bc-4f47-8e67-dd3576ae912c None None] MFA Rules not processed for user `1266a87d93da4f8d9a1ccafa03067169`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:07.131144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d2120e7b-c8bc-4f47-8e67-dd3576ae912c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:07.342215 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 891/1781] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 16:35:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:07.374890 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e6b77-e854-48b2-9fb7-db6593ae638b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:07.376786 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2c9e6b77-e854-48b2-9fb7-db6593ae638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:07.438465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e6b77-e854-48b2-9fb7-db6593ae638b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:07.454868 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed943263-8b6b-4c93-b386-571f6cf6b5ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1266a87d93da4f8d9a1ccafa03067169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:07.456087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed943263-8b6b-4c93-b386-571f6cf6b5ef service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:07.456589 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed943263-8b6b-4c93-b386-571f6cf6b5ef service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:07.457079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed943263-8b6b-4c93-b386-571f6cf6b5ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:07.508255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed943263-8b6b-4c93-b386-571f6cf6b5ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:07.515626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed943263-8b6b-4c93-b386-571f6cf6b5ef service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:07.598216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 891/1782] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:09.003361 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a122cad-b9a9-4fb7-bd3b-da6c86231354 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:09.004174 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a122cad-b9a9-4fb7-bd3b-da6c86231354 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:09.004174 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a122cad-b9a9-4fb7-bd3b-da6c86231354 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:09.007264 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 892/1783] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 16:35:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:35:09.090203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0752a8e-5291-43c6-99af-9cfb8105fb47 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:09.091246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0752a8e-5291-43c6-99af-9cfb8105fb47 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:09.092992 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0752a8e-5291-43c6-99af-9cfb8105fb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:09.160659 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e0752a8e-5291-43c6-99af-9cfb8105fb47 None None] MFA Rules not processed for user `1266a87d93da4f8d9a1ccafa03067169`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:09.162474 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e0752a8e-5291-43c6-99af-9cfb8105fb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:09.180833 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 892/1784] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 16:35:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:09.219017 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa24d9-ea72-4123-ac59-f776a892a51a None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:09.219473 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa24d9-ea72-4123-ac59-f776a892a51a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:09.219789 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa24d9-ea72-4123-ac59-f776a892a51a None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:09.221594 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 893/1785] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 16:35:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:35:09.233696 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ea332-c3f5-48b8-8b87-bd698b581081 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:09.233998 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ea332-c3f5-48b8-8b87-bd698b581081 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:09.234487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ea332-c3f5-48b8-8b87-bd698b581081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:09.315829 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c14ea332-c3f5-48b8-8b87-bd698b581081 None None] MFA Rules not processed for user `3caa3dbc7bd24ebba28296a1eba9cefe`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:09.318679 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c14ea332-c3f5-48b8-8b87-bd698b581081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:09.338766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa24d9-ea72-4123-ac59-f776a892a51a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:09.356555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 893/1786] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 16:35:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:09.394448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa24d9-ea72-4123-ac59-f776a892a51a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:09.416813 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d754f1-8b4c-470a-afd4-84f01bbb9594 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1266a87d93da4f8d9a1ccafa03067169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:09.418071 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d754f1-8b4c-470a-afd4-84f01bbb9594 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:09.418623 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d754f1-8b4c-470a-afd4-84f01bbb9594 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:09.419041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d754f1-8b4c-470a-afd4-84f01bbb9594 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:09.460199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d754f1-8b4c-470a-afd4-84f01bbb9594 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:09.469666 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d754f1-8b4c-470a-afd4-84f01bbb9594 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:09.520782 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 894/1787] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:35:09.619549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ea332-c3f5-48b8-8b87-bd698b581081 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:09.826080 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:09.830224 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803a664-a485-40d0-9882-48db962ec851 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:09.835145 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ea332-c3f5-48b8-8b87-bd698b581081 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:09.836586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803a664-a485-40d0-9882-48db962ec851 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:09.838130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803a664-a485-40d0-9882-48db962ec851 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:09.846606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 895/1788] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 16:35:09 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:35:09.858373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69240e-1121-4ea8-a74b-872f1c86d530 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:09.858858 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69240e-1121-4ea8-a74b-872f1c86d530 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:09.859385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69240e-1121-4ea8-a74b-872f1c86d530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:09.876196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b642df-8f1c-4efb-bbe1-191a11444f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:09.883099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b642df-8f1c-4efb-bbe1-191a11444f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:09.883544 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b642df-8f1c-4efb-bbe1-191a11444f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:09.884393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b642df-8f1c-4efb-bbe1-191a11444f07 admin admin] PATH_INFO: `/v3/users/65c2f42b9884441198ae5fe0087e373e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:09.889868 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b642df-8f1c-4efb-bbe1-191a11444f07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65c2f42b9884441198ae5fe0087e373e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:09.892948 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b642df-8f1c-4efb-bbe1-191a11444f07 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:09.961922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6b69240e-1121-4ea8-a74b-872f1c86d530 None None] MFA Rules not processed for user `3caa3dbc7bd24ebba28296a1eba9cefe`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:09.973523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6b69240e-1121-4ea8-a74b-872f1c86d530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:10.025289 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 896/1789] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 16:35:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:10.026990 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69240e-1121-4ea8-a74b-872f1c86d530 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:10.039206 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-26b642df-8f1c-4efb-bbe1-191a11444f07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65c2f42b9884441198ae5fe0087e373e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:10.070873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-26b642df-8f1c-4efb-bbe1-191a11444f07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65c2f42b9884441198ae5fe0087e373e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:10.071496 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69240e-1121-4ea8-a74b-872f1c86d530 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:10.103280 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac168d7-f2d6-4c23-963e-5e954b601bc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:10.104335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac168d7-f2d6-4c23-963e-5e954b601bc4 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:10.105240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac168d7-f2d6-4c23-963e-5e954b601bc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:10.106833 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac168d7-f2d6-4c23-963e-5e954b601bc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:10.118592 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-26b642df-8f1c-4efb-bbe1-191a11444f07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65c2f42b9884441198ae5fe0087e373e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:10.136353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-26b642df-8f1c-4efb-bbe1-191a11444f07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65c2f42b9884441198ae5fe0087e373e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:10.139524 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-26b642df-8f1c-4efb-bbe1-191a11444f07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65c2f42b9884441198ae5fe0087e373e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:10.149302 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac168d7-f2d6-4c23-963e-5e954b601bc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:10.151031 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac168d7-f2d6-4c23-963e-5e954b601bc4 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:10.153222 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 894/1790] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:09 2022] DELETE /identity/v3/users/65c2f42b9884441198ae5fe0087e373e => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:10.173798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 897/1791] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:10.823107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b642df-8f1c-4efb-bbe1-191a11444f07 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:10.825794 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-26b642df-8f1c-4efb-bbe1-191a11444f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:11.026673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b642df-8f1c-4efb-bbe1-191a11444f07 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:11.049396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac168d7-f2d6-4c23-963e-5e954b601bc4 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:11.058827 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334f0c3-7d16-4aa0-a9b8-d63325a117e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:11.060179 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f0c3-7d16-4aa0-a9b8-d63325a117e3 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:11.060676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f0c3-7d16-4aa0-a9b8-d63325a117e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:11.061130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334f0c3-7d16-4aa0-a9b8-d63325a117e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:11.064923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f334f0c3-7d16-4aa0-a9b8-d63325a117e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:11.092105 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac168d7-f2d6-4c23-963e-5e954b601bc4 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:11.098488 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334f0c3-7d16-4aa0-a9b8-d63325a117e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:11.103425 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334f0c3-7d16-4aa0-a9b8-d63325a117e3 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:11.127485 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 895/1792] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:35:11.242177 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a52c9a-22f3-4a1b-a444-d2030e5c6d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:11.244748 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a52c9a-22f3-4a1b-a444-d2030e5c6d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:11.247212 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a52c9a-22f3-4a1b-a444-d2030e5c6d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:11.247711 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a52c9a-22f3-4a1b-a444-d2030e5c6d96 admin admin] PATH_INFO: `/v3/users/83caeb8e66e4439bb0beda4493eba0ab` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:11.249550 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a52c9a-22f3-4a1b-a444-d2030e5c6d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83caeb8e66e4439bb0beda4493eba0ab)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:11.259153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a52c9a-22f3-4a1b-a444-d2030e5c6d96 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:11.362298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-08a52c9a-22f3-4a1b-a444-d2030e5c6d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83caeb8e66e4439bb0beda4493eba0ab'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:11.363252 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-08a52c9a-22f3-4a1b-a444-d2030e5c6d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83caeb8e66e4439bb0beda4493eba0ab'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:11.364088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-08a52c9a-22f3-4a1b-a444-d2030e5c6d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83caeb8e66e4439bb0beda4493eba0ab'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:11.367402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:11.383719 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-08a52c9a-22f3-4a1b-a444-d2030e5c6d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83caeb8e66e4439bb0beda4493eba0ab'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:11.395914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-08a52c9a-22f3-4a1b-a444-d2030e5c6d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83caeb8e66e4439bb0beda4493eba0ab'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:11.422387 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334f0c3-7d16-4aa0-a9b8-d63325a117e3 service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:11.424393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f334f0c3-7d16-4aa0-a9b8-d63325a117e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:11.442122 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 898/1793] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:11 2022] DELETE /identity/v3/users/83caeb8e66e4439bb0beda4493eba0ab => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:11.448750 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d409a13-42e5-491e-b799-af3cf09f5620 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:11.449055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d409a13-42e5-491e-b799-af3cf09f5620 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:11.451732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d409a13-42e5-491e-b799-af3cf09f5620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:11.452793 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334f0c3-7d16-4aa0-a9b8-d63325a117e3 service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:11.513229 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1d409a13-42e5-491e-b799-af3cf09f5620 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:11.514809 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1d409a13-42e5-491e-b799-af3cf09f5620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:11.552411 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5ac31-3241-4f20-9bd7-8116c3dcffc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:11.556281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5ac31-3241-4f20-9bd7-8116c3dcffc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:11.556578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5ac31-3241-4f20-9bd7-8116c3dcffc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:11.556862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5ac31-3241-4f20-9bd7-8116c3dcffc5 admin admin] PATH_INFO: `/v3/projects/a1fa2f4e2565432383cb03b0039c80dd` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:11.559466 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5ac31-3241-4f20-9bd7-8116c3dcffc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1fa2f4e2565432383cb03b0039c80dd)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:11.561429 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec5ac31-3241-4f20-9bd7-8116c3dcffc5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:11.564860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:11.631771 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 899/1794] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:11.633466 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d409a13-42e5-491e-b799-af3cf09f5620 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:11.635971 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1d409a13-42e5-491e-b799-af3cf09f5620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:11.651592 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d409a13-42e5-491e-b799-af3cf09f5620 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:11.654291 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-dec5ac31-3241-4f20-9bd7-8116c3dcffc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1fa2f4e2565432383cb03b0039c80dd', 'request_id': 'req-dec5ac31-3241-4f20-9bd7-8116c3dcffc5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:11.665913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-dec5ac31-3241-4f20-9bd7-8116c3dcffc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1fa2f4e2565432383cb03b0039c80dd', 'request_id': 'req-dec5ac31-3241-4f20-9bd7-8116c3dcffc5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:11.687619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-dec5ac31-3241-4f20-9bd7-8116c3dcffc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1fa2f4e2565432383cb03b0039c80dd', 'request_id': 'req-dec5ac31-3241-4f20-9bd7-8116c3dcffc5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:11.711927 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-dec5ac31-3241-4f20-9bd7-8116c3dcffc5 admin admin] The token cache is being invalidate because project a1fa2f4e2565432383cb03b0039c80dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:11.712176 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-dec5ac31-3241-4f20-9bd7-8116c3dcffc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:11.713316 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-dec5ac31-3241-4f20-9bd7-8116c3dcffc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:11.716665 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 896/1795] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:11 2022] DELETE /identity/v3/projects/a1fa2f4e2565432383cb03b0039c80dd => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:11.721470 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5ac31-3241-4f20-9bd7-8116c3dcffc5 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:11.724133 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-dec5ac31-3241-4f20-9bd7-8116c3dcffc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:11.741642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c687818-f1e6-4724-9a05-4488be15fd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:11.742611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c687818-f1e6-4724-9a05-4488be15fd8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:11.742894 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c687818-f1e6-4724-9a05-4488be15fd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:11.743168 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c687818-f1e6-4724-9a05-4488be15fd8c admin admin] PATH_INFO: `/v3/users/e1d95e4a54c649c8b6ef9477405c6557` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:11.744640 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c687818-f1e6-4724-9a05-4488be15fd8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1d95e4a54c649c8b6ef9477405c6557)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:11.746852 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c687818-f1e6-4724-9a05-4488be15fd8c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:11.835248 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c687818-f1e6-4724-9a05-4488be15fd8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1d95e4a54c649c8b6ef9477405c6557'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:11.835954 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c687818-f1e6-4724-9a05-4488be15fd8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1d95e4a54c649c8b6ef9477405c6557'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:11.836765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c687818-f1e6-4724-9a05-4488be15fd8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1d95e4a54c649c8b6ef9477405c6557'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:11.851825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5ac31-3241-4f20-9bd7-8116c3dcffc5 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:11.859173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd65bc0-604c-476b-b07f-117b6aa7ee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:11.860470 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd65bc0-604c-476b-b07f-117b6aa7ee0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:11.860914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd65bc0-604c-476b-b07f-117b6aa7ee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:11.861367 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd65bc0-604c-476b-b07f-117b6aa7ee0f admin admin] PATH_INFO: `/v3/users/b5d875574a5d483db34eab21e0b33b66` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:11.864864 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd65bc0-604c-476b-b07f-117b6aa7ee0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5d875574a5d483db34eab21e0b33b66)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:11.865967 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c687818-f1e6-4724-9a05-4488be15fd8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1d95e4a54c649c8b6ef9477405c6557'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:11.868366 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd65bc0-604c-476b-b07f-117b6aa7ee0f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:11.876046 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:11.880532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c687818-f1e6-4724-9a05-4488be15fd8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1d95e4a54c649c8b6ef9477405c6557'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:11.927487 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 900/1796] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:11 2022] DELETE /identity/v3/users/e1d95e4a54c649c8b6ef9477405c6557 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:11.928787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c687818-f1e6-4724-9a05-4488be15fd8c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:11.930866 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6c687818-f1e6-4724-9a05-4488be15fd8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:11.962304 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-dcd65bc0-604c-476b-b07f-117b6aa7ee0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5d875574a5d483db34eab21e0b33b66'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:11.979414 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-dcd65bc0-604c-476b-b07f-117b6aa7ee0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5d875574a5d483db34eab21e0b33b66'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:12.013016 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-dcd65bc0-604c-476b-b07f-117b6aa7ee0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5d875574a5d483db34eab21e0b33b66'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:12.025397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-dcd65bc0-604c-476b-b07f-117b6aa7ee0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5d875574a5d483db34eab21e0b33b66'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:12.026432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-dcd65bc0-604c-476b-b07f-117b6aa7ee0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5d875574a5d483db34eab21e0b33b66'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:12.038996 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 897/1797] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:11 2022] DELETE /identity/v3/users/b5d875574a5d483db34eab21e0b33b66 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:12.045031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91fc42-cb4a-4054-96f0-b312f4aa37ca None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:12.045031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91fc42-cb4a-4054-96f0-b312f4aa37ca None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:12.045031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91fc42-cb4a-4054-96f0-b312f4aa37ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:12.073950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ff91fc42-cb4a-4054-96f0-b312f4aa37ca None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:12.077213 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ff91fc42-cb4a-4054-96f0-b312f4aa37ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:12.084081 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:12.088514 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c687818-f1e6-4724-9a05-4488be15fd8c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:12.180933 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be374587-9610-4760-969d-7922feda3f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:12.181257 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be374587-9610-4760-969d-7922feda3f44 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:12.181794 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be374587-9610-4760-969d-7922feda3f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:12.182094 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be374587-9610-4760-969d-7922feda3f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:12.184478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-be374587-9610-4760-969d-7922feda3f44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:12.200898 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 898/1798] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:12.228455 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91fc42-cb4a-4054-96f0-b312f4aa37ca None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:12.230301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ff91fc42-cb4a-4054-96f0-b312f4aa37ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:12.256977 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91fc42-cb4a-4054-96f0-b312f4aa37ca None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:12.265143 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87306e0e-39c2-450c-8f36-f37808b1be25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:12.267582 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87306e0e-39c2-450c-8f36-f37808b1be25 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:12.268467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87306e0e-39c2-450c-8f36-f37808b1be25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:12.269181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87306e0e-39c2-450c-8f36-f37808b1be25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:12.301549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87306e0e-39c2-450c-8f36-f37808b1be25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:12.306639 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87306e0e-39c2-450c-8f36-f37808b1be25 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:12.309097 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be374587-9610-4760-969d-7922feda3f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:12.325885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be374587-9610-4760-969d-7922feda3f44 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:12.330339 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 899/1799] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:35:12.341889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 901/1800] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:14.158173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87306e0e-39c2-450c-8f36-f37808b1be25 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:14.159597 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-87306e0e-39c2-450c-8f36-f37808b1be25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:14.177673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87306e0e-39c2-450c-8f36-f37808b1be25 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:14.189250 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31146274-1e86-4db5-aa63-22b907b3ba35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:14.192590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31146274-1e86-4db5-aa63-22b907b3ba35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:14.193259 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31146274-1e86-4db5-aa63-22b907b3ba35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:14.193970 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31146274-1e86-4db5-aa63-22b907b3ba35 admin admin] PATH_INFO: `/v3/projects/2c44e33a814d4043b03753b1e31cdfa3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:14.196043 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31146274-1e86-4db5-aa63-22b907b3ba35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c44e33a814d4043b03753b1e31cdfa3)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:14.200162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31146274-1e86-4db5-aa63-22b907b3ba35 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:14.301817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-31146274-1e86-4db5-aa63-22b907b3ba35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c44e33a814d4043b03753b1e31cdfa3', 'request_id': 'req-31146274-1e86-4db5-aa63-22b907b3ba35'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:14.310700 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-31146274-1e86-4db5-aa63-22b907b3ba35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c44e33a814d4043b03753b1e31cdfa3', 'request_id': 'req-31146274-1e86-4db5-aa63-22b907b3ba35'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:14.323640 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-31146274-1e86-4db5-aa63-22b907b3ba35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c44e33a814d4043b03753b1e31cdfa3', 'request_id': 'req-31146274-1e86-4db5-aa63-22b907b3ba35'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:14.345210 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-31146274-1e86-4db5-aa63-22b907b3ba35 admin admin] The token cache is being invalidate because project 2c44e33a814d4043b03753b1e31cdfa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:14.345891 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-31146274-1e86-4db5-aa63-22b907b3ba35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:14.349879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-31146274-1e86-4db5-aa63-22b907b3ba35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:14.353911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 900/1801] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:14 2022] DELETE /identity/v3/projects/2c44e33a814d4043b03753b1e31cdfa3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:14.359163 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be374587-9610-4760-969d-7922feda3f44 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:14.375861 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be374587-9610-4760-969d-7922feda3f44 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:14.394679 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31146274-1e86-4db5-aa63-22b907b3ba35 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:14.397738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-31146274-1e86-4db5-aa63-22b907b3ba35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:14.505881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:14.540498 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac21999-8f51-41f9-9ca6-7eb3afdb9286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:14.541431 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac21999-8f51-41f9-9ca6-7eb3afdb9286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:14.541716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac21999-8f51-41f9-9ca6-7eb3afdb9286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:14.541991 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac21999-8f51-41f9-9ca6-7eb3afdb9286 admin admin] PATH_INFO: `/v3/users/4ee0e930e2544972a4ad631e7b4058e2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:14.545189 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac21999-8f51-41f9-9ca6-7eb3afdb9286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee0e930e2544972a4ad631e7b4058e2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:14.547177 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac21999-8f51-41f9-9ca6-7eb3afdb9286 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:14.558127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31146274-1e86-4db5-aa63-22b907b3ba35 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:14.567580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa4146-54b6-4fde-ba2b-5340ce1e3cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:14.570343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa4146-54b6-4fde-ba2b-5340ce1e3cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:14.570818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa4146-54b6-4fde-ba2b-5340ce1e3cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:14.571594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa4146-54b6-4fde-ba2b-5340ce1e3cd5 admin admin] PATH_INFO: `/v3/projects/84845ae4e7f84e729deaf0b63568632d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:14.575587 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa4146-54b6-4fde-ba2b-5340ce1e3cd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84845ae4e7f84e729deaf0b63568632d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:14.580261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa4146-54b6-4fde-ba2b-5340ce1e3cd5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:14.636402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:14.673055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7ac21999-8f51-41f9-9ca6-7eb3afdb9286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee0e930e2544972a4ad631e7b4058e2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:14.674036 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7ac21999-8f51-41f9-9ca6-7eb3afdb9286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee0e930e2544972a4ad631e7b4058e2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:14.674760 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-05fa4146-54b6-4fde-ba2b-5340ce1e3cd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84845ae4e7f84e729deaf0b63568632d', 'request_id': 'req-05fa4146-54b6-4fde-ba2b-5340ce1e3cd5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:14.675936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7ac21999-8f51-41f9-9ca6-7eb3afdb9286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee0e930e2544972a4ad631e7b4058e2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:14.683969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-05fa4146-54b6-4fde-ba2b-5340ce1e3cd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84845ae4e7f84e729deaf0b63568632d', 'request_id': 'req-05fa4146-54b6-4fde-ba2b-5340ce1e3cd5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:14.700987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-05fa4146-54b6-4fde-ba2b-5340ce1e3cd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84845ae4e7f84e729deaf0b63568632d', 'request_id': 'req-05fa4146-54b6-4fde-ba2b-5340ce1e3cd5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:14.710242 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7ac21999-8f51-41f9-9ca6-7eb3afdb9286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee0e930e2544972a4ad631e7b4058e2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:14.719820 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-05fa4146-54b6-4fde-ba2b-5340ce1e3cd5 admin admin] The token cache is being invalidate because project 84845ae4e7f84e729deaf0b63568632d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:14.721096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-05fa4146-54b6-4fde-ba2b-5340ce1e3cd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:14.722209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-05fa4146-54b6-4fde-ba2b-5340ce1e3cd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:14.724608 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 901/1802] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:14 2022] DELETE /identity/v3/projects/84845ae4e7f84e729deaf0b63568632d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:14.734180 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53285b25-f318-4a88-8d9c-ce3d81f2ab34 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:14.734713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53285b25-f318-4a88-8d9c-ce3d81f2ab34 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:14.734954 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53285b25-f318-4a88-8d9c-ce3d81f2ab34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:14.739988 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7ac21999-8f51-41f9-9ca6-7eb3afdb9286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee0e930e2544972a4ad631e7b4058e2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:14.779303 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 902/1803] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:14 2022] DELETE /identity/v3/users/4ee0e930e2544972a4ad631e7b4058e2 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:14.791085 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-53285b25-f318-4a88-8d9c-ce3d81f2ab34 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:14.794701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-53285b25-f318-4a88-8d9c-ce3d81f2ab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:14.970670 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac21999-8f51-41f9-9ca6-7eb3afdb9286 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:14.973659 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7ac21999-8f51-41f9-9ca6-7eb3afdb9286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:15.001602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 902/1804] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:15.018247 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc68e3-7bd8-4224-a811-19ab7f12d4f1 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:15.018567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc68e3-7bd8-4224-a811-19ab7f12d4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:15.019119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc68e3-7bd8-4224-a811-19ab7f12d4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:15.088104 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-debc68e3-7bd8-4224-a811-19ab7f12d4f1 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:15.090745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-debc68e3-7bd8-4224-a811-19ab7f12d4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:15.125640 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 903/1805] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:15.131179 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac21999-8f51-41f9-9ca6-7eb3afdb9286 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:15.135699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc68e3-7bd8-4224-a811-19ab7f12d4f1 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:15.137380 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246eec67-131d-4c07-948c-a98cbb43ed53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:15.138377 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246eec67-131d-4c07-948c-a98cbb43ed53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:15.138815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246eec67-131d-4c07-948c-a98cbb43ed53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:15.139186 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246eec67-131d-4c07-948c-a98cbb43ed53 admin admin] PATH_INFO: `/v3/projects/4c553e44bf18441cbc5babe21b1991d6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:15.140553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246eec67-131d-4c07-948c-a98cbb43ed53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c553e44bf18441cbc5babe21b1991d6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:15.143018 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246eec67-131d-4c07-948c-a98cbb43ed53 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:15.182526 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc68e3-7bd8-4224-a811-19ab7f12d4f1 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:15.210216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef6b81-7c42-488d-8900-b8ac47c653b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:15.212222 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef6b81-7c42-488d-8900-b8ac47c653b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:15.212222 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef6b81-7c42-488d-8900-b8ac47c653b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:15.212222 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef6b81-7c42-488d-8900-b8ac47c653b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:15.214103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef6b81-7c42-488d-8900-b8ac47c653b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:15.214103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef6b81-7c42-488d-8900-b8ac47c653b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:15.221545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef6b81-7c42-488d-8900-b8ac47c653b3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:15.294921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-246eec67-131d-4c07-948c-a98cbb43ed53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c553e44bf18441cbc5babe21b1991d6', 'request_id': 'req-246eec67-131d-4c07-948c-a98cbb43ed53'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:15.299300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 904/1806] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:35:15.326967 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef6b81-7c42-488d-8900-b8ac47c653b3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:15.328525 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-246eec67-131d-4c07-948c-a98cbb43ed53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c553e44bf18441cbc5babe21b1991d6', 'request_id': 'req-246eec67-131d-4c07-948c-a98cbb43ed53'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:15.338759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-246eec67-131d-4c07-948c-a98cbb43ed53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c553e44bf18441cbc5babe21b1991d6', 'request_id': 'req-246eec67-131d-4c07-948c-a98cbb43ed53'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:15.370700 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-246eec67-131d-4c07-948c-a98cbb43ed53 admin admin] The token cache is being invalidate because project 4c553e44bf18441cbc5babe21b1991d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:15.371646 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-246eec67-131d-4c07-948c-a98cbb43ed53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:15.372074 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-246eec67-131d-4c07-948c-a98cbb43ed53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:15.385350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef6b81-7c42-488d-8900-b8ac47c653b3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:15.387817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 903/1807] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:14 2022] DELETE /identity/v3/projects/4c553e44bf18441cbc5babe21b1991d6 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:15.393201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246eec67-131d-4c07-948c-a98cbb43ed53 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:15.396513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-246eec67-131d-4c07-948c-a98cbb43ed53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:15.402500 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:15.540309 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246eec67-131d-4c07-948c-a98cbb43ed53 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:15.546806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440572e-15b6-4dbe-84f0-2e2346e82b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:15.549458 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440572e-15b6-4dbe-84f0-2e2346e82b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:15.549859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440572e-15b6-4dbe-84f0-2e2346e82b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:15.550231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440572e-15b6-4dbe-84f0-2e2346e82b1a admin admin] PATH_INFO: `/v3/users/1bb52534cc5d45b4bad34aed498c7d3c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:15.553104 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440572e-15b6-4dbe-84f0-2e2346e82b1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb52534cc5d45b4bad34aed498c7d3c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:15.555095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440572e-15b6-4dbe-84f0-2e2346e82b1a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:15.571718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f6eae-b1c4-4316-9082-67ebe5aa123d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:15.572467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f6eae-b1c4-4316-9082-67ebe5aa123d admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:15.572749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f6eae-b1c4-4316-9082-67ebe5aa123d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:15.573025 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f6eae-b1c4-4316-9082-67ebe5aa123d admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:15.573747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f6eae-b1c4-4316-9082-67ebe5aa123d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:15.581919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f6eae-b1c4-4316-9082-67ebe5aa123d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:15.629179 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6440572e-15b6-4dbe-84f0-2e2346e82b1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb52534cc5d45b4bad34aed498c7d3c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:15.630866 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6440572e-15b6-4dbe-84f0-2e2346e82b1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb52534cc5d45b4bad34aed498c7d3c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:15.633350 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6440572e-15b6-4dbe-84f0-2e2346e82b1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb52534cc5d45b4bad34aed498c7d3c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:15.655833 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6440572e-15b6-4dbe-84f0-2e2346e82b1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb52534cc5d45b4bad34aed498c7d3c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:15.667088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6440572e-15b6-4dbe-84f0-2e2346e82b1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb52534cc5d45b4bad34aed498c7d3c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:15.700763 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 905/1808] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:15 2022] POST /identity/v3/projects => generated 365 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:15.702328 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f6eae-b1c4-4316-9082-67ebe5aa123d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:15.705424 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 904/1809] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:15 2022] DELETE /identity/v3/users/1bb52534cc5d45b4bad34aed498c7d3c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:15.710411 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5c0f6eae-b1c4-4316-9082-67ebe5aa123d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:15.761622 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:15.864957 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f6eae-b1c4-4316-9082-67ebe5aa123d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:16.070208 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d0ab0-5ca7-428c-9200-35cfa310f6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:16.070425 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d0ab0-5ca7-428c-9200-35cfa310f6f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:16.070703 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d0ab0-5ca7-428c-9200-35cfa310f6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:16.070982 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d0ab0-5ca7-428c-9200-35cfa310f6f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:16.071710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d0ab0-5ca7-428c-9200-35cfa310f6f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:16.076261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d0ab0-5ca7-428c-9200-35cfa310f6f6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:16.154359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440572e-15b6-4dbe-84f0-2e2346e82b1a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:16.155701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6440572e-15b6-4dbe-84f0-2e2346e82b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:16.170326 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 906/1810] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:15 2022] POST /identity/v3/users => generated 283 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:35:16.173573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d0ab0-5ca7-428c-9200-35cfa310f6f6 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:16.188084 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440572e-15b6-4dbe-84f0-2e2346e82b1a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:16.221597 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1c4fb-a92c-410c-a466-f9caa0b48837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:16.230428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1c4fb-a92c-410c-a466-f9caa0b48837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:16.230859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1c4fb-a92c-410c-a466-f9caa0b48837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:16.231249 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1c4fb-a92c-410c-a466-f9caa0b48837 admin admin] PATH_INFO: `/v3/projects/050a3440c69d46c6a270eb1f9a4a79ac` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:16.234242 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1c4fb-a92c-410c-a466-f9caa0b48837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=050a3440c69d46c6a270eb1f9a4a79ac)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:16.245276 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1c4fb-a92c-410c-a466-f9caa0b48837 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:16.246747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d0ab0-5ca7-428c-9200-35cfa310f6f6 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:16.268366 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6858122-30d1-4994-b356-cb6e1a1e3fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:16.269089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6858122-30d1-4994-b356-cb6e1a1e3fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:16.269419 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6858122-30d1-4994-b356-cb6e1a1e3fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:16.269699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6858122-30d1-4994-b356-cb6e1a1e3fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:16.270564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6858122-30d1-4994-b356-cb6e1a1e3fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:16.272911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6858122-30d1-4994-b356-cb6e1a1e3fb9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:16.319952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 907/1811] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:16.323631 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6858122-30d1-4994-b356-cb6e1a1e3fb9 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:16.357296 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6858122-30d1-4994-b356-cb6e1a1e3fb9 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:16.368166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9ef1c4fb-a92c-410c-a466-f9caa0b48837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '050a3440c69d46c6a270eb1f9a4a79ac', 'request_id': 'req-9ef1c4fb-a92c-410c-a466-f9caa0b48837'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:16.389695 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9ef1c4fb-a92c-410c-a466-f9caa0b48837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '050a3440c69d46c6a270eb1f9a4a79ac', 'request_id': 'req-9ef1c4fb-a92c-410c-a466-f9caa0b48837'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:16.408823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9ef1c4fb-a92c-410c-a466-f9caa0b48837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '050a3440c69d46c6a270eb1f9a4a79ac', 'request_id': 'req-9ef1c4fb-a92c-410c-a466-f9caa0b48837'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:16.453716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9ef1c4fb-a92c-410c-a466-f9caa0b48837 admin admin] The token cache is being invalidate because project 050a3440c69d46c6a270eb1f9a4a79ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:16.454549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9ef1c4fb-a92c-410c-a466-f9caa0b48837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:16.457824 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9ef1c4fb-a92c-410c-a466-f9caa0b48837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:16.465702 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 905/1812] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:16 2022] DELETE /identity/v3/projects/050a3440c69d46c6a270eb1f9a4a79ac => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:16.474213 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff7cca-2428-4b92-8992-50c92c8599e1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:16.474506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff7cca-2428-4b92-8992-50c92c8599e1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:16.474822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff7cca-2428-4b92-8992-50c92c8599e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:16.493044 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:16.524823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-01ff7cca-2428-4b92-8992-50c92c8599e1 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:16.530567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-01ff7cca-2428-4b92-8992-50c92c8599e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:16.635724 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778373b-a941-4df4-86bf-08fafdb1adba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:16.637429 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778373b-a941-4df4-86bf-08fafdb1adba admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:16.637429 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778373b-a941-4df4-86bf-08fafdb1adba admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:16.637852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778373b-a941-4df4-86bf-08fafdb1adba admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:16.638898 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778373b-a941-4df4-86bf-08fafdb1adba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:16.640241 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 906/1813] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:16.641557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff7cca-2428-4b92-8992-50c92c8599e1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:16.646610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-01ff7cca-2428-4b92-8992-50c92c8599e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:16.670515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778373b-a941-4df4-86bf-08fafdb1adba admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:16.670904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff7cca-2428-4b92-8992-50c92c8599e1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:16.679883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02280a2-624b-4b08-983f-e814daff5c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:16.681366 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02280a2-624b-4b08-983f-e814daff5c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:16.681819 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02280a2-624b-4b08-983f-e814daff5c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:16.682440 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02280a2-624b-4b08-983f-e814daff5c62 admin admin] PATH_INFO: `/v3/projects/086fc1b6e14443b6b55cbe4c3adb6dad` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:16.684638 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02280a2-624b-4b08-983f-e814daff5c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=086fc1b6e14443b6b55cbe4c3adb6dad)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:16.688051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02280a2-624b-4b08-983f-e814daff5c62 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:16.699121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 908/1814] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:16.700733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25603516-fcaa-4300-ac17-23585e7f39ee None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:16.701090 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25603516-fcaa-4300-ac17-23585e7f39ee None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:16.701437 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25603516-fcaa-4300-ac17-23585e7f39ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:16.722561 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-25603516-fcaa-4300-ac17-23585e7f39ee None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:16.723923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-25603516-fcaa-4300-ac17-23585e7f39ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:16.736375 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 909/1815] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:16.739285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25603516-fcaa-4300-ac17-23585e7f39ee None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:16.741941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-25603516-fcaa-4300-ac17-23585e7f39ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:16.757205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25603516-fcaa-4300-ac17-23585e7f39ee None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:16.771363 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b02280a2-624b-4b08-983f-e814daff5c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '086fc1b6e14443b6b55cbe4c3adb6dad', 'request_id': 'req-b02280a2-624b-4b08-983f-e814daff5c62'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:16.784398 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b02280a2-624b-4b08-983f-e814daff5c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '086fc1b6e14443b6b55cbe4c3adb6dad', 'request_id': 'req-b02280a2-624b-4b08-983f-e814daff5c62'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:16.792439 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b02280a2-624b-4b08-983f-e814daff5c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '086fc1b6e14443b6b55cbe4c3adb6dad', 'request_id': 'req-b02280a2-624b-4b08-983f-e814daff5c62'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:16.798466 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:16.805786 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b02280a2-624b-4b08-983f-e814daff5c62 admin admin] The token cache is being invalidate because project 086fc1b6e14443b6b55cbe4c3adb6dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:16.806227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b02280a2-624b-4b08-983f-e814daff5c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:16.806978 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b02280a2-624b-4b08-983f-e814daff5c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:16.808659 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 907/1816] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:16 2022] DELETE /identity/v3/projects/086fc1b6e14443b6b55cbe4c3adb6dad => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:16.809503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02280a2-624b-4b08-983f-e814daff5c62 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:16.811232 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b02280a2-624b-4b08-983f-e814daff5c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:16.841360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b36c52-97df-425f-8e96-c38610994031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:16.842291 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b36c52-97df-425f-8e96-c38610994031 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:16.842577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b36c52-97df-425f-8e96-c38610994031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:16.842864 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b36c52-97df-425f-8e96-c38610994031 admin admin] PATH_INFO: `/v3/projects/915e15277aff454082705de60bee5a1b/users/923428bd86be4ab683839414c4463496/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:16.858935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b36c52-97df-425f-8e96-c38610994031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=915e15277aff454082705de60bee5a1b, user_id=923428bd86be4ab683839414c4463496, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:16.861757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b36c52-97df-425f-8e96-c38610994031 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:16.881628 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 910/1817] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:16 2022] PUT /identity/v3/projects/915e15277aff454082705de60bee5a1b/users/923428bd86be4ab683839414c4463496/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:16.883605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6e472-6317-4381-80b9-2b9f1869f3fb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:16.884000 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6e472-6317-4381-80b9-2b9f1869f3fb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:16.884401 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6e472-6317-4381-80b9-2b9f1869f3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:16.904163 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d8b6e472-6317-4381-80b9-2b9f1869f3fb None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:16.905076 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02280a2-624b-4b08-983f-e814daff5c62 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:16.905771 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d8b6e472-6317-4381-80b9-2b9f1869f3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:16.943146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:16.974047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3d885-32e3-40a8-9222-edc1aa7bfed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:16.974838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3d885-32e3-40a8-9222-edc1aa7bfed8 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:16.975120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3d885-32e3-40a8-9222-edc1aa7bfed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:16.975401 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3d885-32e3-40a8-9222-edc1aa7bfed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:16.976178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3d885-32e3-40a8-9222-edc1aa7bfed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:16.976485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3d885-32e3-40a8-9222-edc1aa7bfed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:16.977369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 911/1818] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:16.978128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3d885-32e3-40a8-9222-edc1aa7bfed8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:16.979593 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024ec1d-66ad-4f5b-afc5-1be2506cdfad None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:16.980117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024ec1d-66ad-4f5b-afc5-1be2506cdfad None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:16.980594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024ec1d-66ad-4f5b-afc5-1be2506cdfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:16.995243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 908/1819] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:35:16.998081 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e619d-8f44-4a27-810d-1307dfecf378 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:16.998618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e619d-8f44-4a27-810d-1307dfecf378 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:16.999063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e619d-8f44-4a27-810d-1307dfecf378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:17.016515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d024ec1d-66ad-4f5b-afc5-1be2506cdfad None None] MFA Rules not processed for user `923428bd86be4ab683839414c4463496`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:17.018076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d024ec1d-66ad-4f5b-afc5-1be2506cdfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:17.027902 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-618e619d-8f44-4a27-810d-1307dfecf378 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:17.030589 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-618e619d-8f44-4a27-810d-1307dfecf378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:17.046401 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 909/1820] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:17.047346 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e619d-8f44-4a27-810d-1307dfecf378 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:17.062915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e619d-8f44-4a27-810d-1307dfecf378 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:17.071587 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9747a-05b2-4d13-8155-ac9014241a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:17.072355 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9747a-05b2-4d13-8155-ac9014241a4b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:17.072757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9747a-05b2-4d13-8155-ac9014241a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:17.072920 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9747a-05b2-4d13-8155-ac9014241a4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:17.074285 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9747a-05b2-4d13-8155-ac9014241a4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:17.076650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9747a-05b2-4d13-8155-ac9014241a4b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:17.104779 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 912/1821] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:17.111685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 910/1822] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:17 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:17.117116 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9747a-05b2-4d13-8155-ac9014241a4b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:17.120192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b2d9747a-05b2-4d13-8155-ac9014241a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:17.122561 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024ec1d-66ad-4f5b-afc5-1be2506cdfad None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:17.144554 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024ec1d-66ad-4f5b-afc5-1be2506cdfad None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:17.203132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9747a-05b2-4d13-8155-ac9014241a4b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:17.208485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e5248-7049-4d46-9239-39991f4c50f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:17.210405 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e5248-7049-4d46-9239-39991f4c50f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:17.210718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e5248-7049-4d46-9239-39991f4c50f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:17.211000 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e5248-7049-4d46-9239-39991f4c50f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:17.211721 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e5248-7049-4d46-9239-39991f4c50f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:17.213957 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e5248-7049-4d46-9239-39991f4c50f3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:17.255703 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 911/1823] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:17 2022] POST /identity/v3/projects => generated 363 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:17.257509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e5248-7049-4d46-9239-39991f4c50f3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:17.276946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:17.320381 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e2294-d610-446a-ab31-558e9b94ca28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:17.322361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e2294-d610-446a-ab31-558e9b94ca28 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:17.323129 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e2294-d610-446a-ab31-558e9b94ca28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:17.323703 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e2294-d610-446a-ab31-558e9b94ca28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:17.326457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e2294-d610-446a-ab31-558e9b94ca28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:17.327740 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e2294-d610-446a-ab31-558e9b94ca28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:17.334603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e2294-d610-446a-ab31-558e9b94ca28 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:17.389165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e5248-7049-4d46-9239-39991f4c50f3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:17.397878 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33912977-6e7a-49f5-9313-694412934f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:17.399424 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33912977-6e7a-49f5-9313-694412934f59 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:17.399830 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33912977-6e7a-49f5-9313-694412934f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:17.400289 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33912977-6e7a-49f5-9313-694412934f59 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:17.401292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 913/1824] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:35:17.401649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33912977-6e7a-49f5-9313-694412934f59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:17.402286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e2294-d610-446a-ab31-558e9b94ca28 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:17.405872 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33912977-6e7a-49f5-9313-694412934f59 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:17.420525 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e2294-d610-446a-ab31-558e9b94ca28 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:17.426847 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc371f10-6a3a-4ddd-87cc-5c10acbbf785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:17.427582 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc371f10-6a3a-4ddd-87cc-5c10acbbf785 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:17.427960 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc371f10-6a3a-4ddd-87cc-5c10acbbf785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:17.428910 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc371f10-6a3a-4ddd-87cc-5c10acbbf785 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:17.439020 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc371f10-6a3a-4ddd-87cc-5c10acbbf785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:17.441112 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc371f10-6a3a-4ddd-87cc-5c10acbbf785 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:17.456848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 912/1825] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:17 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:17.457768 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33912977-6e7a-49f5-9313-694412934f59 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:17.473077 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33912977-6e7a-49f5-9313-694412934f59 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:17.477118 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 914/1826] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:17 2022] POST /identity/v3/users => generated 288 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:17.478096 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b17f45-2de7-447e-a4d4-5128aa203ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:17.478783 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b17f45-2de7-447e-a4d4-5128aa203ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:17.479066 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b17f45-2de7-447e-a4d4-5128aa203ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:17.479169 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc371f10-6a3a-4ddd-87cc-5c10acbbf785 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:17.479348 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b17f45-2de7-447e-a4d4-5128aa203ca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:17.480475 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b17f45-2de7-447e-a4d4-5128aa203ca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:17.482484 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b17f45-2de7-447e-a4d4-5128aa203ca2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:17.495845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc371f10-6a3a-4ddd-87cc-5c10acbbf785 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:17.500468 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:17.504596 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf6c04-0f1c-4222-a827-90433e2904c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:17.505854 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf6c04-0f1c-4222-a827-90433e2904c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:17.506974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf6c04-0f1c-4222-a827-90433e2904c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:17.507446 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf6c04-0f1c-4222-a827-90433e2904c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:17.509281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf6c04-0f1c-4222-a827-90433e2904c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:17.512429 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf6c04-0f1c-4222-a827-90433e2904c6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:17.525191 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 913/1827] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:17 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:17.527394 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b17f45-2de7-447e-a4d4-5128aa203ca2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:17.533089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 915/1828] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:17.545679 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf6c04-0f1c-4222-a827-90433e2904c6 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:17.554236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf6c04-0f1c-4222-a827-90433e2904c6 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:17.645717 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd61cd-bca2-4caa-ade9-3a629239a8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:17.647022 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd61cd-bca2-4caa-ade9-3a629239a8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:17.647323 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd61cd-bca2-4caa-ade9-3a629239a8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:17.648168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd61cd-bca2-4caa-ade9-3a629239a8a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:17.652230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd61cd-bca2-4caa-ade9-3a629239a8a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:17.656650 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd61cd-bca2-4caa-ade9-3a629239a8a2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:17.687713 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b17f45-2de7-447e-a4d4-5128aa203ca2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:17.710258 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3146e03-0fe8-40d0-82ff-961350a8fde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:17.720479 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3146e03-0fe8-40d0-82ff-961350a8fde6 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:17.721427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3146e03-0fe8-40d0-82ff-961350a8fde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:17.721929 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3146e03-0fe8-40d0-82ff-961350a8fde6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:17.723558 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3146e03-0fe8-40d0-82ff-961350a8fde6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:17.727273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3146e03-0fe8-40d0-82ff-961350a8fde6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:17.733259 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 916/1829] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:17 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:17.734429 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd61cd-bca2-4caa-ade9-3a629239a8a2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:17.756669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 914/1830] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:17.756669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3146e03-0fe8-40d0-82ff-961350a8fde6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:17.758853 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd61cd-bca2-4caa-ade9-3a629239a8a2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:17.766446 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94673208-5140-4431-a71e-4980125d6b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:17.768134 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94673208-5140-4431-a71e-4980125d6b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:17.768868 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94673208-5140-4431-a71e-4980125d6b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:17.769577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94673208-5140-4431-a71e-4980125d6b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:17.770825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94673208-5140-4431-a71e-4980125d6b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:17.773174 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94673208-5140-4431-a71e-4980125d6b6e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:17.777643 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3146e03-0fe8-40d0-82ff-961350a8fde6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:17.790307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f59df-3007-4420-a5c8-9ac03013dcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:17.791093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 917/1831] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:17.791792 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f59df-3007-4420-a5c8-9ac03013dcce admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:17.792342 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f59df-3007-4420-a5c8-9ac03013dcce admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:17.792774 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94673208-5140-4431-a71e-4980125d6b6e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:17.794597 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f59df-3007-4420-a5c8-9ac03013dcce admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:17.796696 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f59df-3007-4420-a5c8-9ac03013dcce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:17.800119 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f59df-3007-4420-a5c8-9ac03013dcce admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:17.808306 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94673208-5140-4431-a71e-4980125d6b6e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:17.825835 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970f838-e94c-4638-82d6-d6896e2f55c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:17.828861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970f838-e94c-4638-82d6-d6896e2f55c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:17.829636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970f838-e94c-4638-82d6-d6896e2f55c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:17.829830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970f838-e94c-4638-82d6-d6896e2f55c6 admin admin] PATH_INFO: `/v3/projects/2b92e4c0c8844e68a384b52faf26faba/users/05a6e2a362044be18dda089aad3b7b60/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:17.832587 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 915/1832] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:17.834483 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f59df-3007-4420-a5c8-9ac03013dcce admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:17.849016 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f59df-3007-4420-a5c8-9ac03013dcce admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:17.854546 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bf3d9-8407-4f3c-83ff-fb3d71bfdc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:17.855665 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bf3d9-8407-4f3c-83ff-fb3d71bfdc5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:17.855961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bf3d9-8407-4f3c-83ff-fb3d71bfdc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:17.856384 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bf3d9-8407-4f3c-83ff-fb3d71bfdc5d admin admin] PATH_INFO: `/v3/projects/38bd300695b4458481dd9dfb1912b952/users/b139b0bcc8314dc7a983b0678f677e8d/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:17.861766 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970f838-e94c-4638-82d6-d6896e2f55c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b92e4c0c8844e68a384b52faf26faba, user_id=05a6e2a362044be18dda089aad3b7b60, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:17.866122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970f838-e94c-4638-82d6-d6896e2f55c6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:17.880399 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bf3d9-8407-4f3c-83ff-fb3d71bfdc5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=38bd300695b4458481dd9dfb1912b952, user_id=b139b0bcc8314dc7a983b0678f677e8d, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:17.884755 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bf3d9-8407-4f3c-83ff-fb3d71bfdc5d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:17.896710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 918/1833] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:17 2022] PUT /identity/v3/projects/2b92e4c0c8844e68a384b52faf26faba/users/05a6e2a362044be18dda089aad3b7b60/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:17.896710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970f838-e94c-4638-82d6-d6896e2f55c6 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:17.916092 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 916/1834] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:17 2022] PUT /identity/v3/projects/38bd300695b4458481dd9dfb1912b952/users/b139b0bcc8314dc7a983b0678f677e8d/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:17.916092 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bf3d9-8407-4f3c-83ff-fb3d71bfdc5d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:18.049711 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bf3d9-8407-4f3c-83ff-fb3d71bfdc5d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:18.058640 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbab8f9-fcfe-430c-9134-835b26c2459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:18.059468 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbab8f9-fcfe-430c-9134-835b26c2459b admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:18.059664 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970f838-e94c-4638-82d6-d6896e2f55c6 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:18.059768 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbab8f9-fcfe-430c-9134-835b26c2459b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:18.060251 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbab8f9-fcfe-430c-9134-835b26c2459b admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:18.061243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbab8f9-fcfe-430c-9134-835b26c2459b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:18.063399 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbab8f9-fcfe-430c-9134-835b26c2459b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:18.078525 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d5545-8d3e-4817-a1f2-83ecc68f8d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:18.079875 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d5545-8d3e-4817-a1f2-83ecc68f8d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:18.080411 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d5545-8d3e-4817-a1f2-83ecc68f8d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:18.080910 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d5545-8d3e-4817-a1f2-83ecc68f8d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:18.081853 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d5545-8d3e-4817-a1f2-83ecc68f8d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:18.083737 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d5545-8d3e-4817-a1f2-83ecc68f8d38 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:18.088147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 917/1835] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:18.092551 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67bc21-53f9-470d-b12b-517e02a39ae8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:18.092909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67bc21-53f9-470d-b12b-517e02a39ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:18.093358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67bc21-53f9-470d-b12b-517e02a39ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:18.122954 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 919/1836] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:17 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:18.124287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d5545-8d3e-4817-a1f2-83ecc68f8d38 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:18.134487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:18.138558 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3c67bc21-53f9-470d-b12b-517e02a39ae8 None None] MFA Rules not processed for user `b139b0bcc8314dc7a983b0678f677e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:18.145984 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d5545-8d3e-4817-a1f2-83ecc68f8d38 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:18.152114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438a1d3-6f30-4535-b10a-e4d68fc2e624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:18.153184 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438a1d3-6f30-4535-b10a-e4d68fc2e624 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:18.153474 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438a1d3-6f30-4535-b10a-e4d68fc2e624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:18.153758 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438a1d3-6f30-4535-b10a-e4d68fc2e624 admin admin] PATH_INFO: `/v3/projects/2b92e4c0c8844e68a384b52faf26faba/users/05a6e2a362044be18dda089aad3b7b60/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:18.154056 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3c67bc21-53f9-470d-b12b-517e02a39ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:18.165974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438a1d3-6f30-4535-b10a-e4d68fc2e624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b92e4c0c8844e68a384b52faf26faba, user_id=05a6e2a362044be18dda089aad3b7b60, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:18.169058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438a1d3-6f30-4535-b10a-e4d68fc2e624 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:18.196051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 920/1837] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:18 2022] PUT /identity/v3/projects/2b92e4c0c8844e68a384b52faf26faba/users/05a6e2a362044be18dda089aad3b7b60/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:18.196051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438a1d3-6f30-4535-b10a-e4d68fc2e624 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:18.232320 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:18.279946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 918/1838] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:18.281617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfed41f-730b-4e57-9d41-4636b651619a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:18.281903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfed41f-730b-4e57-9d41-4636b651619a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:18.282172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfed41f-730b-4e57-9d41-4636b651619a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:18.329352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9dfed41f-730b-4e57-9d41-4636b651619a None None] MFA Rules not processed for user `05a6e2a362044be18dda089aad3b7b60`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:18.330741 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9dfed41f-730b-4e57-9d41-4636b651619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:18.331883 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438a1d3-6f30-4535-b10a-e4d68fc2e624 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:18.338180 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1a830-8850-403c-905b-9d603fc9f32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:18.340853 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1a830-8850-403c-905b-9d603fc9f32f admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:18.341195 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1a830-8850-403c-905b-9d603fc9f32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:18.341428 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1a830-8850-403c-905b-9d603fc9f32f admin admin] PATH_INFO: `/v3/projects/aff02f43e9574ccbb826a79b4069d872/users/34a647c60303410797364d41479af271/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:18.366710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1a830-8850-403c-905b-9d603fc9f32f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff02f43e9574ccbb826a79b4069d872, user_id=34a647c60303410797364d41479af271, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:18.369691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1a830-8850-403c-905b-9d603fc9f32f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:18.393005 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 921/1839] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:18 2022] PUT /identity/v3/projects/aff02f43e9574ccbb826a79b4069d872/users/34a647c60303410797364d41479af271/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:18.394178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1a830-8850-403c-905b-9d603fc9f32f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:18.396071 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c8a1a830-8850-403c-905b-9d603fc9f32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:18.446871 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 919/1840] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:18 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:18.446871 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0e02b-debb-4f29-9a8b-655cd47ace57 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:18.446871 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0e02b-debb-4f29-9a8b-655cd47ace57 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:18.453389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0e02b-debb-4f29-9a8b-655cd47ace57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:18.507862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1a830-8850-403c-905b-9d603fc9f32f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:18.513465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc157aa-ef5d-4144-b744-644e332eba50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:18.513736 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-38b0e02b-debb-4f29-9a8b-655cd47ace57 None None] MFA Rules not processed for user `34a647c60303410797364d41479af271`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:18.515097 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc157aa-ef5d-4144-b744-644e332eba50 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:18.515587 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc157aa-ef5d-4144-b744-644e332eba50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:18.516073 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc157aa-ef5d-4144-b744-644e332eba50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:18.516449 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-38b0e02b-debb-4f29-9a8b-655cd47ace57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:18.608937 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc157aa-ef5d-4144-b744-644e332eba50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:18.611408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc157aa-ef5d-4144-b744-644e332eba50 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:18.631427 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 922/1841] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:18.633312 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc157aa-ef5d-4144-b744-644e332eba50 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:18.636075 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 920/1842] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:18.636269 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1dc157aa-ef5d-4144-b744-644e332eba50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:18.639133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0e02b-debb-4f29-9a8b-655cd47ace57 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:18.675176 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc157aa-ef5d-4144-b744-644e332eba50 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:18.689834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d037f-1f0b-43c5-98f1-7206afabbcbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:18.690625 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d037f-1f0b-43c5-98f1-7206afabbcbf service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:18.691009 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d037f-1f0b-43c5-98f1-7206afabbcbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:18.691281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d037f-1f0b-43c5-98f1-7206afabbcbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:18.725432 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:18.737214 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0e02b-debb-4f29-9a8b-655cd47ace57 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:18.755177 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921f0b2-07b4-4fd0-b20b-63457740fbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:18.756071 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921f0b2-07b4-4fd0-b20b-63457740fbe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:18.756367 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921f0b2-07b4-4fd0-b20b-63457740fbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:18.756648 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921f0b2-07b4-4fd0-b20b-63457740fbe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:18.757367 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921f0b2-07b4-4fd0-b20b-63457740fbe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:18.759405 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921f0b2-07b4-4fd0-b20b-63457740fbe1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:18.798873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:18.820794 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 921/1843] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:18 2022] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:35:18.828186 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921f0b2-07b4-4fd0-b20b-63457740fbe1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:18.930469 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d037f-1f0b-43c5-98f1-7206afabbcbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:18.933430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3d037f-1f0b-43c5-98f1-7206afabbcbf service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:18.953375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921f0b2-07b4-4fd0-b20b-63457740fbe1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:18.954653 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 923/1844] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:18 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:18.964940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46c5c0-3ad7-4402-86dc-a3feee4ea05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:18.966714 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46c5c0-3ad7-4402-86dc-a3feee4ea05b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:18.967131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46c5c0-3ad7-4402-86dc-a3feee4ea05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:18.967499 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46c5c0-3ad7-4402-86dc-a3feee4ea05b admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:18.968360 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46c5c0-3ad7-4402-86dc-a3feee4ea05b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:18.971545 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46c5c0-3ad7-4402-86dc-a3feee4ea05b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:19.006237 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 922/1845] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:18 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:19.011383 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d037f-1f0b-43c5-98f1-7206afabbcbf service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:19.043387 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3d037f-1f0b-43c5-98f1-7206afabbcbf service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:19.056724 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9b6a2-766b-4b23-8faf-e33f34b46bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:19.057437 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9b6a2-766b-4b23-8faf-e33f34b46bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:19.057719 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9b6a2-766b-4b23-8faf-e33f34b46bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:19.057999 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9b6a2-766b-4b23-8faf-e33f34b46bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:19.058915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9b6a2-766b-4b23-8faf-e33f34b46bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:19.060876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9b6a2-766b-4b23-8faf-e33f34b46bf8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:19.093859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46c5c0-3ad7-4402-86dc-a3feee4ea05b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:19.094220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 924/1846] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:19.110401 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46c5c0-3ad7-4402-86dc-a3feee4ea05b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:19.126511 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d4d6b-ec15-4155-b659-9656dc7a1bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:19.137027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d4d6b-ec15-4155-b659-9656dc7a1bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:19.137027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d4d6b-ec15-4155-b659-9656dc7a1bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:19.137027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d4d6b-ec15-4155-b659-9656dc7a1bb6 admin admin] PATH_INFO: `/v3/projects/9d89688172ff483eaad7fca112da7203/users/affe3f0215e8487bb40890420378d18d/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:19.223319 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d4d6b-ec15-4155-b659-9656dc7a1bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d89688172ff483eaad7fca112da7203, user_id=affe3f0215e8487bb40890420378d18d, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:19.226353 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d4d6b-ec15-4155-b659-9656dc7a1bb6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:19.268958 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 923/1847] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:19 2022] PUT /identity/v3/projects/9d89688172ff483eaad7fca112da7203/users/affe3f0215e8487bb40890420378d18d/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:19.270527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9b6a2-766b-4b23-8faf-e33f34b46bf8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:19.350856 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9b6a2-766b-4b23-8faf-e33f34b46bf8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:19.668539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ec63a-7bd4-4d32-92c2-f500017b61f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:19.670206 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ec63a-7bd4-4d32-92c2-f500017b61f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:19.671100 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ec63a-7bd4-4d32-92c2-f500017b61f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:19.671788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ec63a-7bd4-4d32-92c2-f500017b61f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:19.674676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ec63a-7bd4-4d32-92c2-f500017b61f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:19.678769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ec63a-7bd4-4d32-92c2-f500017b61f8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:19.738215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 925/1848] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:35:19.743277 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d4d6b-ec15-4155-b659-9656dc7a1bb6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:19.760141 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d4d6b-ec15-4155-b659-9656dc7a1bb6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:19.772483 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e3943-19de-4d10-b474-0b7f33ba2f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:19.774168 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e3943-19de-4d10-b474-0b7f33ba2f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:19.774665 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e3943-19de-4d10-b474-0b7f33ba2f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:19.775160 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e3943-19de-4d10-b474-0b7f33ba2f28 admin admin] PATH_INFO: `/v3/projects/9d89688172ff483eaad7fca112da7203/users/affe3f0215e8487bb40890420378d18d/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:19.778901 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e3943-19de-4d10-b474-0b7f33ba2f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d89688172ff483eaad7fca112da7203, user_id=affe3f0215e8487bb40890420378d18d, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:19.784539 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e3943-19de-4d10-b474-0b7f33ba2f28 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:19.840418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 924/1849] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:19 2022] PUT /identity/v3/projects/9d89688172ff483eaad7fca112da7203/users/affe3f0215e8487bb40890420378d18d/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:19.850478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a2543-1423-4d40-a3ba-ea04555337c9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:19.851056 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a2543-1423-4d40-a3ba-ea04555337c9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:19.851431 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a2543-1423-4d40-a3ba-ea04555337c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:19.924955 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-966a2543-1423-4d40-a3ba-ea04555337c9 None None] MFA Rules not processed for user `affe3f0215e8487bb40890420378d18d`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:19.929725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-966a2543-1423-4d40-a3ba-ea04555337c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:20.130550 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e3943-19de-4d10-b474-0b7f33ba2f28 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:20.159595 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 926/1850] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:20.182983 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a2543-1423-4d40-a3ba-ea04555337c9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:20.247419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e3943-19de-4d10-b474-0b7f33ba2f28 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:20.251368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:20.257395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea96170-4f30-4dae-a161-f07d649a926c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:20.258526 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea96170-4f30-4dae-a161-f07d649a926c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:20.258942 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea96170-4f30-4dae-a161-f07d649a926c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:20.259359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea96170-4f30-4dae-a161-f07d649a926c admin admin] PATH_INFO: `/v3/users/923428bd86be4ab683839414c4463496` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:20.261145 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea96170-4f30-4dae-a161-f07d649a926c admin admin] RBAC: Authorizing `identity:delete_user(user_id=923428bd86be4ab683839414c4463496)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:20.263910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea96170-4f30-4dae-a161-f07d649a926c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:20.295913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a2543-1423-4d40-a3ba-ea04555337c9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:20.301618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a1b38-f6ab-454f-a4db-d8f2f4ec3437 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:20.302378 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a1b38-f6ab-454f-a4db-d8f2f4ec3437 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:20.302934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a1b38-f6ab-454f-a4db-d8f2f4ec3437 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:20.303410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a1b38-f6ab-454f-a4db-d8f2f4ec3437 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:20.318972 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a1b38-f6ab-454f-a4db-d8f2f4ec3437 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:20.321654 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a1b38-f6ab-454f-a4db-d8f2f4ec3437 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:20.329399 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:20.341982 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 927/1851] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:20.347936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cea96170-4f30-4dae-a161-f07d649a926c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '923428bd86be4ab683839414c4463496'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:20.349122 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cea96170-4f30-4dae-a161-f07d649a926c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '923428bd86be4ab683839414c4463496'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:20.350571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cea96170-4f30-4dae-a161-f07d649a926c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '923428bd86be4ab683839414c4463496'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:20.378797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cea96170-4f30-4dae-a161-f07d649a926c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '923428bd86be4ab683839414c4463496'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:20.388291 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a1b38-f6ab-454f-a4db-d8f2f4ec3437 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:20.395303 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cea96170-4f30-4dae-a161-f07d649a926c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '923428bd86be4ab683839414c4463496'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:20.403249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a1b38-f6ab-454f-a4db-d8f2f4ec3437 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:20.411516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a9166-3534-4b7f-acd6-752aa34ee3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:20.413562 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a9166-3534-4b7f-acd6-752aa34ee3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:20.413728 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a9166-3534-4b7f-acd6-752aa34ee3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:20.414107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a9166-3534-4b7f-acd6-752aa34ee3ba admin admin] PATH_INFO: `/v3/users/34a647c60303410797364d41479af271` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:20.416271 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a9166-3534-4b7f-acd6-752aa34ee3ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a647c60303410797364d41479af271)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:20.419148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a9166-3534-4b7f-acd6-752aa34ee3ba admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:20.420714 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 925/1852] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:20 2022] DELETE /identity/v3/users/923428bd86be4ab683839414c4463496 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:20.428209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757b57-f8e8-4326-be06-51429b58241f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:20.428606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757b57-f8e8-4326-be06-51429b58241f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:20.429172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757b57-f8e8-4326-be06-51429b58241f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:20.450730 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-61757b57-f8e8-4326-be06-51429b58241f None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:20.453280 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-61757b57-f8e8-4326-be06-51429b58241f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:20.496881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-543a9166-3534-4b7f-acd6-752aa34ee3ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a647c60303410797364d41479af271'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:20.514483 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-543a9166-3534-4b7f-acd6-752aa34ee3ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a647c60303410797364d41479af271'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:20.544372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-543a9166-3534-4b7f-acd6-752aa34ee3ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a647c60303410797364d41479af271'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:20.548251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-543a9166-3534-4b7f-acd6-752aa34ee3ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a647c60303410797364d41479af271'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:20.548625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 926/1853] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:20.549180 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-543a9166-3534-4b7f-acd6-752aa34ee3ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a647c60303410797364d41479af271'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:20.561892 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61757b57-f8e8-4326-be06-51429b58241f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:20.564502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-61757b57-f8e8-4326-be06-51429b58241f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:20.573493 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 928/1854] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:20 2022] DELETE /identity/v3/users/34a647c60303410797364d41479af271 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:20.575716 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee3038-10c7-4770-99e9-7057614ecc18 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:20.578532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee3038-10c7-4770-99e9-7057614ecc18 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:20.578868 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fee3038-10c7-4770-99e9-7057614ecc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:20.606580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8fee3038-10c7-4770-99e9-7057614ecc18 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:20.608331 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8fee3038-10c7-4770-99e9-7057614ecc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:20.679851 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61757b57-f8e8-4326-be06-51429b58241f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:20.692438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 929/1855] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:20.705278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee3038-10c7-4770-99e9-7057614ecc18 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:20.707009 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8fee3038-10c7-4770-99e9-7057614ecc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:20.788530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c816cc-fbd4-450b-9199-0e5732d2acd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:20.790427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c816cc-fbd4-450b-9199-0e5732d2acd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:20.791006 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c816cc-fbd4-450b-9199-0e5732d2acd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:20.791565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c816cc-fbd4-450b-9199-0e5732d2acd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:20.794145 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-53c816cc-fbd4-450b-9199-0e5732d2acd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:20.844752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c816cc-fbd4-450b-9199-0e5732d2acd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:20.846456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c816cc-fbd4-450b-9199-0e5732d2acd5 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:20.856481 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:20.871449 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fee3038-10c7-4770-99e9-7057614ecc18 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:20.873789 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 927/1856] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:35:20.887880 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34b7f8-5b39-40f7-abbf-04be3f241a03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:20.891741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34b7f8-5b39-40f7-abbf-04be3f241a03 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:20.893294 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34b7f8-5b39-40f7-abbf-04be3f241a03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:20.893582 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34b7f8-5b39-40f7-abbf-04be3f241a03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:20.927763 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34b7f8-5b39-40f7-abbf-04be3f241a03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:20.931754 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34b7f8-5b39-40f7-abbf-04be3f241a03 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:20.966229 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 930/1857] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:35:21.995665 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c816cc-fbd4-450b-9199-0e5732d2acd5 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:21.997201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-53c816cc-fbd4-450b-9199-0e5732d2acd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:22.022729 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c816cc-fbd4-450b-9199-0e5732d2acd5 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:22.047178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69b018-6d27-4544-a3a7-d03f3cc580b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:22.049554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69b018-6d27-4544-a3a7-d03f3cc580b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:22.049747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69b018-6d27-4544-a3a7-d03f3cc580b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:22.050035 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69b018-6d27-4544-a3a7-d03f3cc580b5 admin admin] PATH_INFO: `/v3/projects/915e15277aff454082705de60bee5a1b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:22.055873 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69b018-6d27-4544-a3a7-d03f3cc580b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=915e15277aff454082705de60bee5a1b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:22.060140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69b018-6d27-4544-a3a7-d03f3cc580b5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:22.067752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:22.174425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4c69b018-6d27-4544-a3a7-d03f3cc580b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '915e15277aff454082705de60bee5a1b', 'request_id': 'req-4c69b018-6d27-4544-a3a7-d03f3cc580b5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:22.191195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4c69b018-6d27-4544-a3a7-d03f3cc580b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '915e15277aff454082705de60bee5a1b', 'request_id': 'req-4c69b018-6d27-4544-a3a7-d03f3cc580b5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:22.205669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4c69b018-6d27-4544-a3a7-d03f3cc580b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '915e15277aff454082705de60bee5a1b', 'request_id': 'req-4c69b018-6d27-4544-a3a7-d03f3cc580b5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:22.219780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34b7f8-5b39-40f7-abbf-04be3f241a03 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:22.223519 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4e34b7f8-5b39-40f7-abbf-04be3f241a03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:22.228055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4c69b018-6d27-4544-a3a7-d03f3cc580b5 admin admin] The token cache is being invalidate because project 915e15277aff454082705de60bee5a1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:22.228711 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4c69b018-6d27-4544-a3a7-d03f3cc580b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:22.229453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4c69b018-6d27-4544-a3a7-d03f3cc580b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:22.233425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 928/1858] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:21 2022] DELETE /identity/v3/projects/915e15277aff454082705de60bee5a1b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:22.236813 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69b018-6d27-4544-a3a7-d03f3cc580b5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:22.239128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4c69b018-6d27-4544-a3a7-d03f3cc580b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:22.257248 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34b7f8-5b39-40f7-abbf-04be3f241a03 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:22.415608 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69b018-6d27-4544-a3a7-d03f3cc580b5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:22.424324 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b3d28-42d2-4423-b443-d9e3ab314860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:22.425663 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b3d28-42d2-4423-b443-d9e3ab314860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:22.426055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b3d28-42d2-4423-b443-d9e3ab314860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:22.426420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b3d28-42d2-4423-b443-d9e3ab314860 admin admin] PATH_INFO: `/v3/users/05a6e2a362044be18dda089aad3b7b60` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:22.428777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b3d28-42d2-4423-b443-d9e3ab314860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a6e2a362044be18dda089aad3b7b60)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:22.436672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b3d28-42d2-4423-b443-d9e3ab314860 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:22.478799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f061971-137a-4470-a52d-07ddb5ca9bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:22.479929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f061971-137a-4470-a52d-07ddb5ca9bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:22.480265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f061971-137a-4470-a52d-07ddb5ca9bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:22.480548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f061971-137a-4470-a52d-07ddb5ca9bfd admin admin] PATH_INFO: `/v3/projects/aff02f43e9574ccbb826a79b4069d872` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:22.483835 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f061971-137a-4470-a52d-07ddb5ca9bfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff02f43e9574ccbb826a79b4069d872)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:22.486898 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f061971-137a-4470-a52d-07ddb5ca9bfd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:22.600001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6f061971-137a-4470-a52d-07ddb5ca9bfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff02f43e9574ccbb826a79b4069d872', 'request_id': 'req-6f061971-137a-4470-a52d-07ddb5ca9bfd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:22.607595 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d31b3d28-42d2-4423-b443-d9e3ab314860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a6e2a362044be18dda089aad3b7b60'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:22.608374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d31b3d28-42d2-4423-b443-d9e3ab314860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a6e2a362044be18dda089aad3b7b60'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:22.609003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d31b3d28-42d2-4423-b443-d9e3ab314860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a6e2a362044be18dda089aad3b7b60'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:22.619270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6f061971-137a-4470-a52d-07ddb5ca9bfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff02f43e9574ccbb826a79b4069d872', 'request_id': 'req-6f061971-137a-4470-a52d-07ddb5ca9bfd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:22.648923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6f061971-137a-4470-a52d-07ddb5ca9bfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff02f43e9574ccbb826a79b4069d872', 'request_id': 'req-6f061971-137a-4470-a52d-07ddb5ca9bfd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:22.655124 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d31b3d28-42d2-4423-b443-d9e3ab314860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a6e2a362044be18dda089aad3b7b60'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:22.675715 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d31b3d28-42d2-4423-b443-d9e3ab314860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a6e2a362044be18dda089aad3b7b60'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:22.681182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6f061971-137a-4470-a52d-07ddb5ca9bfd admin admin] The token cache is being invalidate because project aff02f43e9574ccbb826a79b4069d872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:22.682856 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6f061971-137a-4470-a52d-07ddb5ca9bfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:22.684396 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6f061971-137a-4470-a52d-07ddb5ca9bfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:22.689543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 931/1859] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:22 2022] DELETE /identity/v3/projects/aff02f43e9574ccbb826a79b4069d872 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:22.695183 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f061971-137a-4470-a52d-07ddb5ca9bfd admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:22.704169 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6f061971-137a-4470-a52d-07ddb5ca9bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:22.733516 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 929/1860] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:22 2022] DELETE /identity/v3/users/05a6e2a362044be18dda089aad3b7b60 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:22.874215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f061971-137a-4470-a52d-07ddb5ca9bfd admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:22.933397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:22.995855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450569d-1ef3-48e9-9cdc-8642d6649446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:22.997310 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450569d-1ef3-48e9-9cdc-8642d6649446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:22.997826 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450569d-1ef3-48e9-9cdc-8642d6649446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:22.998389 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450569d-1ef3-48e9-9cdc-8642d6649446 admin admin] PATH_INFO: `/v3/users/affe3f0215e8487bb40890420378d18d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:23.000174 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450569d-1ef3-48e9-9cdc-8642d6649446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=affe3f0215e8487bb40890420378d18d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:23.002473 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450569d-1ef3-48e9-9cdc-8642d6649446 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:23.087384 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4450569d-1ef3-48e9-9cdc-8642d6649446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'affe3f0215e8487bb40890420378d18d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:23.109527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4450569d-1ef3-48e9-9cdc-8642d6649446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'affe3f0215e8487bb40890420378d18d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:23.127107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4450569d-1ef3-48e9-9cdc-8642d6649446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'affe3f0215e8487bb40890420378d18d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:23.135875 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4450569d-1ef3-48e9-9cdc-8642d6649446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'affe3f0215e8487bb40890420378d18d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:23.136750 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4450569d-1ef3-48e9-9cdc-8642d6649446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'affe3f0215e8487bb40890420378d18d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:23.144598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 932/1861] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:22 2022] DELETE /identity/v3/users/affe3f0215e8487bb40890420378d18d => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:23.221169 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b3d28-42d2-4423-b443-d9e3ab314860 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:23.223339 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d31b3d28-42d2-4423-b443-d9e3ab314860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:23.246180 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b3d28-42d2-4423-b443-d9e3ab314860 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:23.263492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:23.350547 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435f47e-2f61-4c36-9c56-9b0541127404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:23.352620 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435f47e-2f61-4c36-9c56-9b0541127404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:23.354048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435f47e-2f61-4c36-9c56-9b0541127404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:23.354900 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435f47e-2f61-4c36-9c56-9b0541127404 admin admin] PATH_INFO: `/v3/projects/2b92e4c0c8844e68a384b52faf26faba` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:23.357423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435f47e-2f61-4c36-9c56-9b0541127404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b92e4c0c8844e68a384b52faf26faba)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:23.361406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435f47e-2f61-4c36-9c56-9b0541127404 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:23.448831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8435f47e-2f61-4c36-9c56-9b0541127404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b92e4c0c8844e68a384b52faf26faba', 'request_id': 'req-8435f47e-2f61-4c36-9c56-9b0541127404'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:23.465661 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8435f47e-2f61-4c36-9c56-9b0541127404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b92e4c0c8844e68a384b52faf26faba', 'request_id': 'req-8435f47e-2f61-4c36-9c56-9b0541127404'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:23.489365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8435f47e-2f61-4c36-9c56-9b0541127404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b92e4c0c8844e68a384b52faf26faba', 'request_id': 'req-8435f47e-2f61-4c36-9c56-9b0541127404'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:23.516350 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8435f47e-2f61-4c36-9c56-9b0541127404 admin admin] The token cache is being invalidate because project 2b92e4c0c8844e68a384b52faf26faba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:23.516894 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8435f47e-2f61-4c36-9c56-9b0541127404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:23.517881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8435f47e-2f61-4c36-9c56-9b0541127404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:23.532828 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 930/1862] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:23 2022] DELETE /identity/v3/projects/2b92e4c0c8844e68a384b52faf26faba => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:23.537273 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d340892-9334-4c9a-97d2-129638659596 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:23.537941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d340892-9334-4c9a-97d2-129638659596 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:23.537941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d340892-9334-4c9a-97d2-129638659596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:23.574144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6d340892-9334-4c9a-97d2-129638659596 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:23.576148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6d340892-9334-4c9a-97d2-129638659596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:23.683438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 933/1863] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:23.685706 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bb3f8-55ad-4fc5-8c3e-24b42f87f786 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:23.686033 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bb3f8-55ad-4fc5-8c3e-24b42f87f786 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:23.686303 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bb3f8-55ad-4fc5-8c3e-24b42f87f786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:23.709937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-810bb3f8-55ad-4fc5-8c3e-24b42f87f786 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:23.711678 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-810bb3f8-55ad-4fc5-8c3e-24b42f87f786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:23.727928 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 931/1864] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:23.731468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d340892-9334-4c9a-97d2-129638659596 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:23.746495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d340892-9334-4c9a-97d2-129638659596 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:23.787649 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bf788-370b-4742-96b0-cd81abe3a23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:23.788998 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bf788-370b-4742-96b0-cd81abe3a23a admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:23.789775 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bf788-370b-4742-96b0-cd81abe3a23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:23.790305 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bf788-370b-4742-96b0-cd81abe3a23a admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:23.792556 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5bf788-370b-4742-96b0-cd81abe3a23a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:23.792556 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5bf788-370b-4742-96b0-cd81abe3a23a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:23.797779 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5bf788-370b-4742-96b0-cd81abe3a23a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:23.834543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 934/1865] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:35:23.837333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bb3f8-55ad-4fc5-8c3e-24b42f87f786 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:23.851980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bb3f8-55ad-4fc5-8c3e-24b42f87f786 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:23.858867 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cbcc6-a3dc-49f5-b68a-05b8a8926778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:23.859882 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cbcc6-a3dc-49f5-b68a-05b8a8926778 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:23.860260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cbcc6-a3dc-49f5-b68a-05b8a8926778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:23.860776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cbcc6-a3dc-49f5-b68a-05b8a8926778 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:23.861500 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79cbcc6-a3dc-49f5-b68a-05b8a8926778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:23.864735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79cbcc6-a3dc-49f5-b68a-05b8a8926778 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:23.938578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bf788-370b-4742-96b0-cd81abe3a23a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:23.941319 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 932/1866] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:23 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:23.945976 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cbcc6-a3dc-49f5-b68a-05b8a8926778 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:23.947703 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6e5bf788-370b-4742-96b0-cd81abe3a23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:23.985889 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5bf788-370b-4742-96b0-cd81abe3a23a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:24.123023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:24.172667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cbcc6-a3dc-49f5-b68a-05b8a8926778 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:24.180193 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e0344-c2c0-4ac2-b78a-8cb4ba004b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:24.180897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e0344-c2c0-4ac2-b78a-8cb4ba004b29 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:24.181232 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e0344-c2c0-4ac2-b78a-8cb4ba004b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:24.181513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e0344-c2c0-4ac2-b78a-8cb4ba004b29 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:24.182480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e0344-c2c0-4ac2-b78a-8cb4ba004b29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:24.184570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e0344-c2c0-4ac2-b78a-8cb4ba004b29 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:24.206212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5059ba-cb9b-4a8d-85aa-2b1a5e6af4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:24.213546 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5059ba-cb9b-4a8d-85aa-2b1a5e6af4cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:24.215035 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5059ba-cb9b-4a8d-85aa-2b1a5e6af4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:24.215517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5059ba-cb9b-4a8d-85aa-2b1a5e6af4cf admin admin] PATH_INFO: `/v3/projects/9d89688172ff483eaad7fca112da7203` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:24.217649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 933/1867] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:23 2022] POST /identity/v3/users => generated 283 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:24.218660 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e0344-c2c0-4ac2-b78a-8cb4ba004b29 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:24.219478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5059ba-cb9b-4a8d-85aa-2b1a5e6af4cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d89688172ff483eaad7fca112da7203)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:24.226449 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:24.231913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5059ba-cb9b-4a8d-85aa-2b1a5e6af4cf admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:24.235221 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e0344-c2c0-4ac2-b78a-8cb4ba004b29 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:24.248180 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499fd22-8dae-47af-aa17-c60239520d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:24.249263 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499fd22-8dae-47af-aa17-c60239520d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:24.249701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499fd22-8dae-47af-aa17-c60239520d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:24.250963 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499fd22-8dae-47af-aa17-c60239520d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:24.252608 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499fd22-8dae-47af-aa17-c60239520d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:24.255967 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499fd22-8dae-47af-aa17-c60239520d2d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:24.274151 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 934/1868] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:24.275320 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499fd22-8dae-47af-aa17-c60239520d2d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:24.288744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499fd22-8dae-47af-aa17-c60239520d2d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:24.295357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d68c0-8e1f-431d-8e1d-b4312c90b0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:24.298121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d68c0-8e1f-431d-8e1d-b4312c90b0ac admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:24.298442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d68c0-8e1f-431d-8e1d-b4312c90b0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:24.298727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d68c0-8e1f-431d-8e1d-b4312c90b0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:24.300855 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d68c0-8e1f-431d-8e1d-b4312c90b0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:24.306331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d68c0-8e1f-431d-8e1d-b4312c90b0ac admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:24.340532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 935/1869] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:24.372488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d68c0-8e1f-431d-8e1d-b4312c90b0ac admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:24.391416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-da5059ba-cb9b-4a8d-85aa-2b1a5e6af4cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d89688172ff483eaad7fca112da7203', 'request_id': 'req-da5059ba-cb9b-4a8d-85aa-2b1a5e6af4cf'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:24.393155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d68c0-8e1f-431d-8e1d-b4312c90b0ac admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:24.413176 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-da5059ba-cb9b-4a8d-85aa-2b1a5e6af4cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d89688172ff483eaad7fca112da7203', 'request_id': 'req-da5059ba-cb9b-4a8d-85aa-2b1a5e6af4cf'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:24.437345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-da5059ba-cb9b-4a8d-85aa-2b1a5e6af4cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d89688172ff483eaad7fca112da7203', 'request_id': 'req-da5059ba-cb9b-4a8d-85aa-2b1a5e6af4cf'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:24.490604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-da5059ba-cb9b-4a8d-85aa-2b1a5e6af4cf admin admin] The token cache is being invalidate because project 9d89688172ff483eaad7fca112da7203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:24.491127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-da5059ba-cb9b-4a8d-85aa-2b1a5e6af4cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:24.493601 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-da5059ba-cb9b-4a8d-85aa-2b1a5e6af4cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:24.498200 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 935/1870] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:23 2022] DELETE /identity/v3/projects/9d89688172ff483eaad7fca112da7203 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:24.511273 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d58ee-24c9-431b-9726-e0b77fadccb5 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:24.512042 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d58ee-24c9-431b-9726-e0b77fadccb5 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:24.512260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d58ee-24c9-431b-9726-e0b77fadccb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:24.567718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-556d58ee-24c9-431b-9726-e0b77fadccb5 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:24.569124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-556d58ee-24c9-431b-9726-e0b77fadccb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:24.600559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921005d-74f0-459b-a990-170e475a6a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:24.601554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921005d-74f0-459b-a990-170e475a6a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:24.602560 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921005d-74f0-459b-a990-170e475a6a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:24.602849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921005d-74f0-459b-a990-170e475a6a35 admin admin] PATH_INFO: `/v3/projects/1a6e4222a7e04fd4bb5316c47c94bc87/users/29b3899ad8f0442189326df5515d0050/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:24.638379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921005d-74f0-459b-a990-170e475a6a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6e4222a7e04fd4bb5316c47c94bc87, user_id=29b3899ad8f0442189326df5515d0050, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:24.647074 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921005d-74f0-459b-a990-170e475a6a35 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:24.708347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 936/1871] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:24 2022] PUT /identity/v3/projects/1a6e4222a7e04fd4bb5316c47c94bc87/users/29b3899ad8f0442189326df5515d0050/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:24.710016 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 936/1872] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:24.718114 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120ccd3-ef31-426b-9d84-96442447c9af None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:24.719837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8d56d-6394-4259-bce1-a5aaf65e7066 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:24.720178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8d56d-6394-4259-bce1-a5aaf65e7066 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:24.720451 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8d56d-6394-4259-bce1-a5aaf65e7066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:24.722128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120ccd3-ef31-426b-9d84-96442447c9af None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:24.722431 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120ccd3-ef31-426b-9d84-96442447c9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:24.745001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d120ccd3-ef31-426b-9d84-96442447c9af None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:24.746264 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d120ccd3-ef31-426b-9d84-96442447c9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:24.763393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-14f8d56d-6394-4259-bce1-a5aaf65e7066 None None] MFA Rules not processed for user `29b3899ad8f0442189326df5515d0050`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:24.765164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-14f8d56d-6394-4259-bce1-a5aaf65e7066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:24.839335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 937/1873] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:24.845676 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120ccd3-ef31-426b-9d84-96442447c9af None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:24.862253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120ccd3-ef31-426b-9d84-96442447c9af None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:24.869471 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc52a9-29d6-480b-9f83-2705e83eb7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:24.870278 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc52a9-29d6-480b-9f83-2705e83eb7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:24.870560 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc52a9-29d6-480b-9f83-2705e83eb7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:24.870828 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc52a9-29d6-480b-9f83-2705e83eb7f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:24.871651 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc52a9-29d6-480b-9f83-2705e83eb7f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:24.872243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc52a9-29d6-480b-9f83-2705e83eb7f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:24.874089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc52a9-29d6-480b-9f83-2705e83eb7f0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:24.883950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:24.891876 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 938/1874] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:35:24.897421 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc52a9-29d6-480b-9f83-2705e83eb7f0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:24.902907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 937/1875] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:24.905493 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8d56d-6394-4259-bce1-a5aaf65e7066 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:24.909474 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-14f8d56d-6394-4259-bce1-a5aaf65e7066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:24.910073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc52a9-29d6-480b-9f83-2705e83eb7f0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:24.917801 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b492e0-0acd-4545-8262-18d6597a771b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:24.918516 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b492e0-0acd-4545-8262-18d6597a771b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:24.918993 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b492e0-0acd-4545-8262-18d6597a771b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:24.919269 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b492e0-0acd-4545-8262-18d6597a771b admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:24.920612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b492e0-0acd-4545-8262-18d6597a771b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:24.923280 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b492e0-0acd-4545-8262-18d6597a771b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:24.936037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8d56d-6394-4259-bce1-a5aaf65e7066 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:24.943518 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856f30f-f68f-4126-85ac-4ed33a72f767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:24.944132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856f30f-f68f-4126-85ac-4ed33a72f767 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:24.944507 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856f30f-f68f-4126-85ac-4ed33a72f767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:24.944728 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856f30f-f68f-4126-85ac-4ed33a72f767 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:24.945572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856f30f-f68f-4126-85ac-4ed33a72f767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:24.947933 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856f30f-f68f-4126-85ac-4ed33a72f767 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:24.992456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 939/1876] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:24 2022] POST /identity/v3/projects => generated 391 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:35:24.999270 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b492e0-0acd-4545-8262-18d6597a771b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:25.011425 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 938/1877] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:24 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:25.013342 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856f30f-f68f-4126-85ac-4ed33a72f767 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:25.066109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:25.120148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b492e0-0acd-4545-8262-18d6597a771b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:25.175640 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856f30f-f68f-4126-85ac-4ed33a72f767 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:25.182729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860f8d9-9980-459d-864b-e0692dd98f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:25.183807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860f8d9-9980-459d-864b-e0692dd98f6b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:25.184147 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860f8d9-9980-459d-864b-e0692dd98f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:25.184425 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860f8d9-9980-459d-864b-e0692dd98f6b admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:25.185174 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860f8d9-9980-459d-864b-e0692dd98f6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:25.187500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860f8d9-9980-459d-864b-e0692dd98f6b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:25.239487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 939/1878] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:25 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:35:25.245062 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860f8d9-9980-459d-864b-e0692dd98f6b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:25.258422 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36527a43-2cbd-4dbc-ba51-27b94b30162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:25.260066 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36527a43-2cbd-4dbc-ba51-27b94b30162e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:25.260612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36527a43-2cbd-4dbc-ba51-27b94b30162e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:25.261161 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36527a43-2cbd-4dbc-ba51-27b94b30162e admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:25.262644 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36527a43-2cbd-4dbc-ba51-27b94b30162e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:25.262840 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860f8d9-9980-459d-864b-e0692dd98f6b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:25.268528 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36527a43-2cbd-4dbc-ba51-27b94b30162e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:25.275451 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b63fe0-4a7d-4749-a296-89597e87b678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:25.277013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b63fe0-4a7d-4749-a296-89597e87b678 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:25.277514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b63fe0-4a7d-4749-a296-89597e87b678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:25.278218 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b63fe0-4a7d-4749-a296-89597e87b678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:25.279604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b63fe0-4a7d-4749-a296-89597e87b678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:25.282952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b63fe0-4a7d-4749-a296-89597e87b678 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:25.315011 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 940/1879] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:24 2022] POST /identity/v3/users => generated 296 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:25.319264 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36527a43-2cbd-4dbc-ba51-27b94b30162e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:25.321406 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 940/1880] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:35:25.323261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b63fe0-4a7d-4749-a296-89597e87b678 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:25.338065 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b63fe0-4a7d-4749-a296-89597e87b678 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:25.342619 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36527a43-2cbd-4dbc-ba51-27b94b30162e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:25.344413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df49e85-8f84-4b6d-a8b9-7020a334dfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:25.345435 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df49e85-8f84-4b6d-a8b9-7020a334dfae admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:25.345725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df49e85-8f84-4b6d-a8b9-7020a334dfae admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:25.346005 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df49e85-8f84-4b6d-a8b9-7020a334dfae admin admin] PATH_INFO: `/v3/projects/9696b01a5b6a4b4499a75db2c18100ec/users/4f08b8baf47440268072a133f80deb22/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:25.352240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269510b-ba19-4447-b1a1-01573129be61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:25.353285 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269510b-ba19-4447-b1a1-01573129be61 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:25.353779 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269510b-ba19-4447-b1a1-01573129be61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:25.354160 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269510b-ba19-4447-b1a1-01573129be61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:25.355331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269510b-ba19-4447-b1a1-01573129be61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:25.357463 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269510b-ba19-4447-b1a1-01573129be61 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:25.367732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df49e85-8f84-4b6d-a8b9-7020a334dfae admin admin] RBAC: Authorizing `identity:create_grant(project_id=9696b01a5b6a4b4499a75db2c18100ec, user_id=4f08b8baf47440268072a133f80deb22, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:25.374645 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df49e85-8f84-4b6d-a8b9-7020a334dfae admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:25.390497 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 941/1881] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:25.393699 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269510b-ba19-4447-b1a1-01573129be61 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:25.411178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269510b-ba19-4447-b1a1-01573129be61 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:25.440674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 941/1882] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:25 2022] PUT /identity/v3/projects/9696b01a5b6a4b4499a75db2c18100ec/users/4f08b8baf47440268072a133f80deb22/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:25.445805 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df49e85-8f84-4b6d-a8b9-7020a334dfae admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:25.511721 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b3d00-7ae5-40bd-9699-914f8a032b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:25.512491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b3d00-7ae5-40bd-9699-914f8a032b97 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:25.513470 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b3d00-7ae5-40bd-9699-914f8a032b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:25.515957 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b3d00-7ae5-40bd-9699-914f8a032b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:25.516915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b3d00-7ae5-40bd-9699-914f8a032b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:25.522557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b3d00-7ae5-40bd-9699-914f8a032b97 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:25.559081 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 942/1883] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:25.565636 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b3d00-7ae5-40bd-9699-914f8a032b97 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:25.590590 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b3d00-7ae5-40bd-9699-914f8a032b97 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:25.593921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df49e85-8f84-4b6d-a8b9-7020a334dfae admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:25.596270 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370f52a-d4f3-4d23-97f1-d7c02211c9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:25.597218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370f52a-d4f3-4d23-97f1-d7c02211c9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:25.597460 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370f52a-d4f3-4d23-97f1-d7c02211c9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:25.597925 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370f52a-d4f3-4d23-97f1-d7c02211c9b9 admin admin] PATH_INFO: `/v3/projects/28c92de5cd4a4fb89f84aabbd2433b38/users/b74cebd063ca4ee58857376ca488f577/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:25.603063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629c5dc-41ea-427a-b340-ce0b3cb6ee94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:25.604344 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629c5dc-41ea-427a-b340-ce0b3cb6ee94 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:25.604941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629c5dc-41ea-427a-b340-ce0b3cb6ee94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:25.605437 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629c5dc-41ea-427a-b340-ce0b3cb6ee94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:25.606603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629c5dc-41ea-427a-b340-ce0b3cb6ee94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:25.609587 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629c5dc-41ea-427a-b340-ce0b3cb6ee94 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:25.627814 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 942/1884] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:25.633898 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629c5dc-41ea-427a-b340-ce0b3cb6ee94 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:25.634365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370f52a-d4f3-4d23-97f1-d7c02211c9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c92de5cd4a4fb89f84aabbd2433b38, user_id=b74cebd063ca4ee58857376ca488f577, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:25.639609 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370f52a-d4f3-4d23-97f1-d7c02211c9b9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:25.649104 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629c5dc-41ea-427a-b340-ce0b3cb6ee94 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:25.656404 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a225f5-0cec-42c2-920e-994068369486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:25.657830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a225f5-0cec-42c2-920e-994068369486 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:25.658194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a225f5-0cec-42c2-920e-994068369486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:25.658598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a225f5-0cec-42c2-920e-994068369486 admin admin] PATH_INFO: `/v3/projects/9696b01a5b6a4b4499a75db2c18100ec/users/4f08b8baf47440268072a133f80deb22/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:25.661292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a225f5-0cec-42c2-920e-994068369486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9696b01a5b6a4b4499a75db2c18100ec, user_id=4f08b8baf47440268072a133f80deb22, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:25.664564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a225f5-0cec-42c2-920e-994068369486 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:25.679298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 943/1885] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:25 2022] PUT /identity/v3/projects/9696b01a5b6a4b4499a75db2c18100ec/users/4f08b8baf47440268072a133f80deb22/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:25.679704 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 943/1886] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:25 2022] PUT /identity/v3/projects/28c92de5cd4a4fb89f84aabbd2433b38/users/b74cebd063ca4ee58857376ca488f577/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:25.694271 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fca347-07d4-4aa7-bc13-f7a41612cb0d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:25.695207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fca347-07d4-4aa7-bc13-f7a41612cb0d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:25.695547 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fca347-07d4-4aa7-bc13-f7a41612cb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:25.699848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61f178-a07d-4736-9814-a22a471aeca8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:25.700322 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61f178-a07d-4736-9814-a22a471aeca8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:25.700616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61f178-a07d-4736-9814-a22a471aeca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:25.753260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:25.780250 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c7fca347-07d4-4aa7-bc13-f7a41612cb0d None None] MFA Rules not processed for user `b74cebd063ca4ee58857376ca488f577`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:25.783349 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ab61f178-a07d-4736-9814-a22a471aeca8 None None] MFA Rules not processed for user `4f08b8baf47440268072a133f80deb22`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:25.783657 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c7fca347-07d4-4aa7-bc13-f7a41612cb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:25.785168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ab61f178-a07d-4736-9814-a22a471aeca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:25.851206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:25.904335 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 944/1887] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:25 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:25.922571 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61f178-a07d-4736-9814-a22a471aeca8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:25.935567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ab61f178-a07d-4736-9814-a22a471aeca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:26.058680 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 944/1888] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:26.063607 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fca347-07d4-4aa7-bc13-f7a41612cb0d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:26.080401 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61f178-a07d-4736-9814-a22a471aeca8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:26.094553 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a5888-9823-411f-b232-fd857108f2fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:26.095376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a5888-9823-411f-b232-fd857108f2fd service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:26.095732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a5888-9823-411f-b232-fd857108f2fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:26.096107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a5888-9823-411f-b232-fd857108f2fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:26.124972 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a5888-9823-411f-b232-fd857108f2fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:26.126780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a5888-9823-411f-b232-fd857108f2fd service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:26.150888 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 945/1889] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:25 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:26.213023 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fca347-07d4-4aa7-bc13-f7a41612cb0d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:26.233345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9db0b-6034-4b6e-9a4c-e9159eaf3a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:26.234025 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9db0b-6034-4b6e-9a4c-e9159eaf3a60 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:26.234408 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9db0b-6034-4b6e-9a4c-e9159eaf3a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:26.234821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9db0b-6034-4b6e-9a4c-e9159eaf3a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:26.235499 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9db0b-6034-4b6e-9a4c-e9159eaf3a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:26.247316 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9db0b-6034-4b6e-9a4c-e9159eaf3a60 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:26.284844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a5888-9823-411f-b232-fd857108f2fd service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:26.290106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b62a5888-9823-411f-b232-fd857108f2fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:26.296071 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 945/1890] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:26 2022] POST /identity/v3/projects => generated 391 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:35:26.297485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9db0b-6034-4b6e-9a4c-e9159eaf3a60 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:26.305610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a5888-9823-411f-b232-fd857108f2fd service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:26.373483 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b047319-ea09-40c5-a365-7ee102ff9fe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:26.374797 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b047319-ea09-40c5-a365-7ee102ff9fe6 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:26.375085 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b047319-ea09-40c5-a365-7ee102ff9fe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:26.375366 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b047319-ea09-40c5-a365-7ee102ff9fe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:26.376869 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9db0b-6034-4b6e-9a4c-e9159eaf3a60 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:26.384782 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6abf9f-dbd6-4207-bd60-0326b96b0443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:26.385712 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6abf9f-dbd6-4207-bd60-0326b96b0443 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:26.385846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6abf9f-dbd6-4207-bd60-0326b96b0443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:26.386166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6abf9f-dbd6-4207-bd60-0326b96b0443 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:26.386836 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6abf9f-dbd6-4207-bd60-0326b96b0443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:26.388948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6abf9f-dbd6-4207-bd60-0326b96b0443 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:26.420524 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 946/1891] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:26 2022] POST /identity/v3/users => generated 302 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:35:26.425105 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6abf9f-dbd6-4207-bd60-0326b96b0443 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:26.438841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6abf9f-dbd6-4207-bd60-0326b96b0443 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:26.445802 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f97c98-c8e4-46a8-873d-dbb8b9f2ea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:26.447074 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f97c98-c8e4-46a8-873d-dbb8b9f2ea8d admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:26.447665 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f97c98-c8e4-46a8-873d-dbb8b9f2ea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:26.448268 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f97c98-c8e4-46a8-873d-dbb8b9f2ea8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:26.449891 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f97c98-c8e4-46a8-873d-dbb8b9f2ea8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:26.451589 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f97c98-c8e4-46a8-873d-dbb8b9f2ea8d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:26.464846 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:26.469176 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 947/1892] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:26.470145 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f97c98-c8e4-46a8-873d-dbb8b9f2ea8d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:26.476617 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b047319-ea09-40c5-a365-7ee102ff9fe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:26.478126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b047319-ea09-40c5-a365-7ee102ff9fe6 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:26.483141 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f97c98-c8e4-46a8-873d-dbb8b9f2ea8d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:26.487975 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 946/1893] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:26.488756 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cc4c3-4d89-4049-9314-39d2894dc47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:26.490743 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cc4c3-4d89-4049-9314-39d2894dc47c admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:26.491340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cc4c3-4d89-4049-9314-39d2894dc47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:26.491626 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cc4c3-4d89-4049-9314-39d2894dc47c admin admin] PATH_INFO: `/v3/projects/5eb893b17d14493797a71618c613edec/users/e794e90bcb314a32a03375928144f457/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:26.511418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cc4c3-4d89-4049-9314-39d2894dc47c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb893b17d14493797a71618c613edec, user_id=e794e90bcb314a32a03375928144f457, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:26.518895 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cc4c3-4d89-4049-9314-39d2894dc47c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:26.530672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:26.537392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 948/1894] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:26 2022] PUT /identity/v3/projects/5eb893b17d14493797a71618c613edec/users/e794e90bcb314a32a03375928144f457/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:26.541848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b047319-ea09-40c5-a365-7ee102ff9fe6 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:26.554540 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b047319-ea09-40c5-a365-7ee102ff9fe6 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:26.626632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a828c5c-5fce-4cc9-a7db-2dcb151916dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:26.627408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a828c5c-5fce-4cc9-a7db-2dcb151916dd admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:26.627913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a828c5c-5fce-4cc9-a7db-2dcb151916dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:26.628192 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a828c5c-5fce-4cc9-a7db-2dcb151916dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:26.629190 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a828c5c-5fce-4cc9-a7db-2dcb151916dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:26.631294 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a828c5c-5fce-4cc9-a7db-2dcb151916dd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:26.644650 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 947/1895] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:26.650547 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cc4c3-4d89-4049-9314-39d2894dc47c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:26.664514 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cc4c3-4d89-4049-9314-39d2894dc47c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:26.669280 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efce9a1-3345-4faf-872c-3189cc1b9dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:26.670103 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efce9a1-3345-4faf-872c-3189cc1b9dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:26.670374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efce9a1-3345-4faf-872c-3189cc1b9dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:26.670767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efce9a1-3345-4faf-872c-3189cc1b9dfe admin admin] PATH_INFO: `/v3/projects/5eb893b17d14493797a71618c613edec/users/e794e90bcb314a32a03375928144f457/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:26.672950 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efce9a1-3345-4faf-872c-3189cc1b9dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb893b17d14493797a71618c613edec, user_id=e794e90bcb314a32a03375928144f457, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:26.676171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efce9a1-3345-4faf-872c-3189cc1b9dfe admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:26.687736 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 949/1896] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:26 2022] PUT /identity/v3/projects/5eb893b17d14493797a71618c613edec/users/e794e90bcb314a32a03375928144f457/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:26.698708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b0155-2eb7-47e2-ae6c-1ae6d65393ec None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:26.698996 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b0155-2eb7-47e2-ae6c-1ae6d65393ec None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:26.699293 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b0155-2eb7-47e2-ae6c-1ae6d65393ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:26.728887 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-628b0155-2eb7-47e2-ae6c-1ae6d65393ec None None] MFA Rules not processed for user `e794e90bcb314a32a03375928144f457`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:26.730151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-628b0155-2eb7-47e2-ae6c-1ae6d65393ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:26.815893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 948/1897] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:26.829077 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efce9a1-3345-4faf-872c-3189cc1b9dfe admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:26.902808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efce9a1-3345-4faf-872c-3189cc1b9dfe admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:26.907243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4972fc8-bec3-47f4-82cb-9999952b089e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:26.907921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4972fc8-bec3-47f4-82cb-9999952b089e service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:26.908407 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4972fc8-bec3-47f4-82cb-9999952b089e service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:26.908684 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4972fc8-bec3-47f4-82cb-9999952b089e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:26.919436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4972fc8-bec3-47f4-82cb-9999952b089e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:26.921255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4972fc8-bec3-47f4-82cb-9999952b089e service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:26.932744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 950/1898] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:27.007200 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b0155-2eb7-47e2-ae6c-1ae6d65393ec None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:27.033911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b0155-2eb7-47e2-ae6c-1ae6d65393ec None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:27.044599 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15325318-457c-4751-b820-994503a55673 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:27.045657 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15325318-457c-4751-b820-994503a55673 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:27.046114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15325318-457c-4751-b820-994503a55673 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:27.046304 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15325318-457c-4751-b820-994503a55673 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:27.125187 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15325318-457c-4751-b820-994503a55673 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:27.126866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15325318-457c-4751-b820-994503a55673 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:27.137969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 949/1899] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:31.093249 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4972fc8-bec3-47f4-82cb-9999952b089e service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:31.173379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4972fc8-bec3-47f4-82cb-9999952b089e service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:31.178970 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a30b3-1ec3-475c-84a3-f392be53fa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:31.179884 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a30b3-1ec3-475c-84a3-f392be53fa65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:31.180208 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a30b3-1ec3-475c-84a3-f392be53fa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:31.180490 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a30b3-1ec3-475c-84a3-f392be53fa65 admin admin] PATH_INFO: `/v3/users/b74cebd063ca4ee58857376ca488f577` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:31.181980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a30b3-1ec3-475c-84a3-f392be53fa65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b74cebd063ca4ee58857376ca488f577)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:31.183998 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a30b3-1ec3-475c-84a3-f392be53fa65 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:31.267237 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b82a30b3-1ec3-475c-84a3-f392be53fa65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b74cebd063ca4ee58857376ca488f577'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:31.267951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b82a30b3-1ec3-475c-84a3-f392be53fa65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b74cebd063ca4ee58857376ca488f577'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:31.268579 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b82a30b3-1ec3-475c-84a3-f392be53fa65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b74cebd063ca4ee58857376ca488f577'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:31.300367 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b82a30b3-1ec3-475c-84a3-f392be53fa65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b74cebd063ca4ee58857376ca488f577'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:31.311253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b82a30b3-1ec3-475c-84a3-f392be53fa65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b74cebd063ca4ee58857376ca488f577'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:31.338225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 951/1900] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:31 2022] DELETE /identity/v3/users/b74cebd063ca4ee58857376ca488f577 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:31.342695 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1514251-845f-43c5-a5c9-4d10c663419b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:31.343210 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1514251-845f-43c5-a5c9-4d10c663419b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:31.343312 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1514251-845f-43c5-a5c9-4d10c663419b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:31.380403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e1514251-845f-43c5-a5c9-4d10c663419b None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:31.382709 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e1514251-845f-43c5-a5c9-4d10c663419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:31.400308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:31.573788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 950/1901] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:31.643005 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a30b3-1ec3-475c-84a3-f392be53fa65 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:31.644942 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b82a30b3-1ec3-475c-84a3-f392be53fa65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:31.677158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:31.853076 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a30b3-1ec3-475c-84a3-f392be53fa65 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:31.858480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f322b47-e1e1-4605-8443-bc143e9f9d28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:31.859141 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f322b47-e1e1-4605-8443-bc143e9f9d28 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:31.859436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f322b47-e1e1-4605-8443-bc143e9f9d28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:31.860148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f322b47-e1e1-4605-8443-bc143e9f9d28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:31.873158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f322b47-e1e1-4605-8443-bc143e9f9d28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:31.876258 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f322b47-e1e1-4605-8443-bc143e9f9d28 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:31.891327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 952/1902] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:32.603678 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1514251-845f-43c5-a5c9-4d10c663419b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:32.605261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e1514251-845f-43c5-a5c9-4d10c663419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:32.619450 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1514251-845f-43c5-a5c9-4d10c663419b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:32.625954 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578aca35-93ac-476b-8cb0-86c4ecccd862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:32.626896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578aca35-93ac-476b-8cb0-86c4ecccd862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:32.627517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578aca35-93ac-476b-8cb0-86c4ecccd862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:32.627963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578aca35-93ac-476b-8cb0-86c4ecccd862 admin admin] PATH_INFO: `/v3/users/b139b0bcc8314dc7a983b0678f677e8d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:32.629513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578aca35-93ac-476b-8cb0-86c4ecccd862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b139b0bcc8314dc7a983b0678f677e8d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:32.631709 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578aca35-93ac-476b-8cb0-86c4ecccd862 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:32.715140 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-578aca35-93ac-476b-8cb0-86c4ecccd862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b139b0bcc8314dc7a983b0678f677e8d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:32.731767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-578aca35-93ac-476b-8cb0-86c4ecccd862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b139b0bcc8314dc7a983b0678f677e8d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:32.764552 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f322b47-e1e1-4605-8443-bc143e9f9d28 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:32.766799 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9f322b47-e1e1-4605-8443-bc143e9f9d28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:32.790483 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-578aca35-93ac-476b-8cb0-86c4ecccd862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b139b0bcc8314dc7a983b0678f677e8d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:32.811609 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f322b47-e1e1-4605-8443-bc143e9f9d28 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:32.836740 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-578aca35-93ac-476b-8cb0-86c4ecccd862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b139b0bcc8314dc7a983b0678f677e8d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:32.844918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-578aca35-93ac-476b-8cb0-86c4ecccd862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b139b0bcc8314dc7a983b0678f677e8d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:32.851015 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40bf9e-b0c1-46d9-b93c-0422d006d6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:32.857284 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40bf9e-b0c1-46d9-b93c-0422d006d6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:32.862484 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40bf9e-b0c1-46d9-b93c-0422d006d6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:32.864088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40bf9e-b0c1-46d9-b93c-0422d006d6f7 admin admin] PATH_INFO: `/v3/projects/28c92de5cd4a4fb89f84aabbd2433b38` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:32.873270 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40bf9e-b0c1-46d9-b93c-0422d006d6f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28c92de5cd4a4fb89f84aabbd2433b38)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:32.888187 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 951/1903] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:32 2022] DELETE /identity/v3/users/b139b0bcc8314dc7a983b0678f677e8d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:32.889267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40bf9e-b0c1-46d9-b93c-0422d006d6f7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:32.894422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02ef20-ceda-480c-8297-e94f6d0b2514 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:32.900089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02ef20-ceda-480c-8297-e94f6d0b2514 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:32.900858 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02ef20-ceda-480c-8297-e94f6d0b2514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:33.000538 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3c02ef20-ceda-480c-8297-e94f6d0b2514 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:33.004612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3c02ef20-ceda-480c-8297-e94f6d0b2514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:33.096364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cb40bf9e-b0c1-46d9-b93c-0422d006d6f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28c92de5cd4a4fb89f84aabbd2433b38', 'request_id': 'req-cb40bf9e-b0c1-46d9-b93c-0422d006d6f7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:33.119586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cb40bf9e-b0c1-46d9-b93c-0422d006d6f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28c92de5cd4a4fb89f84aabbd2433b38', 'request_id': 'req-cb40bf9e-b0c1-46d9-b93c-0422d006d6f7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:33.131629 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cb40bf9e-b0c1-46d9-b93c-0422d006d6f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28c92de5cd4a4fb89f84aabbd2433b38', 'request_id': 'req-cb40bf9e-b0c1-46d9-b93c-0422d006d6f7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:33.179097 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cb40bf9e-b0c1-46d9-b93c-0422d006d6f7 admin admin] The token cache is being invalidate because project 28c92de5cd4a4fb89f84aabbd2433b38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:33.179249 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cb40bf9e-b0c1-46d9-b93c-0422d006d6f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:33.182965 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cb40bf9e-b0c1-46d9-b93c-0422d006d6f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:33.194498 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 953/1904] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:32 2022] DELETE /identity/v3/projects/28c92de5cd4a4fb89f84aabbd2433b38 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:33.196831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40bf9e-b0c1-46d9-b93c-0422d006d6f7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:33.200681 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cb40bf9e-b0c1-46d9-b93c-0422d006d6f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:33.219564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 952/1905] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:33.238957 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02ef20-ceda-480c-8297-e94f6d0b2514 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:33.240878 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3c02ef20-ceda-480c-8297-e94f6d0b2514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:33.362367 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:33.408662 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40bf9e-b0c1-46d9-b93c-0422d006d6f7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:33.429241 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899e7c5-6acc-4027-8e88-42a08cdaca88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:33.430287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899e7c5-6acc-4027-8e88-42a08cdaca88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:33.430596 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899e7c5-6acc-4027-8e88-42a08cdaca88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:33.430881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899e7c5-6acc-4027-8e88-42a08cdaca88 admin admin] PATH_INFO: `/v3/users/e794e90bcb314a32a03375928144f457` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:33.433153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899e7c5-6acc-4027-8e88-42a08cdaca88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e794e90bcb314a32a03375928144f457)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:33.435680 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899e7c5-6acc-4027-8e88-42a08cdaca88 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:33.509767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02ef20-ceda-480c-8297-e94f6d0b2514 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:33.533043 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:33.561693 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0899e7c5-6acc-4027-8e88-42a08cdaca88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e794e90bcb314a32a03375928144f457'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:33.562501 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0899e7c5-6acc-4027-8e88-42a08cdaca88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e794e90bcb314a32a03375928144f457'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:33.563559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0899e7c5-6acc-4027-8e88-42a08cdaca88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e794e90bcb314a32a03375928144f457'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:33.631036 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0899e7c5-6acc-4027-8e88-42a08cdaca88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e794e90bcb314a32a03375928144f457'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:33.655294 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0899e7c5-6acc-4027-8e88-42a08cdaca88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e794e90bcb314a32a03375928144f457'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:33.687641 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 954/1906] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:33 2022] DELETE /identity/v3/users/e794e90bcb314a32a03375928144f457 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:33.698071 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4ba4c-6b71-44fe-b704-5906519de3f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:33.700870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4ba4c-6b71-44fe-b704-5906519de3f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:33.702511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4ba4c-6b71-44fe-b704-5906519de3f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:33.703272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4ba4c-6b71-44fe-b704-5906519de3f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:33.706178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-edc4ba4c-6b71-44fe-b704-5906519de3f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:33.729542 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4ba4c-6b71-44fe-b704-5906519de3f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:33.731605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4ba4c-6b71-44fe-b704-5906519de3f4 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:33.748505 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 953/1907] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:34.229066 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899e7c5-6acc-4027-8e88-42a08cdaca88 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:34.231291 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0899e7c5-6acc-4027-8e88-42a08cdaca88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:34.265149 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4ba4c-6b71-44fe-b704-5906519de3f4 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:34.268151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-edc4ba4c-6b71-44fe-b704-5906519de3f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:34.296170 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4ba4c-6b71-44fe-b704-5906519de3f4 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:34.381264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3540970-9e91-42c3-a20e-da477a513d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:34.382357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3540970-9e91-42c3-a20e-da477a513d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:34.382760 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3540970-9e91-42c3-a20e-da477a513d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:34.383141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3540970-9e91-42c3-a20e-da477a513d0c admin admin] PATH_INFO: `/v3/users/98582ba48a95412e89fc973405bbe1e8` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:34.384787 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3540970-9e91-42c3-a20e-da477a513d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=98582ba48a95412e89fc973405bbe1e8)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:34.388040 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3540970-9e91-42c3-a20e-da477a513d0c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:34.404997 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899e7c5-6acc-4027-8e88-42a08cdaca88 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:34.412465 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c9be4-53cc-4146-94fb-19bccf34b9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:34.413949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c9be4-53cc-4146-94fb-19bccf34b9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:34.414432 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c9be4-53cc-4146-94fb-19bccf34b9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:34.414970 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c9be4-53cc-4146-94fb-19bccf34b9f4 admin admin] PATH_INFO: `/v3/projects/5eb893b17d14493797a71618c613edec` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:34.417627 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c9be4-53cc-4146-94fb-19bccf34b9f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb893b17d14493797a71618c613edec)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:34.420394 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c9be4-53cc-4146-94fb-19bccf34b9f4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:34.498824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a3540970-9e91-42c3-a20e-da477a513d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98582ba48a95412e89fc973405bbe1e8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:34.507858 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e17c9be4-53cc-4146-94fb-19bccf34b9f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb893b17d14493797a71618c613edec', 'request_id': 'req-e17c9be4-53cc-4146-94fb-19bccf34b9f4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:34.521495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a3540970-9e91-42c3-a20e-da477a513d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98582ba48a95412e89fc973405bbe1e8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:34.530363 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e17c9be4-53cc-4146-94fb-19bccf34b9f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb893b17d14493797a71618c613edec', 'request_id': 'req-e17c9be4-53cc-4146-94fb-19bccf34b9f4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:34.541480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e17c9be4-53cc-4146-94fb-19bccf34b9f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb893b17d14493797a71618c613edec', 'request_id': 'req-e17c9be4-53cc-4146-94fb-19bccf34b9f4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:34.543000 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a3540970-9e91-42c3-a20e-da477a513d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98582ba48a95412e89fc973405bbe1e8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:34.555150 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a3540970-9e91-42c3-a20e-da477a513d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98582ba48a95412e89fc973405bbe1e8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:34.556126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a3540970-9e91-42c3-a20e-da477a513d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98582ba48a95412e89fc973405bbe1e8'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:34.559430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e17c9be4-53cc-4146-94fb-19bccf34b9f4 admin admin] The token cache is being invalidate because project 5eb893b17d14493797a71618c613edec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:34.560083 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e17c9be4-53cc-4146-94fb-19bccf34b9f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:34.560877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e17c9be4-53cc-4146-94fb-19bccf34b9f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:34.569044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 954/1908] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:34 2022] DELETE /identity/v3/users/98582ba48a95412e89fc973405bbe1e8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:34.574065 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c2712-af2a-4806-802c-b1b918f592e8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:34.574065 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c2712-af2a-4806-802c-b1b918f592e8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:34.574065 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c2712-af2a-4806-802c-b1b918f592e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:34.578805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 955/1909] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:34 2022] DELETE /identity/v3/projects/5eb893b17d14493797a71618c613edec => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:34.580467 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931437d7-ba2e-4ecd-9b0c-7d85e1404a0f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:34.580767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931437d7-ba2e-4ecd-9b0c-7d85e1404a0f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:34.581054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931437d7-ba2e-4ecd-9b0c-7d85e1404a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:34.585181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:34.602906 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-931437d7-ba2e-4ecd-9b0c-7d85e1404a0f None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:34.604313 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-931437d7-ba2e-4ecd-9b0c-7d85e1404a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:34.627820 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2d3c2712-af2a-4806-802c-b1b918f592e8 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:34.630285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2d3c2712-af2a-4806-802c-b1b918f592e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:34.676276 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:34.719196 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 956/1910] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:34.734930 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf241e91-e41d-46ac-a386-4893a5506387 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:34.734930 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf241e91-e41d-46ac-a386-4893a5506387 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:34.734930 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf241e91-e41d-46ac-a386-4893a5506387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:34.746467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 955/1911] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:34.770948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-cf241e91-e41d-46ac-a386-4893a5506387 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:34.772292 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cf241e91-e41d-46ac-a386-4893a5506387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:34.794173 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 957/1912] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:34.795479 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c2712-af2a-4806-802c-b1b918f592e8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:34.796971 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf241e91-e41d-46ac-a386-4893a5506387 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:34.798804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cf241e91-e41d-46ac-a386-4893a5506387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:34.807381 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c2712-af2a-4806-802c-b1b918f592e8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:34.822323 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f244b9-d391-46c0-8d60-3f5ff12e02f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:34.823183 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f244b9-d391-46c0-8d60-3f5ff12e02f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:34.823545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f244b9-d391-46c0-8d60-3f5ff12e02f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:34.823924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f244b9-d391-46c0-8d60-3f5ff12e02f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:34.825128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f244b9-d391-46c0-8d60-3f5ff12e02f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:34.825443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f244b9-d391-46c0-8d60-3f5ff12e02f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:34.833721 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f244b9-d391-46c0-8d60-3f5ff12e02f8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:34.870558 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf241e91-e41d-46ac-a386-4893a5506387 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:34.875406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263eb01-a7a5-4d8a-82c5-b10802fa30a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:34.875406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263eb01-a7a5-4d8a-82c5-b10802fa30a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:34.875701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263eb01-a7a5-4d8a-82c5-b10802fa30a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:34.875793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263eb01-a7a5-4d8a-82c5-b10802fa30a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:34.888555 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263eb01-a7a5-4d8a-82c5-b10802fa30a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:34.890057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263eb01-a7a5-4d8a-82c5-b10802fa30a1 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:34.906199 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 956/1913] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:35:34.908511 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 958/1914] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:35:34.916696 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f244b9-d391-46c0-8d60-3f5ff12e02f8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:34.961525 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f244b9-d391-46c0-8d60-3f5ff12e02f8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:34.962795 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263eb01-a7a5-4d8a-82c5-b10802fa30a1 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:34.968065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3263eb01-a7a5-4d8a-82c5-b10802fa30a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:34.985218 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b95434-7e8d-48eb-a75a-48cab8b529b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:34.986022 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263eb01-a7a5-4d8a-82c5-b10802fa30a1 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:34.987815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b95434-7e8d-48eb-a75a-48cab8b529b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:34.993723 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b95434-7e8d-48eb-a75a-48cab8b529b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:34.995231 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b95434-7e8d-48eb-a75a-48cab8b529b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:35.000263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b95434-7e8d-48eb-a75a-48cab8b529b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:35.001281 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce6fec-5d12-4e4e-bcde-c8ef12b37167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:35.002199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce6fec-5d12-4e4e-bcde-c8ef12b37167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:35.002485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce6fec-5d12-4e4e-bcde-c8ef12b37167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:35.002761 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce6fec-5d12-4e4e-bcde-c8ef12b37167 admin admin] PATH_INFO: `/v3/users/29b3899ad8f0442189326df5515d0050` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:35.004671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b95434-7e8d-48eb-a75a-48cab8b529b6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:35.004855 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce6fec-5d12-4e4e-bcde-c8ef12b37167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b3899ad8f0442189326df5515d0050)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:35.010027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce6fec-5d12-4e4e-bcde-c8ef12b37167 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:35.096780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 957/1915] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:34 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:35.101449 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b95434-7e8d-48eb-a75a-48cab8b529b6 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:35.139680 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-76ce6fec-5d12-4e4e-bcde-c8ef12b37167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b3899ad8f0442189326df5515d0050'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:35.140659 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-76ce6fec-5d12-4e4e-bcde-c8ef12b37167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b3899ad8f0442189326df5515d0050'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:35.142556 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-76ce6fec-5d12-4e4e-bcde-c8ef12b37167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b3899ad8f0442189326df5515d0050'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:35.159608 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-76ce6fec-5d12-4e4e-bcde-c8ef12b37167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b3899ad8f0442189326df5515d0050'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:35.170344 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-76ce6fec-5d12-4e4e-bcde-c8ef12b37167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b3899ad8f0442189326df5515d0050'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:35.188509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 959/1916] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:34 2022] DELETE /identity/v3/users/29b3899ad8f0442189326df5515d0050 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:35.194369 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0da88b-a36f-4da1-8524-0dbbb4f2701f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:35.194662 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0da88b-a36f-4da1-8524-0dbbb4f2701f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:35.194945 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0da88b-a36f-4da1-8524-0dbbb4f2701f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:35.227436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fa0da88b-a36f-4da1-8524-0dbbb4f2701f None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:35.230709 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fa0da88b-a36f-4da1-8524-0dbbb4f2701f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:35.247084 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b95434-7e8d-48eb-a75a-48cab8b529b6 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:35.304872 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:35.342515 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 960/1917] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:35.356626 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0da88b-a36f-4da1-8524-0dbbb4f2701f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:35.358096 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fa0da88b-a36f-4da1-8524-0dbbb4f2701f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:35.372454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84ac9c-866a-4eba-aede-9c51604c8531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:35.373190 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84ac9c-866a-4eba-aede-9c51604c8531 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:35.373480 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84ac9c-866a-4eba-aede-9c51604c8531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:35.373763 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84ac9c-866a-4eba-aede-9c51604c8531 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:35.374503 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84ac9c-866a-4eba-aede-9c51604c8531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:35.376645 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84ac9c-866a-4eba-aede-9c51604c8531 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:35.427022 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 958/1918] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:35 2022] POST /identity/v3/users => generated 292 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:35.432158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84ac9c-866a-4eba-aede-9c51604c8531 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:35.434634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3b84ac9c-866a-4eba-aede-9c51604c8531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:35.453163 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:35.465014 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84ac9c-866a-4eba-aede-9c51604c8531 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:35.483406 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2ca90-1bfe-4f4d-9a8a-b556b4a1eb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:35.484254 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2ca90-1bfe-4f4d-9a8a-b556b4a1eb0a admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:35.484547 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2ca90-1bfe-4f4d-9a8a-b556b4a1eb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:35.484828 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2ca90-1bfe-4f4d-9a8a-b556b4a1eb0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:35.486365 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2ca90-1bfe-4f4d-9a8a-b556b4a1eb0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:35.488468 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0da88b-a36f-4da1-8524-0dbbb4f2701f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:35.491401 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2ca90-1bfe-4f4d-9a8a-b556b4a1eb0a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:35.497263 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fee39-a6d2-46c2-8775-934d0e7f8cd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:35.498332 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fee39-a6d2-46c2-8775-934d0e7f8cd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:35.498619 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fee39-a6d2-46c2-8775-934d0e7f8cd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:35.498894 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fee39-a6d2-46c2-8775-934d0e7f8cd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:35.522916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 959/1919] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:35:35.530702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2ca90-1bfe-4f4d-9a8a-b556b4a1eb0a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:35.533010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fee39-a6d2-46c2-8775-934d0e7f8cd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:35.538914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fee39-a6d2-46c2-8775-934d0e7f8cd7 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:35.555321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2ca90-1bfe-4f4d-9a8a-b556b4a1eb0a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:35.570369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0ba63-41f4-45c5-bc90-071721ded3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:35.571074 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0ba63-41f4-45c5-bc90-071721ded3bd admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:35.572196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0ba63-41f4-45c5-bc90-071721ded3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:35.572196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0ba63-41f4-45c5-bc90-071721ded3bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:35.573236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 961/1920] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:35.573588 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0ba63-41f4-45c5-bc90-071721ded3bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:35.576609 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0ba63-41f4-45c5-bc90-071721ded3bd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:35.600456 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 960/1921] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:35.600787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fee39-a6d2-46c2-8775-934d0e7f8cd7 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:35.612228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fee39-a6d2-46c2-8775-934d0e7f8cd7 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:35.625912 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e7903-b8d1-4a2b-9eb5-4b4d9dc61d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:35.629653 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e7903-b8d1-4a2b-9eb5-4b4d9dc61d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:35.630010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e7903-b8d1-4a2b-9eb5-4b4d9dc61d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:35.630397 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e7903-b8d1-4a2b-9eb5-4b4d9dc61d1f admin admin] PATH_INFO: `/v3/projects/2112b9b773b640b0a68ea3fdd8c2b13f/users/9d0c8cc6bda44c21990c5cc2dc4f14d4/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:35.660400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e7903-b8d1-4a2b-9eb5-4b4d9dc61d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2112b9b773b640b0a68ea3fdd8c2b13f, user_id=9d0c8cc6bda44c21990c5cc2dc4f14d4, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:35.666592 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0ba63-41f4-45c5-bc90-071721ded3bd admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:35.669105 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e7903-b8d1-4a2b-9eb5-4b4d9dc61d1f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:35.669438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d4a0ba63-41f4-45c5-bc90-071721ded3bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:35.705628 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 962/1922] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:35 2022] PUT /identity/v3/projects/2112b9b773b640b0a68ea3fdd8c2b13f/users/9d0c8cc6bda44c21990c5cc2dc4f14d4/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:35.707471 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcaeeb-2108-4dfe-8492-4e1fb3743c9b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:35.707817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcaeeb-2108-4dfe-8492-4e1fb3743c9b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:35.708159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcaeeb-2108-4dfe-8492-4e1fb3743c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:35.722644 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0ba63-41f4-45c5-bc90-071721ded3bd admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:35.748626 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4ebcaeeb-2108-4dfe-8492-4e1fb3743c9b None None] MFA Rules not processed for user `9d0c8cc6bda44c21990c5cc2dc4f14d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:35.750230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4ebcaeeb-2108-4dfe-8492-4e1fb3743c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:35.891186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1ba24-d959-4258-b5b8-0dfd5bae5e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:35.892301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1ba24-d959-4258-b5b8-0dfd5bae5e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:35.892686 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1ba24-d959-4258-b5b8-0dfd5bae5e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:35.893061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1ba24-d959-4258-b5b8-0dfd5bae5e17 admin admin] PATH_INFO: `/v3/projects/38bd300695b4458481dd9dfb1912b952` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:35.897837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1ba24-d959-4258-b5b8-0dfd5bae5e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38bd300695b4458481dd9dfb1912b952)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:35.900151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1ba24-d959-4258-b5b8-0dfd5bae5e17 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:35.923463 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 963/1923] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:35.929960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcaeeb-2108-4dfe-8492-4e1fb3743c9b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:35.948429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcaeeb-2108-4dfe-8492-4e1fb3743c9b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:35.955842 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f29304-4e74-4809-935c-9dca137045fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:35.957187 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f29304-4e74-4809-935c-9dca137045fa admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:35.957580 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f29304-4e74-4809-935c-9dca137045fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:35.957954 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f29304-4e74-4809-935c-9dca137045fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:35.958810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f29304-4e74-4809-935c-9dca137045fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:35.961581 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f29304-4e74-4809-935c-9dca137045fa admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:36.011576 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 964/1924] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:35 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:36.013059 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f29304-4e74-4809-935c-9dca137045fa admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:36.059538 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3fd1ba24-d959-4258-b5b8-0dfd5bae5e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38bd300695b4458481dd9dfb1912b952', 'request_id': 'req-3fd1ba24-d959-4258-b5b8-0dfd5bae5e17'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:36.086520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3fd1ba24-d959-4258-b5b8-0dfd5bae5e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38bd300695b4458481dd9dfb1912b952', 'request_id': 'req-3fd1ba24-d959-4258-b5b8-0dfd5bae5e17'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:36.094560 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:36.103248 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3fd1ba24-d959-4258-b5b8-0dfd5bae5e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38bd300695b4458481dd9dfb1912b952', 'request_id': 'req-3fd1ba24-d959-4258-b5b8-0dfd5bae5e17'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:36.122946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3fd1ba24-d959-4258-b5b8-0dfd5bae5e17 admin admin] The token cache is being invalidate because project 38bd300695b4458481dd9dfb1912b952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:36.123354 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3fd1ba24-d959-4258-b5b8-0dfd5bae5e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:36.124175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-3fd1ba24-d959-4258-b5b8-0dfd5bae5e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:36.130495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 961/1925] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:35 2022] DELETE /identity/v3/projects/38bd300695b4458481dd9dfb1912b952 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:36.137317 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f2585-c8a7-4a6a-a63d-3e129f8eb8be None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:36.137773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f2585-c8a7-4a6a-a63d-3e129f8eb8be None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:36.138158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f2585-c8a7-4a6a-a63d-3e129f8eb8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:36.142011 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f29304-4e74-4809-935c-9dca137045fa admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:36.153367 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d65e2-9a20-4d75-8d58-4beb9a0ba8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:36.155485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d65e2-9a20-4d75-8d58-4beb9a0ba8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:36.155485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d65e2-9a20-4d75-8d58-4beb9a0ba8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:36.155485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d65e2-9a20-4d75-8d58-4beb9a0ba8f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:36.156825 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d65e2-9a20-4d75-8d58-4beb9a0ba8f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:36.159759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d65e2-9a20-4d75-8d58-4beb9a0ba8f3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:36.179780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ee7f2585-c8a7-4a6a-a63d-3e129f8eb8be None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:36.183337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ee7f2585-c8a7-4a6a-a63d-3e129f8eb8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:36.208466 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 965/1926] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:36 2022] POST /identity/v3/users => generated 298 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:36.214384 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d65e2-9a20-4d75-8d58-4beb9a0ba8f3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:36.222638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 962/1927] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:36.233638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945e874-9286-42e4-a0ce-576f2e10d8d4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:36.233935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945e874-9286-42e4-a0ce-576f2e10d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:36.234311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f90d65e2-9a20-4d75-8d58-4beb9a0ba8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:36.236362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945e874-9286-42e4-a0ce-576f2e10d8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:36.281170 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7945e874-9286-42e4-a0ce-576f2e10d8d4 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:36.283288 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7945e874-9286-42e4-a0ce-576f2e10d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:36.285024 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d65e2-9a20-4d75-8d58-4beb9a0ba8f3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:36.299840 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 963/1928] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:36.301784 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945e874-9286-42e4-a0ce-576f2e10d8d4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:36.314865 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc35b13-b07a-4624-a2f6-f9183b7e4244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:36.315661 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35b13-b07a-4624-a2f6-f9183b7e4244 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:36.316055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35b13-b07a-4624-a2f6-f9183b7e4244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:36.316409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35b13-b07a-4624-a2f6-f9183b7e4244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:36.317232 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc35b13-b07a-4624-a2f6-f9183b7e4244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:36.319125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc35b13-b07a-4624-a2f6-f9183b7e4244 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:36.320282 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945e874-9286-42e4-a0ce-576f2e10d8d4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:36.340597 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0f066-e33e-4122-90e3-4e1a4f7c94bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:36.342298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 966/1929] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:36.343598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0f066-e33e-4122-90e3-4e1a4f7c94bd admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:36.344160 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0f066-e33e-4122-90e3-4e1a4f7c94bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:36.344738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c0f066-e33e-4122-90e3-4e1a4f7c94bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:36.346666 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0f066-e33e-4122-90e3-4e1a4f7c94bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:36.347072 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc35b13-b07a-4624-a2f6-f9183b7e4244 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:36.347209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0f066-e33e-4122-90e3-4e1a4f7c94bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:36.352513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c0f066-e33e-4122-90e3-4e1a4f7c94bd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:36.372118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc35b13-b07a-4624-a2f6-f9183b7e4244 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:36.385832 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2b91f-e089-40e5-b708-2a15182346d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:36.387710 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2b91f-e089-40e5-b708-2a15182346d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:36.388936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2b91f-e089-40e5-b708-2a15182346d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:36.390028 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 964/1930] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:35:36.390156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2b91f-e089-40e5-b708-2a15182346d5 admin admin] PATH_INFO: `/v3/projects/1e847831dc384e6e90b5128317da2e8d/users/bc28d7f3118945a28a3d5ed4b8754c14/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:36.398239 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0f066-e33e-4122-90e3-4e1a4f7c94bd admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:36.433039 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c0f066-e33e-4122-90e3-4e1a4f7c94bd admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:36.459249 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2b91f-e089-40e5-b708-2a15182346d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e847831dc384e6e90b5128317da2e8d, user_id=bc28d7f3118945a28a3d5ed4b8754c14, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:36.459473 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c42e95-3407-4a13-b07c-2403c3862816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:36.460299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c42e95-3407-4a13-b07c-2403c3862816 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:36.460480 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c42e95-3407-4a13-b07c-2403c3862816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:36.460724 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c42e95-3407-4a13-b07c-2403c3862816 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:36.461448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c42e95-3407-4a13-b07c-2403c3862816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:36.463416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c42e95-3407-4a13-b07c-2403c3862816 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:36.473779 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2b91f-e089-40e5-b708-2a15182346d5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:36.523684 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 967/1931] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:36 2022] PUT /identity/v3/projects/1e847831dc384e6e90b5128317da2e8d/users/bc28d7f3118945a28a3d5ed4b8754c14/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:36.532229 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2b91f-e089-40e5-b708-2a15182346d5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:36.544806 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 965/1932] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:36 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:36.550616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c42e95-3407-4a13-b07c-2403c3862816 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:36.623581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:36.703305 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c42e95-3407-4a13-b07c-2403c3862816 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:36.710996 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a35410-576d-4cc5-9748-ca470662f0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:36.711862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a35410-576d-4cc5-9748-ca470662f0ef admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:36.712629 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a35410-576d-4cc5-9748-ca470662f0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:36.712964 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a35410-576d-4cc5-9748-ca470662f0ef admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:36.713908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a35410-576d-4cc5-9748-ca470662f0ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:36.716108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a35410-576d-4cc5-9748-ca470662f0ef admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:36.733754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2b91f-e089-40e5-b708-2a15182346d5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:36.740806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160547c7-ecc5-48d3-8a00-0a236d24802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:36.741652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160547c7-ecc5-48d3-8a00-0a236d24802a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:36.742006 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160547c7-ecc5-48d3-8a00-0a236d24802a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:36.742356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160547c7-ecc5-48d3-8a00-0a236d24802a admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:36.743282 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160547c7-ecc5-48d3-8a00-0a236d24802a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:36.745068 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160547c7-ecc5-48d3-8a00-0a236d24802a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:36.759652 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 966/1933] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:36 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:36.761155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a35410-576d-4cc5-9748-ca470662f0ef admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:36.762796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 968/1934] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:36.763835 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d8a35410-576d-4cc5-9748-ca470662f0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:36.763981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160547c7-ecc5-48d3-8a00-0a236d24802a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:36.765705 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-160547c7-ecc5-48d3-8a00-0a236d24802a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:36.783913 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160547c7-ecc5-48d3-8a00-0a236d24802a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:36.784693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a35410-576d-4cc5-9748-ca470662f0ef admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:36.790325 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2606c8e-536a-41c2-84bb-49d44594f1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:36.791222 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1678fa6-3c0d-430f-a961-00e65db25e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:36.791378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2606c8e-536a-41c2-84bb-49d44594f1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:36.791672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2606c8e-536a-41c2-84bb-49d44594f1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:36.791952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2606c8e-536a-41c2-84bb-49d44594f1de admin admin] PATH_INFO: `/v3/projects/5e9631bcf12f4cc5bc0e71d0a0b0a932` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:36.793065 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1678fa6-3c0d-430f-a961-00e65db25e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:36.793324 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2606c8e-536a-41c2-84bb-49d44594f1de admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e9631bcf12f4cc5bc0e71d0a0b0a932)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:36.793677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1678fa6-3c0d-430f-a961-00e65db25e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:36.794133 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1678fa6-3c0d-430f-a961-00e65db25e08 admin admin] PATH_INFO: `/v3/users/a6b94a5619864811a22bdf949e56ee77` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:36.795571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2606c8e-536a-41c2-84bb-49d44594f1de admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:36.795862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1678fa6-3c0d-430f-a961-00e65db25e08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b94a5619864811a22bdf949e56ee77)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:36.798773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1678fa6-3c0d-430f-a961-00e65db25e08 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:36.879548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1678fa6-3c0d-430f-a961-00e65db25e08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b94a5619864811a22bdf949e56ee77'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:36.890093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1678fa6-3c0d-430f-a961-00e65db25e08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b94a5619864811a22bdf949e56ee77'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:36.890617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f2606c8e-536a-41c2-84bb-49d44594f1de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e9631bcf12f4cc5bc0e71d0a0b0a932', 'request_id': 'req-f2606c8e-536a-41c2-84bb-49d44594f1de'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:36.914410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f2606c8e-536a-41c2-84bb-49d44594f1de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e9631bcf12f4cc5bc0e71d0a0b0a932', 'request_id': 'req-f2606c8e-536a-41c2-84bb-49d44594f1de'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:36.930154 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1678fa6-3c0d-430f-a961-00e65db25e08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b94a5619864811a22bdf949e56ee77'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:36.931253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f2606c8e-536a-41c2-84bb-49d44594f1de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e9631bcf12f4cc5bc0e71d0a0b0a932', 'request_id': 'req-f2606c8e-536a-41c2-84bb-49d44594f1de'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:36.941871 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1678fa6-3c0d-430f-a961-00e65db25e08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b94a5619864811a22bdf949e56ee77'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:36.943512 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1678fa6-3c0d-430f-a961-00e65db25e08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b94a5619864811a22bdf949e56ee77'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:36.946160 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f2606c8e-536a-41c2-84bb-49d44594f1de admin admin] The token cache is being invalidate because project 5e9631bcf12f4cc5bc0e71d0a0b0a932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:36.946825 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f2606c8e-536a-41c2-84bb-49d44594f1de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:36.947277 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f2606c8e-536a-41c2-84bb-49d44594f1de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:36.948995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 969/1935] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:36 2022] DELETE /identity/v3/projects/5e9631bcf12f4cc5bc0e71d0a0b0a932 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:36.950370 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2606c8e-536a-41c2-84bb-49d44594f1de admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:36.953516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 967/1936] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:36 2022] DELETE /identity/v3/users/a6b94a5619864811a22bdf949e56ee77 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:36.954545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1678fa6-3c0d-430f-a961-00e65db25e08 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:36.954993 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f2606c8e-536a-41c2-84bb-49d44594f1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:36.967060 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d1678fa6-3c0d-430f-a961-00e65db25e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:36.988058 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:37.108691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2606c8e-536a-41c2-84bb-49d44594f1de admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:37.129514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1678fa6-3c0d-430f-a961-00e65db25e08 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:37.135235 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119f296-da20-4dcf-a715-d5b699947fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:37.136333 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119f296-da20-4dcf-a715-d5b699947fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:37.137243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119f296-da20-4dcf-a715-d5b699947fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:37.137708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119f296-da20-4dcf-a715-d5b699947fbd admin admin] PATH_INFO: `/v3/projects/1e847831dc384e6e90b5128317da2e8d/users/bc28d7f3118945a28a3d5ed4b8754c14/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:37.141044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119f296-da20-4dcf-a715-d5b699947fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e847831dc384e6e90b5128317da2e8d, user_id=bc28d7f3118945a28a3d5ed4b8754c14, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:37.145907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119f296-da20-4dcf-a715-d5b699947fbd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:37.164624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 968/1937] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:36 2022] PUT /identity/v3/projects/1e847831dc384e6e90b5128317da2e8d/users/bc28d7f3118945a28a3d5ed4b8754c14/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:37.174874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119f296-da20-4dcf-a715-d5b699947fbd admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:37.174874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e119f296-da20-4dcf-a715-d5b699947fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:37.213642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe611e8-1192-4012-9cca-3e141935ba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:37.215448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe611e8-1192-4012-9cca-3e141935ba55 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:37.215736 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe611e8-1192-4012-9cca-3e141935ba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:37.216072 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe611e8-1192-4012-9cca-3e141935ba55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:37.217334 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe611e8-1192-4012-9cca-3e141935ba55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:37.221303 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe611e8-1192-4012-9cca-3e141935ba55 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:37.223647 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:37.255388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 970/1938] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:37.256399 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe611e8-1192-4012-9cca-3e141935ba55 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:37.258537 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bbe611e8-1192-4012-9cca-3e141935ba55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:37.278307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe611e8-1192-4012-9cca-3e141935ba55 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:37.347116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119f296-da20-4dcf-a715-d5b699947fbd admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:37.356263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea72d8-53e6-45f2-99cf-af97f0d3296a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:37.357528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea72d8-53e6-45f2-99cf-af97f0d3296a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:37.357760 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea72d8-53e6-45f2-99cf-af97f0d3296a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:37.358129 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea72d8-53e6-45f2-99cf-af97f0d3296a admin admin] PATH_INFO: `/v3/users/5bc21fb411214a6eb187371962077f89` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:37.359730 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea72d8-53e6-45f2-99cf-af97f0d3296a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bc21fb411214a6eb187371962077f89)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:37.362837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea72d8-53e6-45f2-99cf-af97f0d3296a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:37.368372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e150c9-d397-45d4-b8b5-199c8054e1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:37.369313 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e150c9-d397-45d4-b8b5-199c8054e1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:37.369693 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e150c9-d397-45d4-b8b5-199c8054e1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:37.370067 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e150c9-d397-45d4-b8b5-199c8054e1b6 admin admin] PATH_INFO: `/v3/projects/1a6e4222a7e04fd4bb5316c47c94bc87` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:37.371423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e150c9-d397-45d4-b8b5-199c8054e1b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a6e4222a7e04fd4bb5316c47c94bc87)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:37.373525 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e150c9-d397-45d4-b8b5-199c8054e1b6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:37.427480 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2cea72d8-53e6-45f2-99cf-af97f0d3296a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bc21fb411214a6eb187371962077f89'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.437994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2cea72d8-53e6-45f2-99cf-af97f0d3296a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bc21fb411214a6eb187371962077f89'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.439562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-38e150c9-d397-45d4-b8b5-199c8054e1b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a6e4222a7e04fd4bb5316c47c94bc87', 'request_id': 'req-38e150c9-d397-45d4-b8b5-199c8054e1b6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.449291 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-38e150c9-d397-45d4-b8b5-199c8054e1b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a6e4222a7e04fd4bb5316c47c94bc87', 'request_id': 'req-38e150c9-d397-45d4-b8b5-199c8054e1b6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.451944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:37.454303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2cea72d8-53e6-45f2-99cf-af97f0d3296a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bc21fb411214a6eb187371962077f89'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.463107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-38e150c9-d397-45d4-b8b5-199c8054e1b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a6e4222a7e04fd4bb5316c47c94bc87', 'request_id': 'req-38e150c9-d397-45d4-b8b5-199c8054e1b6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.463587 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2cea72d8-53e6-45f2-99cf-af97f0d3296a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bc21fb411214a6eb187371962077f89'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.465011 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2cea72d8-53e6-45f2-99cf-af97f0d3296a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bc21fb411214a6eb187371962077f89'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.475518 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 969/1939] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:37 2022] DELETE /identity/v3/users/5bc21fb411214a6eb187371962077f89 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:37.481819 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-38e150c9-d397-45d4-b8b5-199c8054e1b6 admin admin] The token cache is being invalidate because project 1a6e4222a7e04fd4bb5316c47c94bc87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:37.482885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-38e150c9-d397-45d4-b8b5-199c8054e1b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.483674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-38e150c9-d397-45d4-b8b5-199c8054e1b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.485617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 971/1940] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:37 2022] DELETE /identity/v3/projects/1a6e4222a7e04fd4bb5316c47c94bc87 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:37.489387 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e150c9-d397-45d4-b8b5-199c8054e1b6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:37.489387 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-38e150c9-d397-45d4-b8b5-199c8054e1b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:37.491515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f38d5-0350-46c7-a5b9-67b741c2923c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:37.493874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f38d5-0350-46c7-a5b9-67b741c2923c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:37.494538 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f38d5-0350-46c7-a5b9-67b741c2923c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:37.566925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-724f38d5-0350-46c7-a5b9-67b741c2923c None None] MFA Rules not processed for user `bc28d7f3118945a28a3d5ed4b8754c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:37.569609 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-724f38d5-0350-46c7-a5b9-67b741c2923c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:37.615362 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e150c9-d397-45d4-b8b5-199c8054e1b6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:37.705451 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 970/1941] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:37.706382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f38d5-0350-46c7-a5b9-67b741c2923c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:37.707781 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-724f38d5-0350-46c7-a5b9-67b741c2923c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:37.712940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a1f91-4cc8-408f-a680-65d382a1c356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:37.714188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a1f91-4cc8-408f-a680-65d382a1c356 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:37.714651 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a1f91-4cc8-408f-a680-65d382a1c356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:37.715117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a1f91-4cc8-408f-a680-65d382a1c356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:37.716793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a1f91-4cc8-408f-a680-65d382a1c356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:37.720213 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a1f91-4cc8-408f-a680-65d382a1c356 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:37.732840 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f38d5-0350-46c7-a5b9-67b741c2923c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:37.745617 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238958a0-0c15-4b53-9b14-58e7504d9ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:37.746544 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238958a0-0c15-4b53-9b14-58e7504d9ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:37.746833 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238958a0-0c15-4b53-9b14-58e7504d9ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:37.747170 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238958a0-0c15-4b53-9b14-58e7504d9ab4 admin admin] PATH_INFO: `/v3/projects/9b5bab75d5954ef4be88addb4148d302` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:37.748457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238958a0-0c15-4b53-9b14-58e7504d9ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b5bab75d5954ef4be88addb4148d302)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:37.750518 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238958a0-0c15-4b53-9b14-58e7504d9ab4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:37.758506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 972/1942] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:37.759693 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a1f91-4cc8-408f-a680-65d382a1c356 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:37.763864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-672a1f91-4cc8-408f-a680-65d382a1c356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:37.779938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a1f91-4cc8-408f-a680-65d382a1c356 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:37.781688 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:37.789630 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c9708-ba22-4e6a-8b27-e8b08958c820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:37.791450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c9708-ba22-4e6a-8b27-e8b08958c820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:37.792259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c9708-ba22-4e6a-8b27-e8b08958c820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:37.792259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c9708-ba22-4e6a-8b27-e8b08958c820 admin admin] PATH_INFO: `/v3/users/4f08b8baf47440268072a133f80deb22` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:37.794502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c9708-ba22-4e6a-8b27-e8b08958c820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f08b8baf47440268072a133f80deb22)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:37.796881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c9708-ba22-4e6a-8b27-e8b08958c820 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:37.820311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-238958a0-0c15-4b53-9b14-58e7504d9ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b5bab75d5954ef4be88addb4148d302', 'request_id': 'req-238958a0-0c15-4b53-9b14-58e7504d9ab4'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.828653 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-238958a0-0c15-4b53-9b14-58e7504d9ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b5bab75d5954ef4be88addb4148d302', 'request_id': 'req-238958a0-0c15-4b53-9b14-58e7504d9ab4'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.839031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-238958a0-0c15-4b53-9b14-58e7504d9ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b5bab75d5954ef4be88addb4148d302', 'request_id': 'req-238958a0-0c15-4b53-9b14-58e7504d9ab4'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.857188 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-238958a0-0c15-4b53-9b14-58e7504d9ab4 admin admin] The token cache is being invalidate because project 9b5bab75d5954ef4be88addb4148d302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:37.857610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-238958a0-0c15-4b53-9b14-58e7504d9ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.858818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-238958a0-0c15-4b53-9b14-58e7504d9ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.867341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 971/1943] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:37 2022] DELETE /identity/v3/projects/9b5bab75d5954ef4be88addb4148d302 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:37.867341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238958a0-0c15-4b53-9b14-58e7504d9ab4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:37.867341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-238958a0-0c15-4b53-9b14-58e7504d9ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:37.876351 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-350c9708-ba22-4e6a-8b27-e8b08958c820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f08b8baf47440268072a133f80deb22'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.877309 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-350c9708-ba22-4e6a-8b27-e8b08958c820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f08b8baf47440268072a133f80deb22'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.878928 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-350c9708-ba22-4e6a-8b27-e8b08958c820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f08b8baf47440268072a133f80deb22'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.894673 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-350c9708-ba22-4e6a-8b27-e8b08958c820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f08b8baf47440268072a133f80deb22'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.914291 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-350c9708-ba22-4e6a-8b27-e8b08958c820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f08b8baf47440268072a133f80deb22'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:37.939793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:37.940756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238958a0-0c15-4b53-9b14-58e7504d9ab4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:37.945496 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 973/1944] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:37 2022] DELETE /identity/v3/users/4f08b8baf47440268072a133f80deb22 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:37.946797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c9708-ba22-4e6a-8b27-e8b08958c820 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:37.949848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-350c9708-ba22-4e6a-8b27-e8b08958c820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:37.952903 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63605ae2-e613-4cf9-8097-572918583dc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:37.953881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63605ae2-e613-4cf9-8097-572918583dc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:37.954234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63605ae2-e613-4cf9-8097-572918583dc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:37.954444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63605ae2-e613-4cf9-8097-572918583dc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:37.956832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-63605ae2-e613-4cf9-8097-572918583dc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:38.050485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c9708-ba22-4e6a-8b27-e8b08958c820 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:38.061797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb4a73-1ac2-4017-a454-10e16514d8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:38.061797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb4a73-1ac2-4017-a454-10e16514d8a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:38.061797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb4a73-1ac2-4017-a454-10e16514d8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:38.061797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb4a73-1ac2-4017-a454-10e16514d8a9 admin admin] PATH_INFO: `/v3/projects/a64d3b435c714095912938e598662080/users/86f2fc2d9a68415aaf05e76e1f010d2f/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:38.080293 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb4a73-1ac2-4017-a454-10e16514d8a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a64d3b435c714095912938e598662080, user_id=86f2fc2d9a68415aaf05e76e1f010d2f, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:38.084034 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb4a73-1ac2-4017-a454-10e16514d8a9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:38.093354 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63605ae2-e613-4cf9-8097-572918583dc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:38.095011 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63605ae2-e613-4cf9-8097-572918583dc3 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:38.108083 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 972/1945] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:38.109600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 974/1946] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:37 2022] PUT /identity/v3/projects/a64d3b435c714095912938e598662080/users/86f2fc2d9a68415aaf05e76e1f010d2f/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:38.110577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583050e0-543b-42bd-b462-00b46eb11f40 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:38.111044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583050e0-543b-42bd-b462-00b46eb11f40 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:38.111493 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583050e0-543b-42bd-b462-00b46eb11f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:38.113060 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb4a73-1ac2-4017-a454-10e16514d8a9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:38.117094 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d2fb4a73-1ac2-4017-a454-10e16514d8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:38.142302 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-583050e0-543b-42bd-b462-00b46eb11f40 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:38.143538 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-583050e0-543b-42bd-b462-00b46eb11f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:38.232175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:38.256546 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 973/1947] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:38.258907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5481a-5476-41cc-b5a0-df79774fe97b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:38.258907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5481a-5476-41cc-b5a0-df79774fe97b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:38.258907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5481a-5476-41cc-b5a0-df79774fe97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:38.266200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb4a73-1ac2-4017-a454-10e16514d8a9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:38.275496 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b4bf22-b903-4a45-97a7-d83c1b43c43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:38.279153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4bf22-b903-4a45-97a7-d83c1b43c43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:38.280048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4bf22-b903-4a45-97a7-d83c1b43c43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:38.280849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b4bf22-b903-4a45-97a7-d83c1b43c43c admin admin] PATH_INFO: `/v3/projects/cef45afe60da436a87281946b9446b85` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:38.282364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4bf22-b903-4a45-97a7-d83c1b43c43c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef45afe60da436a87281946b9446b85)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:38.290004 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b4bf22-b903-4a45-97a7-d83c1b43c43c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:38.310499 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-51d5481a-5476-41cc-b5a0-df79774fe97b None None] MFA Rules not processed for user `86f2fc2d9a68415aaf05e76e1f010d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:38.313338 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-51d5481a-5476-41cc-b5a0-df79774fe97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:38.359679 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-54b4bf22-b903-4a45-97a7-d83c1b43c43c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef45afe60da436a87281946b9446b85', 'request_id': 'req-54b4bf22-b903-4a45-97a7-d83c1b43c43c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:38.379800 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-54b4bf22-b903-4a45-97a7-d83c1b43c43c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef45afe60da436a87281946b9446b85', 'request_id': 'req-54b4bf22-b903-4a45-97a7-d83c1b43c43c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:38.387931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-54b4bf22-b903-4a45-97a7-d83c1b43c43c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef45afe60da436a87281946b9446b85', 'request_id': 'req-54b4bf22-b903-4a45-97a7-d83c1b43c43c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:38.403053 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-54b4bf22-b903-4a45-97a7-d83c1b43c43c admin admin] The token cache is being invalidate because project cef45afe60da436a87281946b9446b85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:38.403339 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-54b4bf22-b903-4a45-97a7-d83c1b43c43c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:38.404069 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-54b4bf22-b903-4a45-97a7-d83c1b43c43c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:38.405709 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 975/1948] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:38 2022] DELETE /identity/v3/projects/cef45afe60da436a87281946b9446b85 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:38.407053 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cb20f-aff5-4d2f-9639-21f1b84bd083 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:38.407347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cb20f-aff5-4d2f-9639-21f1b84bd083 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:38.407619 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cb20f-aff5-4d2f-9639-21f1b84bd083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:38.413051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 974/1949] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:38.414330 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5481a-5476-41cc-b5a0-df79774fe97b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:38.417356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-51d5481a-5476-41cc-b5a0-df79774fe97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:38.430326 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1f4cb20f-aff5-4d2f-9639-21f1b84bd083 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:38.431546 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1f4cb20f-aff5-4d2f-9639-21f1b84bd083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:38.444694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:38.490517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5481a-5476-41cc-b5a0-df79774fe97b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:38.509279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 976/1950] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:38.509279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cb20f-aff5-4d2f-9639-21f1b84bd083 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:38.509279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1f4cb20f-aff5-4d2f-9639-21f1b84bd083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:38.519718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cb20f-aff5-4d2f-9639-21f1b84bd083 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:38.525530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb06708-96f3-4f94-88ab-e5f0f9f8fab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:38.526434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb06708-96f3-4f94-88ab-e5f0f9f8fab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:38.526723 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb06708-96f3-4f94-88ab-e5f0f9f8fab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:38.526995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb06708-96f3-4f94-88ab-e5f0f9f8fab1 admin admin] PATH_INFO: `/v3/projects/9696b01a5b6a4b4499a75db2c18100ec` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:38.528302 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb06708-96f3-4f94-88ab-e5f0f9f8fab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9696b01a5b6a4b4499a75db2c18100ec)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:38.530307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb06708-96f3-4f94-88ab-e5f0f9f8fab1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:38.547306 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a63cef-22d2-46c7-ade4-c1ffadb671e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:38.548517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63cef-22d2-46c7-ade4-c1ffadb671e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:38.548895 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63cef-22d2-46c7-ade4-c1ffadb671e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:38.549171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63cef-22d2-46c7-ade4-c1ffadb671e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:38.551608 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b6a63cef-22d2-46c7-ade4-c1ffadb671e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:38.592494 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0fb06708-96f3-4f94-88ab-e5f0f9f8fab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9696b01a5b6a4b4499a75db2c18100ec', 'request_id': 'req-0fb06708-96f3-4f94-88ab-e5f0f9f8fab1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:38.602238 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0fb06708-96f3-4f94-88ab-e5f0f9f8fab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9696b01a5b6a4b4499a75db2c18100ec', 'request_id': 'req-0fb06708-96f3-4f94-88ab-e5f0f9f8fab1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:38.610198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0fb06708-96f3-4f94-88ab-e5f0f9f8fab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9696b01a5b6a4b4499a75db2c18100ec', 'request_id': 'req-0fb06708-96f3-4f94-88ab-e5f0f9f8fab1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:38.628327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0fb06708-96f3-4f94-88ab-e5f0f9f8fab1 admin admin] The token cache is being invalidate because project 9696b01a5b6a4b4499a75db2c18100ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:38.628630 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0fb06708-96f3-4f94-88ab-e5f0f9f8fab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:38.629327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0fb06708-96f3-4f94-88ab-e5f0f9f8fab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:38.629634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a63cef-22d2-46c7-ade4-c1ffadb671e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:38.631073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 977/1951] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:38 2022] DELETE /identity/v3/projects/9696b01a5b6a4b4499a75db2c18100ec => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:38.631490 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a63cef-22d2-46c7-ade4-c1ffadb671e3 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:38.632527 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eda8cd-606a-419b-baca-f009ceca8a44 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:38.632976 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eda8cd-606a-419b-baca-f009ceca8a44 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:38.633124 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eda8cd-606a-419b-baca-f009ceca8a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:38.635765 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:38.644439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 975/1952] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:38.646528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a63cef-22d2-46c7-ade4-c1ffadb671e3 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:38.648322 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b6a63cef-22d2-46c7-ade4-c1ffadb671e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:38.655338 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-51eda8cd-606a-419b-baca-f009ceca8a44 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:38.657150 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-51eda8cd-606a-419b-baca-f009ceca8a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:38.659608 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a63cef-22d2-46c7-ade4-c1ffadb671e3 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:38.724914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd1bde-e174-4b75-a0b0-37fb14bd61a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:38.725903 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd1bde-e174-4b75-a0b0-37fb14bd61a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:38.726188 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd1bde-e174-4b75-a0b0-37fb14bd61a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:38.726469 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd1bde-e174-4b75-a0b0-37fb14bd61a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:38.728887 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-10cd1bde-e174-4b75-a0b0-37fb14bd61a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:38.750695 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 978/1953] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:38.751860 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eda8cd-606a-419b-baca-f009ceca8a44 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:38.759730 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-51eda8cd-606a-419b-baca-f009ceca8a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:38.773479 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eda8cd-606a-419b-baca-f009ceca8a44 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:38.779057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b42256-7351-4d42-8223-044408c72cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:38.779758 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b42256-7351-4d42-8223-044408c72cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:38.780064 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b42256-7351-4d42-8223-044408c72cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:38.780341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b42256-7351-4d42-8223-044408c72cc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:38.781072 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b42256-7351-4d42-8223-044408c72cc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:38.781378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b42256-7351-4d42-8223-044408c72cc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:38.783026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b42256-7351-4d42-8223-044408c72cc4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:38.797057 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd1bde-e174-4b75-a0b0-37fb14bd61a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:38.798485 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd1bde-e174-4b75-a0b0-37fb14bd61a8 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:38.799724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 979/1954] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:35:38.800844 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9074f-b443-40a1-99e5-303e13499837 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:38.801131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9074f-b443-40a1-99e5-303e13499837 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:38.801419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9074f-b443-40a1-99e5-303e13499837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:38.814430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 976/1955] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:38.816036 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ecef6-6d7f-4c16-873e-6207fd34b529 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:38.818114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ecef6-6d7f-4c16-873e-6207fd34b529 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:38.818614 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ecef6-6d7f-4c16-873e-6207fd34b529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:38.828670 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1bf9074f-b443-40a1-99e5-303e13499837 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:38.830088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1bf9074f-b443-40a1-99e5-303e13499837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:38.839784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 980/1956] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:38.841064 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9074f-b443-40a1-99e5-303e13499837 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:38.852924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9074f-b443-40a1-99e5-303e13499837 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:38.856263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-222ecef6-6d7f-4c16-873e-6207fd34b529 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:38.858805 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-222ecef6-6d7f-4c16-873e-6207fd34b529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:38.860510 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9375ba-46ca-4200-95b2-996ea48610de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:38.861526 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9375ba-46ca-4200-95b2-996ea48610de admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:38.863315 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9375ba-46ca-4200-95b2-996ea48610de admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:38.863567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9375ba-46ca-4200-95b2-996ea48610de admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:38.865006 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9375ba-46ca-4200-95b2-996ea48610de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:38.867541 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9375ba-46ca-4200-95b2-996ea48610de admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:38.874564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 977/1957] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:38.876091 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3a209-9614-47ba-8b01-86fcbe306b7a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:38.876382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3a209-9614-47ba-8b01-86fcbe306b7a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:38.876675 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3a209-9614-47ba-8b01-86fcbe306b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:38.893839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:38.908636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-acf3a209-9614-47ba-8b01-86fcbe306b7a None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:38.911506 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-acf3a209-9614-47ba-8b01-86fcbe306b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:38.922254 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 981/1958] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:38 2022] POST /identity/v3/projects => generated 367 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:38.923280 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9375ba-46ca-4200-95b2-996ea48610de admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:39.057043 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9375ba-46ca-4200-95b2-996ea48610de admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:39.064582 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4acaa1-42fc-4a99-a7a4-813d9e680474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:39.067452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4acaa1-42fc-4a99-a7a4-813d9e680474 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.067452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4acaa1-42fc-4a99-a7a4-813d9e680474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.067452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4acaa1-42fc-4a99-a7a4-813d9e680474 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.067452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4acaa1-42fc-4a99-a7a4-813d9e680474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:39.067452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4acaa1-42fc-4a99-a7a4-813d9e680474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:39.070243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4acaa1-42fc-4a99-a7a4-813d9e680474 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:39.072733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 978/1959] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:39.073417 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3a209-9614-47ba-8b01-86fcbe306b7a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:39.096639 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3a209-9614-47ba-8b01-86fcbe306b7a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:39.103130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 982/1960] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:35:39.104099 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4acaa1-42fc-4a99-a7a4-813d9e680474 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:39.111434 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b4d3a-9aaf-4bed-8503-232b5cc49e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:39.112308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b4d3a-9aaf-4bed-8503-232b5cc49e7f admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.112688 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b4d3a-9aaf-4bed-8503-232b5cc49e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.112989 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b4d3a-9aaf-4bed-8503-232b5cc49e7f admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.113880 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b4d3a-9aaf-4bed-8503-232b5cc49e7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:39.116879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b4d3a-9aaf-4bed-8503-232b5cc49e7f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:39.122463 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4acaa1-42fc-4a99-a7a4-813d9e680474 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:39.129581 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb760871-fd90-418a-9887-ca9eda23abb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:39.131420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760871-fd90-418a-9887-ca9eda23abb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.132081 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760871-fd90-418a-9887-ca9eda23abb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.132603 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760871-fd90-418a-9887-ca9eda23abb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.133649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb760871-fd90-418a-9887-ca9eda23abb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:39.134108 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb760871-fd90-418a-9887-ca9eda23abb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:39.136735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb760871-fd90-418a-9887-ca9eda23abb1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:39.157764 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 983/1961] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:35:39.159121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb760871-fd90-418a-9887-ca9eda23abb1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:39.162943 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 979/1962] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:39 2022] POST /identity/v3/users => generated 284 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:39.164895 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b4d3a-9aaf-4bed-8503-232b5cc49e7f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:39.176121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b4d3a-9aaf-4bed-8503-232b5cc49e7f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:39.177672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb760871-fd90-418a-9887-ca9eda23abb1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:39.182235 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28119826-6edb-4e8f-af8c-7f56bda77636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:39.183045 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28119826-6edb-4e8f-af8c-7f56bda77636 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.183533 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28119826-6edb-4e8f-af8c-7f56bda77636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.183936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28119826-6edb-4e8f-af8c-7f56bda77636 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.184533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457480f-bb08-41da-8234-c42c7723dfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:39.185093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28119826-6edb-4e8f-af8c-7f56bda77636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:39.185580 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457480f-bb08-41da-8234-c42c7723dfc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.186140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457480f-bb08-41da-8234-c42c7723dfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.186630 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457480f-bb08-41da-8234-c42c7723dfc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.187340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28119826-6edb-4e8f-af8c-7f56bda77636 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:39.187724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457480f-bb08-41da-8234-c42c7723dfc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:39.190768 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457480f-bb08-41da-8234-c42c7723dfc7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:39.232136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 980/1963] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:39 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:39.232136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28119826-6edb-4e8f-af8c-7f56bda77636 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:39.243388 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:39.250226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 984/1964] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:39 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:39.251081 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457480f-bb08-41da-8234-c42c7723dfc7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:39.333395 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28119826-6edb-4e8f-af8c-7f56bda77636 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:39.352661 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956e51e-ad3f-4b2a-9e4e-a54c10f7c485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:39.353369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956e51e-ad3f-4b2a-9e4e-a54c10f7c485 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.353673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956e51e-ad3f-4b2a-9e4e-a54c10f7c485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.353925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956e51e-ad3f-4b2a-9e4e-a54c10f7c485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.354673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956e51e-ad3f-4b2a-9e4e-a54c10f7c485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:39.356434 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956e51e-ad3f-4b2a-9e4e-a54c10f7c485 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:39.361004 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457480f-bb08-41da-8234-c42c7723dfc7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:39.367995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af4bbc-5672-4f63-be6c-7596f29e53db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:39.368922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af4bbc-5672-4f63-be6c-7596f29e53db admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.369249 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af4bbc-5672-4f63-be6c-7596f29e53db admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.372657 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 981/1965] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:39.372833 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af4bbc-5672-4f63-be6c-7596f29e53db admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.372932 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956e51e-ad3f-4b2a-9e4e-a54c10f7c485 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:39.373047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af4bbc-5672-4f63-be6c-7596f29e53db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:39.373982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af4bbc-5672-4f63-be6c-7596f29e53db admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:39.389141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956e51e-ad3f-4b2a-9e4e-a54c10f7c485 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:39.397333 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fa5c9-3f0d-4896-88e9-29d0d6f9cb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:39.398616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fa5c9-3f0d-4896-88e9-29d0d6f9cb8e admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.399778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fa5c9-3f0d-4896-88e9-29d0d6f9cb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.400213 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fa5c9-3f0d-4896-88e9-29d0d6f9cb8e admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.401186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fa5c9-3f0d-4896-88e9-29d0d6f9cb8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:39.403339 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fa5c9-3f0d-4896-88e9-29d0d6f9cb8e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:39.425858 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 985/1966] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:39 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:39.427204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af4bbc-5672-4f63-be6c-7596f29e53db admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:39.429959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 982/1967] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:39 2022] POST /identity/v3/users => generated 291 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:39.431171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fa5c9-3f0d-4896-88e9-29d0d6f9cb8e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:39.444889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af4bbc-5672-4f63-be6c-7596f29e53db admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:39.445165 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fa5c9-3f0d-4896-88e9-29d0d6f9cb8e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:39.452892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b9f3c-2ccf-4a45-95ff-05ed3ab5702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:39.453834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a3302-4722-426e-800b-ced9ec5957f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:39.453993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b9f3c-2ccf-4a45-95ff-05ed3ab5702b admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.454340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b9f3c-2ccf-4a45-95ff-05ed3ab5702b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.454527 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a3302-4722-426e-800b-ced9ec5957f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.454760 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b9f3c-2ccf-4a45-95ff-05ed3ab5702b admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.455063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a3302-4722-426e-800b-ced9ec5957f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.455339 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a3302-4722-426e-800b-ced9ec5957f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.455764 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b9f3c-2ccf-4a45-95ff-05ed3ab5702b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:39.456110 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a3302-4722-426e-800b-ced9ec5957f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:39.457315 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b9f3c-2ccf-4a45-95ff-05ed3ab5702b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:39.459657 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a3302-4722-426e-800b-ced9ec5957f0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:39.475786 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 983/1968] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:39.475786 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b9f3c-2ccf-4a45-95ff-05ed3ab5702b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:39.479102 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 986/1969] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:39.479943 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a3302-4722-426e-800b-ced9ec5957f0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:39.484918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b9f3c-2ccf-4a45-95ff-05ed3ab5702b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:39.489833 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b2e07-3083-4339-bf17-5d79d09da66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:39.490809 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b2e07-3083-4339-bf17-5d79d09da66f admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.491069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b2e07-3083-4339-bf17-5d79d09da66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.491373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b2e07-3083-4339-bf17-5d79d09da66f admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.492150 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b2e07-3083-4339-bf17-5d79d09da66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:39.493882 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b2e07-3083-4339-bf17-5d79d09da66f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:39.494001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a3302-4722-426e-800b-ced9ec5957f0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:39.500179 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091297f-7b3e-4edc-ab46-97134ae37aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:39.501538 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091297f-7b3e-4edc-ab46-97134ae37aeb admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.501831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091297f-7b3e-4edc-ab46-97134ae37aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.502209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091297f-7b3e-4edc-ab46-97134ae37aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.503148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091297f-7b3e-4edc-ab46-97134ae37aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:39.504857 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 984/1970] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:39.508097 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b2e07-3083-4339-bf17-5d79d09da66f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:39.508188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091297f-7b3e-4edc-ab46-97134ae37aeb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:39.516685 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b2e07-3083-4339-bf17-5d79d09da66f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:39.525730 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 987/1971] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:39.525941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a4dfb-17b3-44ac-b2fa-4aac6d650571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:39.526051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091297f-7b3e-4edc-ab46-97134ae37aeb admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:39.526138 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a4dfb-17b3-44ac-b2fa-4aac6d650571 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.526138 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a4dfb-17b3-44ac-b2fa-4aac6d650571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.526138 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a4dfb-17b3-44ac-b2fa-4aac6d650571 admin admin] PATH_INFO: `/v3/projects/1abb6ddc3f1d4eeb8234c5b8341b8b4e/users/5ec23439880c4169a49012f974e52537/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.535495 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091297f-7b3e-4edc-ab46-97134ae37aeb admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:39.540474 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e35b3-1732-4ef4-9c86-e2095df9c51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:39.541276 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e35b3-1732-4ef4-9c86-e2095df9c51c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.541537 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e35b3-1732-4ef4-9c86-e2095df9c51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.541709 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e35b3-1732-4ef4-9c86-e2095df9c51c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.541883 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a4dfb-17b3-44ac-b2fa-4aac6d650571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1abb6ddc3f1d4eeb8234c5b8341b8b4e, user_id=5ec23439880c4169a49012f974e52537, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:39.542517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e35b3-1732-4ef4-9c86-e2095df9c51c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:39.544102 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e35b3-1732-4ef4-9c86-e2095df9c51c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:39.544662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a4dfb-17b3-44ac-b2fa-4aac6d650571 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:39.555659 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 988/1972] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:39.556657 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e35b3-1732-4ef4-9c86-e2095df9c51c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:39.564660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 985/1973] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:39 2022] PUT /identity/v3/projects/1abb6ddc3f1d4eeb8234c5b8341b8b4e/users/5ec23439880c4169a49012f974e52537/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:39.565629 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a4dfb-17b3-44ac-b2fa-4aac6d650571 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:39.568509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e35b3-1732-4ef4-9c86-e2095df9c51c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:39.583083 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:39.645448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d08f0-06db-4d40-b9d8-67cdaae3d001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:39.646803 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d08f0-06db-4d40-b9d8-67cdaae3d001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.647099 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d08f0-06db-4d40-b9d8-67cdaae3d001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.647379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d08f0-06db-4d40-b9d8-67cdaae3d001 admin admin] PATH_INFO: `/v3/projects/752e3c41914844d2a9fc8e95fa950f44/users/04db439867764abb870b4fc8840e0c1b/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.650236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a4dfb-17b3-44ac-b2fa-4aac6d650571 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:39.654910 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda307d-8bbc-463c-85e6-d79677ddc28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:39.655861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda307d-8bbc-463c-85e6-d79677ddc28a admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.656183 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda307d-8bbc-463c-85e6-d79677ddc28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.656465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda307d-8bbc-463c-85e6-d79677ddc28a admin admin] PATH_INFO: `/v3/projects/3c211d4986994fafa4ab93e3a342491d/users/bffa9e0b2e224c5ba23034eb5c9db0d3/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.663624 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d08f0-06db-4d40-b9d8-67cdaae3d001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=752e3c41914844d2a9fc8e95fa950f44, user_id=04db439867764abb870b4fc8840e0c1b, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:39.666352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8d08f0-06db-4d40-b9d8-67cdaae3d001 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:39.674134 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda307d-8bbc-463c-85e6-d79677ddc28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c211d4986994fafa4ab93e3a342491d, user_id=bffa9e0b2e224c5ba23034eb5c9db0d3, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:39.676996 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda307d-8bbc-463c-85e6-d79677ddc28a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:39.682740 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 989/1974] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:39 2022] PUT /identity/v3/projects/752e3c41914844d2a9fc8e95fa950f44/users/04db439867764abb870b4fc8840e0c1b/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:39.684142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca494ec5-33b7-4400-8438-dd464c2dc24a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.684432 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca494ec5-33b7-4400-8438-dd464c2dc24a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.684712 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca494ec5-33b7-4400-8438-dd464c2dc24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.707745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 986/1975] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:39 2022] PUT /identity/v3/projects/3c211d4986994fafa4ab93e3a342491d/users/bffa9e0b2e224c5ba23034eb5c9db0d3/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:39.709375 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761e0e0-244f-43c3-a444-2235908e9c7d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.709660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761e0e0-244f-43c3-a444-2235908e9c7d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.709935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761e0e0-244f-43c3-a444-2235908e9c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.722885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ca494ec5-33b7-4400-8438-dd464c2dc24a None None] MFA Rules not processed for user `5ec23439880c4169a49012f974e52537`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:39.724797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ca494ec5-33b7-4400-8438-dd464c2dc24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:39.750761 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6761e0e0-244f-43c3-a444-2235908e9c7d None None] MFA Rules not processed for user `04db439867764abb870b4fc8840e0c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:39.752047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6761e0e0-244f-43c3-a444-2235908e9c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:39.762949 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:39.824224 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 990/1976] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:39.826643 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef30225-54b6-4f62-885e-c2925195cb6e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.827415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef30225-54b6-4f62-885e-c2925195cb6e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.827910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef30225-54b6-4f62-885e-c2925195cb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.842780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 987/1977] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:39.844404 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761e0e0-244f-43c3-a444-2235908e9c7d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:39.845858 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6761e0e0-244f-43c3-a444-2235908e9c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:39.858526 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6ef30225-54b6-4f62-885e-c2925195cb6e None None] MFA Rules not processed for user `bffa9e0b2e224c5ba23034eb5c9db0d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:39.859762 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6ef30225-54b6-4f62-885e-c2925195cb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:39.927159 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761e0e0-244f-43c3-a444-2235908e9c7d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:39.933157 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b67e0-bbdb-4a8c-94f0-aa5ccdf8c249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:39.933836 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b67e0-bbdb-4a8c-94f0-aa5ccdf8c249 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:39.934114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b67e0-bbdb-4a8c-94f0-aa5ccdf8c249 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:39.934419 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b67e0-bbdb-4a8c-94f0-aa5ccdf8c249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:39.940415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 991/1978] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:39.941374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef30225-54b6-4f62-885e-c2925195cb6e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:39.947803 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b67e0-bbdb-4a8c-94f0-aa5ccdf8c249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:39.949318 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b67e0-bbdb-4a8c-94f0-aa5ccdf8c249 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:39.956717 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:39.961626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 988/1979] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:39 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:39.962615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b67e0-bbdb-4a8c-94f0-aa5ccdf8c249 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:40.014705 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef30225-54b6-4f62-885e-c2925195cb6e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:40.020217 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70922468-90bd-4e8f-8992-9e42f84a8721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:40.020851 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70922468-90bd-4e8f-8992-9e42f84a8721 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:40.021200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70922468-90bd-4e8f-8992-9e42f84a8721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:40.021403 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70922468-90bd-4e8f-8992-9e42f84a8721 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:40.022291 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70922468-90bd-4e8f-8992-9e42f84a8721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:40.024428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70922468-90bd-4e8f-8992-9e42f84a8721 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:40.052577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b67e0-bbdb-4a8c-94f0-aa5ccdf8c249 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:40.059842 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe245ba-de54-42cb-bd2f-a8933c3bc542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:40.060725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe245ba-de54-42cb-bd2f-a8933c3bc542 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:40.061008 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe245ba-de54-42cb-bd2f-a8933c3bc542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:40.061283 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe245ba-de54-42cb-bd2f-a8933c3bc542 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:40.061996 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe245ba-de54-42cb-bd2f-a8933c3bc542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:40.064392 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe245ba-de54-42cb-bd2f-a8933c3bc542 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:40.082030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 992/1980] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:39 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:40.082379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70922468-90bd-4e8f-8992-9e42f84a8721 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:40.109352 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 989/1981] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:39 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:40.113588 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe245ba-de54-42cb-bd2f-a8933c3bc542 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:40.190946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70922468-90bd-4e8f-8992-9e42f84a8721 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:40.230469 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:40.271107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe245ba-de54-42cb-bd2f-a8933c3bc542 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:40.277491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca34f86-ca0f-4372-a31c-5a12d04c736c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:40.278309 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca34f86-ca0f-4372-a31c-5a12d04c736c admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:40.278590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca34f86-ca0f-4372-a31c-5a12d04c736c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:40.278869 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca34f86-ca0f-4372-a31c-5a12d04c736c admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:40.279678 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca34f86-ca0f-4372-a31c-5a12d04c736c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:40.282331 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca34f86-ca0f-4372-a31c-5a12d04c736c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:40.319340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 990/1982] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:40 2022] POST /identity/v3/users => generated 296 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:35:40.325084 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca34f86-ca0f-4372-a31c-5a12d04c736c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:40.351353 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d0174-a2b3-41b0-86b3-51e6769278ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:40.352838 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca34f86-ca0f-4372-a31c-5a12d04c736c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:40.353451 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d0174-a2b3-41b0-86b3-51e6769278ac admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:40.354220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d0174-a2b3-41b0-86b3-51e6769278ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:40.355036 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d0174-a2b3-41b0-86b3-51e6769278ac admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:40.356885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d0174-a2b3-41b0-86b3-51e6769278ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:40.361134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d0174-a2b3-41b0-86b3-51e6769278ac admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:40.363053 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92bc92-2635-4957-b4fc-b7d697310347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:40.363749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92bc92-2635-4957-b4fc-b7d697310347 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:40.364165 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92bc92-2635-4957-b4fc-b7d697310347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:40.364495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92bc92-2635-4957-b4fc-b7d697310347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:40.365460 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92bc92-2635-4957-b4fc-b7d697310347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:40.367175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92bc92-2635-4957-b4fc-b7d697310347 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:40.404122 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 993/1983] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:40 2022] POST /identity/v3/users => generated 299 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:40.406946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 991/1984] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:40.411776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d0174-a2b3-41b0-86b3-51e6769278ac admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:40.412442 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92bc92-2635-4957-b4fc-b7d697310347 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:40.424456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d0174-a2b3-41b0-86b3-51e6769278ac admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:40.432644 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52089006-277a-4c0e-9605-31819c6df8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:40.433505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52089006-277a-4c0e-9605-31819c6df8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:40.433793 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52089006-277a-4c0e-9605-31819c6df8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:40.434067 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52089006-277a-4c0e-9605-31819c6df8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:40.434812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52089006-277a-4c0e-9605-31819c6df8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:40.436568 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52089006-277a-4c0e-9605-31819c6df8a2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:40.438781 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92bc92-2635-4957-b4fc-b7d697310347 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:40.452897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 994/1985] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:40.453107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee980386-9e06-4ffe-8432-a1080900eb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:40.453107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee980386-9e06-4ffe-8432-a1080900eb90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:40.453107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee980386-9e06-4ffe-8432-a1080900eb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:40.453107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee980386-9e06-4ffe-8432-a1080900eb90 admin admin] PATH_INFO: `/v3/projects/6230179549b8491cb57270ef06ef8730/users/df2b835b46c244df80241d06f8c22ac4/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:40.454519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52089006-277a-4c0e-9605-31819c6df8a2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:40.473740 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52089006-277a-4c0e-9605-31819c6df8a2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:40.480753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180c6d5-3693-4124-8764-c6ffe5d38ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:40.482032 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180c6d5-3693-4124-8764-c6ffe5d38ff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:40.482611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180c6d5-3693-4124-8764-c6ffe5d38ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:40.483028 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180c6d5-3693-4124-8764-c6ffe5d38ff4 admin admin] PATH_INFO: `/v3/projects/c782d846ee2a4976aa30037d42961606/users/8bf1f6d2361848209b6a47a76cd719d6/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:40.507751 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180c6d5-3693-4124-8764-c6ffe5d38ff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c782d846ee2a4976aa30037d42961606, user_id=8bf1f6d2361848209b6a47a76cd719d6, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:40.511475 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee980386-9e06-4ffe-8432-a1080900eb90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6230179549b8491cb57270ef06ef8730, user_id=df2b835b46c244df80241d06f8c22ac4, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:40.516552 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee980386-9e06-4ffe-8432-a1080900eb90 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:40.517753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180c6d5-3693-4124-8764-c6ffe5d38ff4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:40.536814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:40.541783 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 992/1986] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:40 2022] PUT /identity/v3/projects/6230179549b8491cb57270ef06ef8730/users/df2b835b46c244df80241d06f8c22ac4/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:40.545650 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee980386-9e06-4ffe-8432-a1080900eb90 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:40.549061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 995/1987] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:40 2022] PUT /identity/v3/projects/c782d846ee2a4976aa30037d42961606/users/8bf1f6d2361848209b6a47a76cd719d6/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:40.553250 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180c6d5-3693-4124-8764-c6ffe5d38ff4 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:40.660296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180c6d5-3693-4124-8764-c6ffe5d38ff4 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:40.664265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee980386-9e06-4ffe-8432-a1080900eb90 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:40.666792 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3afbfd-3d74-43c9-8bbe-863606f42f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:40.667499 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3afbfd-3d74-43c9-8bbe-863606f42f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:40.667794 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3afbfd-3d74-43c9-8bbe-863606f42f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:40.668188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3afbfd-3d74-43c9-8bbe-863606f42f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:40.668927 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3afbfd-3d74-43c9-8bbe-863606f42f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:40.669830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f440a3d-9206-40e3-9a3c-7fe18288f2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:40.670511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f440a3d-9206-40e3-9a3c-7fe18288f2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:40.670610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3afbfd-3d74-43c9-8bbe-863606f42f8a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:40.670801 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f440a3d-9206-40e3-9a3c-7fe18288f2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:40.671077 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f440a3d-9206-40e3-9a3c-7fe18288f2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:40.671811 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f440a3d-9206-40e3-9a3c-7fe18288f2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:40.673502 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f440a3d-9206-40e3-9a3c-7fe18288f2c2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:40.684248 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 996/1988] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:40.684248 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b31c34-2738-4286-841a-891b0a5cc9d5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:40.684248 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b31c34-2738-4286-841a-891b0a5cc9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:40.684248 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b31c34-2738-4286-841a-891b0a5cc9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:40.684807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 993/1989] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:35:40.687990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f440a3d-9206-40e3-9a3c-7fe18288f2c2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:40.698336 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f440a3d-9206-40e3-9a3c-7fe18288f2c2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:40.703579 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f3922-e1eb-4623-98a3-46bcd490c9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:40.703923 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-25b31c34-2738-4286-841a-891b0a5cc9d5 None None] MFA Rules not processed for user `86f2fc2d9a68415aaf05e76e1f010d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:40.704652 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f3922-e1eb-4623-98a3-46bcd490c9df admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:40.704999 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f3922-e1eb-4623-98a3-46bcd490c9df admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:40.705195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-25b31c34-2738-4286-841a-891b0a5cc9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:40.705387 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f3922-e1eb-4623-98a3-46bcd490c9df admin admin] PATH_INFO: `/v3/projects/6230179549b8491cb57270ef06ef8730/users/df2b835b46c244df80241d06f8c22ac4/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:40.707440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f3922-e1eb-4623-98a3-46bcd490c9df admin admin] RBAC: Authorizing `identity:create_grant(project_id=6230179549b8491cb57270ef06ef8730, user_id=df2b835b46c244df80241d06f8c22ac4, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:40.710520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f3922-e1eb-4623-98a3-46bcd490c9df admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:40.721405 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 994/1990] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:40 2022] PUT /identity/v3/projects/6230179549b8491cb57270ef06ef8730/users/df2b835b46c244df80241d06f8c22ac4/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:40.730789 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f3922-e1eb-4623-98a3-46bcd490c9df admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:40.763717 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 997/1991] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:40.765402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da728b-eb0d-4874-8c0a-4388db7c6c42 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:40.765844 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da728b-eb0d-4874-8c0a-4388db7c6c42 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:40.766373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da728b-eb0d-4874-8c0a-4388db7c6c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:40.785647 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f3922-e1eb-4623-98a3-46bcd490c9df admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:40.791347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bbfc5-8d65-46d0-9b9e-a61b73c8c00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:40.792462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bbfc5-8d65-46d0-9b9e-a61b73c8c00d admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:40.793309 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bbfc5-8d65-46d0-9b9e-a61b73c8c00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:40.793309 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bbfc5-8d65-46d0-9b9e-a61b73c8c00d admin admin] PATH_INFO: `/v3/projects/c782d846ee2a4976aa30037d42961606/users/8bf1f6d2361848209b6a47a76cd719d6/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:40.797004 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bbfc5-8d65-46d0-9b9e-a61b73c8c00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c782d846ee2a4976aa30037d42961606, user_id=8bf1f6d2361848209b6a47a76cd719d6, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:40.799834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bbfc5-8d65-46d0-9b9e-a61b73c8c00d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:40.804278 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-19da728b-eb0d-4874-8c0a-4388db7c6c42 None None] MFA Rules not processed for user `df2b835b46c244df80241d06f8c22ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:40.805770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-19da728b-eb0d-4874-8c0a-4388db7c6c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:40.816110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 995/1992] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:40 2022] PUT /identity/v3/projects/c782d846ee2a4976aa30037d42961606/users/8bf1f6d2361848209b6a47a76cd719d6/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:40.827168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b39f67-248a-4139-bb84-6e87208dcdef None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:40.827619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b39f67-248a-4139-bb84-6e87208dcdef None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:40.828548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b39f67-248a-4139-bb84-6e87208dcdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:40.852181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:40.860139 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e1b39f67-248a-4139-bb84-6e87208dcdef None None] MFA Rules not processed for user `8bf1f6d2361848209b6a47a76cd719d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:40.861935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e1b39f67-248a-4139-bb84-6e87208dcdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:40.885649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 998/1993] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:40.898415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da728b-eb0d-4874-8c0a-4388db7c6c42 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:40.900055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-19da728b-eb0d-4874-8c0a-4388db7c6c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:40.933024 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:40.954880 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 996/1994] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:40.964477 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da728b-eb0d-4874-8c0a-4388db7c6c42 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:40.966964 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b39f67-248a-4139-bb84-6e87208dcdef None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:40.969766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b3372-309b-4833-910a-e5ba89e127ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:40.969766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b3372-309b-4833-910a-e5ba89e127ec service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:40.970007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b3372-309b-4833-910a-e5ba89e127ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:40.970390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b3372-309b-4833-910a-e5ba89e127ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:40.977367 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b39f67-248a-4139-bb84-6e87208dcdef None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:40.981186 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b3372-309b-4833-910a-e5ba89e127ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:40.981339 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805ea68-4e1c-40f8-ab81-6f95270b5d95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:40.981999 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805ea68-4e1c-40f8-ab81-6f95270b5d95 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:40.982282 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805ea68-4e1c-40f8-ab81-6f95270b5d95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:40.982555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805ea68-4e1c-40f8-ab81-6f95270b5d95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:40.983350 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b3372-309b-4833-910a-e5ba89e127ec service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:40.993289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805ea68-4e1c-40f8-ab81-6f95270b5d95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:40.994294 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 999/1995] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:35:40.994748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805ea68-4e1c-40f8-ab81-6f95270b5d95 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:41.006123 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 997/1996] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:41.085958 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b3372-309b-4833-910a-e5ba89e127ec service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:41.182190 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b3372-309b-4833-910a-e5ba89e127ec service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:41.189548 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6401556-1328-40b0-8812-81c9924453cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:41.190688 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6401556-1328-40b0-8812-81c9924453cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:41.191282 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6401556-1328-40b0-8812-81c9924453cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:41.192345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6401556-1328-40b0-8812-81c9924453cf admin admin] PATH_INFO: `/v3/users/04db439867764abb870b4fc8840e0c1b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:41.194137 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6401556-1328-40b0-8812-81c9924453cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=04db439867764abb870b4fc8840e0c1b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:41.196585 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6401556-1328-40b0-8812-81c9924453cf admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:41.265709 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6401556-1328-40b0-8812-81c9924453cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04db439867764abb870b4fc8840e0c1b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:41.266557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6401556-1328-40b0-8812-81c9924453cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04db439867764abb870b4fc8840e0c1b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:41.267211 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6401556-1328-40b0-8812-81c9924453cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04db439867764abb870b4fc8840e0c1b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:41.283753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6401556-1328-40b0-8812-81c9924453cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04db439867764abb870b4fc8840e0c1b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:41.311833 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6401556-1328-40b0-8812-81c9924453cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04db439867764abb870b4fc8840e0c1b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:41.334277 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1000/1997] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:41 2022] DELETE /identity/v3/users/04db439867764abb870b4fc8840e0c1b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:41.337238 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d3a1a-eb6d-47d4-a4ba-9314eb792e7d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:41.339049 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d3a1a-eb6d-47d4-a4ba-9314eb792e7d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:41.339844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d3a1a-eb6d-47d4-a4ba-9314eb792e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:41.385294 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8c0d3a1a-eb6d-47d4-a4ba-9314eb792e7d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:41.386564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8c0d3a1a-eb6d-47d4-a4ba-9314eb792e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:41.418776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6401556-1328-40b0-8812-81c9924453cf admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:41.420261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e6401556-1328-40b0-8812-81c9924453cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:41.496102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 998/1998] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:41.510060 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:41.512152 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d3a1a-eb6d-47d4-a4ba-9314eb792e7d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:41.517403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8c0d3a1a-eb6d-47d4-a4ba-9314eb792e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:41.547502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6401556-1328-40b0-8812-81c9924453cf admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:41.561871 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a40ce5-77e9-4ba6-8d46-1b53910050f9 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df2b835b46c244df80241d06f8c22ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6230179549b8491cb57270ef06ef8730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:41.562574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a40ce5-77e9-4ba6-8d46-1b53910050f9 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:41.562865 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a40ce5-77e9-4ba6-8d46-1b53910050f9 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:41.564324 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a40ce5-77e9-4ba6-8d46-1b53910050f9 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:41.565236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a40ce5-77e9-4ba6-8d46-1b53910050f9 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:41.565651 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a40ce5-77e9-4ba6-8d46-1b53910050f9 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:41.567626 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a40ce5-77e9-4ba6-8d46-1b53910050f9 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:41.585416 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1001/1999] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:35:41.597412 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a40ce5-77e9-4ba6-8d46-1b53910050f9 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:41.621320 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d3a1a-eb6d-47d4-a4ba-9314eb792e7d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:41.630399 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a40ce5-77e9-4ba6-8d46-1b53910050f9 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:41.634055 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e4237-ff38-4279-9c81-4b66196130f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:41.634594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e4237-ff38-4279-9c81-4b66196130f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:41.634881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e4237-ff38-4279-9c81-4b66196130f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:41.635175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e4237-ff38-4279-9c81-4b66196130f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:41.645263 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2501a-a2aa-45be-88d6-8b7dc511189b tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df2b835b46c244df80241d06f8c22ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6230179549b8491cb57270ef06ef8730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:41.647395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2501a-a2aa-45be-88d6-8b7dc511189b tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:41.650487 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2501a-a2aa-45be-88d6-8b7dc511189b tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:41.651002 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2501a-a2aa-45be-88d6-8b7dc511189b tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:41.653278 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2501a-a2aa-45be-88d6-8b7dc511189b tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:41.657702 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2501a-a2aa-45be-88d6-8b7dc511189b tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:41.672182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e4237-ff38-4279-9c81-4b66196130f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:41.675716 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e4237-ff38-4279-9c81-4b66196130f1 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:41.694285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 999/2000] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:35:41.734805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1002/2001] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:41 2022] POST /identity/v3/projects => generated 354 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:41.741489 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e4237-ff38-4279-9c81-4b66196130f1 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:41.776041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2501a-a2aa-45be-88d6-8b7dc511189b tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:41.779175 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-27c2501a-a2aa-45be-88d6-8b7dc511189b tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:41.779359 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e4237-ff38-4279-9c81-4b66196130f1 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:41.814186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:41.852225 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d2aa6-e74b-4990-91bd-8b51a58b38d0 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df2b835b46c244df80241d06f8c22ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6230179549b8491cb57270ef06ef8730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:41.852804 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d2aa6-e74b-4990-91bd-8b51a58b38d0 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:41.853107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d2aa6-e74b-4990-91bd-8b51a58b38d0 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:41.853448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d2aa6-e74b-4990-91bd-8b51a58b38d0 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:41.855338 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d2aa6-e74b-4990-91bd-8b51a58b38d0 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:41.855480 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d2aa6-e74b-4990-91bd-8b51a58b38d0 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:41.857232 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d2aa6-e74b-4990-91bd-8b51a58b38d0 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:41.873020 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1000/2002] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:35:41.916791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d2aa6-e74b-4990-91bd-8b51a58b38d0 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:41.929372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2501a-a2aa-45be-88d6-8b7dc511189b tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:41.932598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d2aa6-e74b-4990-91bd-8b51a58b38d0 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:41.940658 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfa622-aa6f-4691-9b4a-48a53bb8e985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:41.941565 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eaf4c-eecc-4450-b5dc-65244894d938 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df2b835b46c244df80241d06f8c22ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6230179549b8491cb57270ef06ef8730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:41.941968 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfa622-aa6f-4691-9b4a-48a53bb8e985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:41.942320 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfa622-aa6f-4691-9b4a-48a53bb8e985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:41.942475 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eaf4c-eecc-4450-b5dc-65244894d938 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:41.942751 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfa622-aa6f-4691-9b4a-48a53bb8e985 admin admin] PATH_INFO: `/v3/users/9d0c8cc6bda44c21990c5cc2dc4f14d4` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:41.944810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfa622-aa6f-4691-9b4a-48a53bb8e985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0c8cc6bda44c21990c5cc2dc4f14d4)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:41.945877 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eaf4c-eecc-4450-b5dc-65244894d938 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:41.946182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eaf4c-eecc-4450-b5dc-65244894d938 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] PATH_INFO: `/v3/projects/37b6cd633fc841e5956c2b1d375b4ecf` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:41.947283 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfa622-aa6f-4691-9b4a-48a53bb8e985 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:41.952215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5eaf4c-eecc-4450-b5dc-65244894d938 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] RBAC: Authorizing `identity:delete_project(project_id=37b6cd633fc841e5956c2b1d375b4ecf)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:41.956897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5eaf4c-eecc-4450-b5dc-65244894d938 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:42.021113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-99bfa622-aa6f-4691-9b4a-48a53bb8e985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0c8cc6bda44c21990c5cc2dc4f14d4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.022376 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-99bfa622-aa6f-4691-9b4a-48a53bb8e985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0c8cc6bda44c21990c5cc2dc4f14d4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.023066 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-99bfa622-aa6f-4691-9b4a-48a53bb8e985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0c8cc6bda44c21990c5cc2dc4f14d4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.045776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-99bfa622-aa6f-4691-9b4a-48a53bb8e985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0c8cc6bda44c21990c5cc2dc4f14d4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.060850 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-99bfa622-aa6f-4691-9b4a-48a53bb8e985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0c8cc6bda44c21990c5cc2dc4f14d4'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.063179 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ef5eaf4c-eecc-4450-b5dc-65244894d938 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37b6cd633fc841e5956c2b1d375b4ecf', 'request_id': 'req-ef5eaf4c-eecc-4450-b5dc-65244894d938'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.072830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ef5eaf4c-eecc-4450-b5dc-65244894d938 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37b6cd633fc841e5956c2b1d375b4ecf', 'request_id': 'req-ef5eaf4c-eecc-4450-b5dc-65244894d938'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.084563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ef5eaf4c-eecc-4450-b5dc-65244894d938 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37b6cd633fc841e5956c2b1d375b4ecf', 'request_id': 'req-ef5eaf4c-eecc-4450-b5dc-65244894d938'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.087619 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1003/2003] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:41 2022] DELETE /identity/v3/users/9d0c8cc6bda44c21990c5cc2dc4f14d4 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:42.092558 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff771982-1542-4aed-896e-eec2cb43ade8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:42.093040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff771982-1542-4aed-896e-eec2cb43ade8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:42.093518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff771982-1542-4aed-896e-eec2cb43ade8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:42.106983 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ef5eaf4c-eecc-4450-b5dc-65244894d938 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] The token cache is being invalidate because project 37b6cd633fc841e5956c2b1d375b4ecf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:42.108467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ef5eaf4c-eecc-4450-b5dc-65244894d938 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.109576 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ef5eaf4c-eecc-4450-b5dc-65244894d938 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.114153 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1001/2004] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:41 2022] DELETE /identity/v3/projects/37b6cd633fc841e5956c2b1d375b4ecf => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:42.131318 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ff771982-1542-4aed-896e-eec2cb43ade8 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:42.132816 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ff771982-1542-4aed-896e-eec2cb43ade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:42.174195 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eaf4c-eecc-4450-b5dc-65244894d938 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:42.179281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ef5eaf4c-eecc-4450-b5dc-65244894d938 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:42.181976 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:42.245997 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1004/2005] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:42.260292 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff771982-1542-4aed-896e-eec2cb43ade8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:42.264728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ff771982-1542-4aed-896e-eec2cb43ade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:42.315190 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eaf4c-eecc-4450-b5dc-65244894d938 tempest-VolumeQuotaClassesTest-173780808 tempest-VolumeQuotaClassesTest-173780808-project-admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:42.322132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e8910-4529-4c06-886f-e7f0ed937874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:42.323157 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e8910-4529-4c06-886f-e7f0ed937874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:42.323550 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e8910-4529-4c06-886f-e7f0ed937874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:42.323952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e8910-4529-4c06-886f-e7f0ed937874 admin admin] PATH_INFO: `/v3/projects/752e3c41914844d2a9fc8e95fa950f44` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:42.325997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e8910-4529-4c06-886f-e7f0ed937874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=752e3c41914844d2a9fc8e95fa950f44)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:42.329661 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e8910-4529-4c06-886f-e7f0ed937874 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:42.413190 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9b5e8910-4529-4c06-886f-e7f0ed937874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '752e3c41914844d2a9fc8e95fa950f44', 'request_id': 'req-9b5e8910-4529-4c06-886f-e7f0ed937874'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.415057 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:42.430052 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9b5e8910-4529-4c06-886f-e7f0ed937874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '752e3c41914844d2a9fc8e95fa950f44', 'request_id': 'req-9b5e8910-4529-4c06-886f-e7f0ed937874'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.437895 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff771982-1542-4aed-896e-eec2cb43ade8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:42.449085 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9b5e8910-4529-4c06-886f-e7f0ed937874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '752e3c41914844d2a9fc8e95fa950f44', 'request_id': 'req-9b5e8910-4529-4c06-886f-e7f0ed937874'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.466550 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9b5e8910-4529-4c06-886f-e7f0ed937874 admin admin] The token cache is being invalidate because project 752e3c41914844d2a9fc8e95fa950f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:42.467300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9b5e8910-4529-4c06-886f-e7f0ed937874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.468236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9b5e8910-4529-4c06-886f-e7f0ed937874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.474088 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1002/2006] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:42 2022] DELETE /identity/v3/projects/752e3c41914844d2a9fc8e95fa950f44 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:42.475482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e8910-4529-4c06-886f-e7f0ed937874 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:42.477481 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9b5e8910-4529-4c06-886f-e7f0ed937874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:42.511119 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26875c4-2a92-44c2-ba80-04f081ca567d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:42.512055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26875c4-2a92-44c2-ba80-04f081ca567d service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:42.512334 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26875c4-2a92-44c2-ba80-04f081ca567d service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:42.512677 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26875c4-2a92-44c2-ba80-04f081ca567d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:42.515433 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a26875c4-2a92-44c2-ba80-04f081ca567d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:42.579447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e8910-4529-4c06-886f-e7f0ed937874 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:42.587402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c1333-8f5c-4122-a4aa-b402544da1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:42.588321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c1333-8f5c-4122-a4aa-b402544da1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:42.588630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c1333-8f5c-4122-a4aa-b402544da1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:42.588905 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c1333-8f5c-4122-a4aa-b402544da1b0 admin admin] PATH_INFO: `/v3/users/8bf1f6d2361848209b6a47a76cd719d6` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:42.590263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c1333-8f5c-4122-a4aa-b402544da1b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bf1f6d2361848209b6a47a76cd719d6)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:42.592463 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c1333-8f5c-4122-a4aa-b402544da1b0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:42.616587 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26875c4-2a92-44c2-ba80-04f081ca567d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:42.619084 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26875c4-2a92-44c2-ba80-04f081ca567d service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:42.636739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1005/2007] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:42.638345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26875c4-2a92-44c2-ba80-04f081ca567d service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:42.640562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a26875c4-2a92-44c2-ba80-04f081ca567d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:42.649106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-906c1333-8f5c-4122-a4aa-b402544da1b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bf1f6d2361848209b6a47a76cd719d6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.661048 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-906c1333-8f5c-4122-a4aa-b402544da1b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bf1f6d2361848209b6a47a76cd719d6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.662086 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26875c4-2a92-44c2-ba80-04f081ca567d service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:42.670135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbb9c5-ad00-4043-9340-df81d061f32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:42.673131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbb9c5-ad00-4043-9340-df81d061f32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:42.674051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbb9c5-ad00-4043-9340-df81d061f32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:42.674631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbb9c5-ad00-4043-9340-df81d061f32f admin admin] PATH_INFO: `/v3/users/bffa9e0b2e224c5ba23034eb5c9db0d3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:42.677502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbb9c5-ad00-4043-9340-df81d061f32f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bffa9e0b2e224c5ba23034eb5c9db0d3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:42.680105 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-906c1333-8f5c-4122-a4aa-b402544da1b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bf1f6d2361848209b6a47a76cd719d6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.681852 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbb9c5-ad00-4043-9340-df81d061f32f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:42.690345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-906c1333-8f5c-4122-a4aa-b402544da1b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bf1f6d2361848209b6a47a76cd719d6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.691313 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-906c1333-8f5c-4122-a4aa-b402544da1b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bf1f6d2361848209b6a47a76cd719d6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.702292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1003/2008] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:42 2022] DELETE /identity/v3/users/8bf1f6d2361848209b6a47a76cd719d6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:42.763190 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:42.772343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-15cbb9c5-ad00-4043-9340-df81d061f32f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bffa9e0b2e224c5ba23034eb5c9db0d3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.775024 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-15cbb9c5-ad00-4043-9340-df81d061f32f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bffa9e0b2e224c5ba23034eb5c9db0d3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.775574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-15cbb9c5-ad00-4043-9340-df81d061f32f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bffa9e0b2e224c5ba23034eb5c9db0d3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.800493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-15cbb9c5-ad00-4043-9340-df81d061f32f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bffa9e0b2e224c5ba23034eb5c9db0d3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.813924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-15cbb9c5-ad00-4043-9340-df81d061f32f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bffa9e0b2e224c5ba23034eb5c9db0d3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:42.842441 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1006/2009] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:42 2022] DELETE /identity/v3/users/bffa9e0b2e224c5ba23034eb5c9db0d3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:42.850362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178184c-6f8e-428c-9e10-17405316f7a7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:42.850745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178184c-6f8e-428c-9e10-17405316f7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:42.851245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178184c-6f8e-428c-9e10-17405316f7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:42.885363 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d178184c-6f8e-428c-9e10-17405316f7a7 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:42.887653 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d178184c-6f8e-428c-9e10-17405316f7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:42.970245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:43.001909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1004/2010] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:43.027104 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbb9c5-ad00-4043-9340-df81d061f32f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:43.031592 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-15cbb9c5-ad00-4043-9340-df81d061f32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:43.061080 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178184c-6f8e-428c-9e10-17405316f7a7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:43.063335 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d178184c-6f8e-428c-9e10-17405316f7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:43.112931 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178184c-6f8e-428c-9e10-17405316f7a7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:43.131103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb83ae-d095-4bae-b400-1fcc4ce70557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:43.132715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb83ae-d095-4bae-b400-1fcc4ce70557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:43.133228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb83ae-d095-4bae-b400-1fcc4ce70557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:43.133723 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb83ae-d095-4bae-b400-1fcc4ce70557 admin admin] PATH_INFO: `/v3/projects/2112b9b773b640b0a68ea3fdd8c2b13f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:43.137403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb83ae-d095-4bae-b400-1fcc4ce70557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2112b9b773b640b0a68ea3fdd8c2b13f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:43.140528 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb83ae-d095-4bae-b400-1fcc4ce70557 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:43.178390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbb9c5-ad00-4043-9340-df81d061f32f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:43.186075 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb96cb-3666-4880-abce-57130657d628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:43.186828 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb96cb-3666-4880-abce-57130657d628 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:43.187142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb96cb-3666-4880-abce-57130657d628 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:43.187431 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb96cb-3666-4880-abce-57130657d628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:43.202780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb96cb-3666-4880-abce-57130657d628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:43.205469 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb96cb-3666-4880-abce-57130657d628 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:43.221615 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1007/2011] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:43.231557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f1eb83ae-d095-4bae-b400-1fcc4ce70557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2112b9b773b640b0a68ea3fdd8c2b13f', 'request_id': 'req-f1eb83ae-d095-4bae-b400-1fcc4ce70557'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:43.263831 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f1eb83ae-d095-4bae-b400-1fcc4ce70557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2112b9b773b640b0a68ea3fdd8c2b13f', 'request_id': 'req-f1eb83ae-d095-4bae-b400-1fcc4ce70557'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:43.278836 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f1eb83ae-d095-4bae-b400-1fcc4ce70557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2112b9b773b640b0a68ea3fdd8c2b13f', 'request_id': 'req-f1eb83ae-d095-4bae-b400-1fcc4ce70557'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:43.300312 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f1eb83ae-d095-4bae-b400-1fcc4ce70557 admin admin] The token cache is being invalidate because project 2112b9b773b640b0a68ea3fdd8c2b13f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:43.300312 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f1eb83ae-d095-4bae-b400-1fcc4ce70557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:43.303795 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb96cb-3666-4880-abce-57130657d628 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:43.305350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f1eb83ae-d095-4bae-b400-1fcc4ce70557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:43.306640 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-32cb96cb-3666-4880-abce-57130657d628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:43.307940 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1005/2012] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:43 2022] DELETE /identity/v3/projects/2112b9b773b640b0a68ea3fdd8c2b13f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:43.312122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb83ae-d095-4bae-b400-1fcc4ce70557 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:43.313613 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f1eb83ae-d095-4bae-b400-1fcc4ce70557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:43.331881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb96cb-3666-4880-abce-57130657d628 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:43.425428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1046d8e-e0a9-4d2f-837a-11405ed3a67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:43.426325 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1046d8e-e0a9-4d2f-837a-11405ed3a67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:43.426682 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1046d8e-e0a9-4d2f-837a-11405ed3a67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:43.427028 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1046d8e-e0a9-4d2f-837a-11405ed3a67a admin admin] PATH_INFO: `/v3/projects/c782d846ee2a4976aa30037d42961606` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:43.428834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1046d8e-e0a9-4d2f-837a-11405ed3a67a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c782d846ee2a4976aa30037d42961606)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:43.436149 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1046d8e-e0a9-4d2f-837a-11405ed3a67a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:43.460234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb83ae-d095-4bae-b400-1fcc4ce70557 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:43.468726 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa6204-52fa-40f8-9f84-92088923b2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:43.470064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa6204-52fa-40f8-9f84-92088923b2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:43.470064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa6204-52fa-40f8-9f84-92088923b2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:43.470351 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa6204-52fa-40f8-9f84-92088923b2be admin admin] PATH_INFO: `/v3/users/bc28d7f3118945a28a3d5ed4b8754c14` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:43.475425 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa6204-52fa-40f8-9f84-92088923b2be admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc28d7f3118945a28a3d5ed4b8754c14)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:43.477455 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa6204-52fa-40f8-9f84-92088923b2be admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:43.559985 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b1046d8e-e0a9-4d2f-837a-11405ed3a67a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c782d846ee2a4976aa30037d42961606', 'request_id': 'req-b1046d8e-e0a9-4d2f-837a-11405ed3a67a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:43.573029 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-33aa6204-52fa-40f8-9f84-92088923b2be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc28d7f3118945a28a3d5ed4b8754c14'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:43.581310 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b1046d8e-e0a9-4d2f-837a-11405ed3a67a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c782d846ee2a4976aa30037d42961606', 'request_id': 'req-b1046d8e-e0a9-4d2f-837a-11405ed3a67a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:43.591251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-33aa6204-52fa-40f8-9f84-92088923b2be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc28d7f3118945a28a3d5ed4b8754c14'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:43.606387 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b1046d8e-e0a9-4d2f-837a-11405ed3a67a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c782d846ee2a4976aa30037d42961606', 'request_id': 'req-b1046d8e-e0a9-4d2f-837a-11405ed3a67a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:43.609841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:43.622692 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-33aa6204-52fa-40f8-9f84-92088923b2be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc28d7f3118945a28a3d5ed4b8754c14'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:43.638380 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b1046d8e-e0a9-4d2f-837a-11405ed3a67a admin admin] The token cache is being invalidate because project c782d846ee2a4976aa30037d42961606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:43.639557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b1046d8e-e0a9-4d2f-837a-11405ed3a67a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:43.640437 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b1046d8e-e0a9-4d2f-837a-11405ed3a67a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:43.641360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:43.643422 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1008/2013] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:43 2022] DELETE /identity/v3/projects/c782d846ee2a4976aa30037d42961606 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:43.648729 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a01997-4513-4a98-815f-feca204e322d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:43.649560 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a01997-4513-4a98-815f-feca204e322d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:43.649997 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a01997-4513-4a98-815f-feca204e322d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:43.654520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-33aa6204-52fa-40f8-9f84-92088923b2be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc28d7f3118945a28a3d5ed4b8754c14'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:43.671169 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-33aa6204-52fa-40f8-9f84-92088923b2be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc28d7f3118945a28a3d5ed4b8754c14'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:43.692819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1006/2014] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:43 2022] DELETE /identity/v3/users/bc28d7f3118945a28a3d5ed4b8754c14 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:43.709474 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c3a01997-4513-4a98-815f-feca204e322d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:43.711011 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c3a01997-4513-4a98-815f-feca204e322d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:43.810474 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa6204-52fa-40f8-9f84-92088923b2be admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:43.812058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-33aa6204-52fa-40f8-9f84-92088923b2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:43.832167 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1009/2015] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:43.842265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174587a4-e439-47e2-9c1f-08c7b0caa939 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:43.842755 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174587a4-e439-47e2-9c1f-08c7b0caa939 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:43.843497 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174587a4-e439-47e2-9c1f-08c7b0caa939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:43.893820 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-174587a4-e439-47e2-9c1f-08c7b0caa939 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:43.895198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-174587a4-e439-47e2-9c1f-08c7b0caa939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:43.904425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1010/2016] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:43.908376 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174587a4-e439-47e2-9c1f-08c7b0caa939 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:43.927156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174587a4-e439-47e2-9c1f-08c7b0caa939 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:43.938144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1c64d-ed06-4e57-a387-4fe96d1ce305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:43.939236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1c64d-ed06-4e57-a387-4fe96d1ce305 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:43.939847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1c64d-ed06-4e57-a387-4fe96d1ce305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:43.939847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1c64d-ed06-4e57-a387-4fe96d1ce305 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:43.942772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1c64d-ed06-4e57-a387-4fe96d1ce305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:43.943312 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1c64d-ed06-4e57-a387-4fe96d1ce305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:43.946661 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1c64d-ed06-4e57-a387-4fe96d1ce305 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:43.948895 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa6204-52fa-40f8-9f84-92088923b2be admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:43.960760 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c9b8c-fa30-4c14-a565-b446ce9b484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:43.962834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c9b8c-fa30-4c14-a565-b446ce9b484e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:43.963463 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c9b8c-fa30-4c14-a565-b446ce9b484e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:43.964358 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c9b8c-fa30-4c14-a565-b446ce9b484e admin admin] PATH_INFO: `/v3/projects/3c211d4986994fafa4ab93e3a342491d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:43.966819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c9b8c-fa30-4c14-a565-b446ce9b484e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c211d4986994fafa4ab93e3a342491d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:43.971037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c9b8c-fa30-4c14-a565-b446ce9b484e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:43.972262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1011/2017] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:35:43.977013 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1c64d-ed06-4e57-a387-4fe96d1ce305 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:43.993052 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1c64d-ed06-4e57-a387-4fe96d1ce305 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:43.999674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367c620-e16d-4d33-8048-b7fb151f1ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:44.001227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367c620-e16d-4d33-8048-b7fb151f1ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:44.001736 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367c620-e16d-4d33-8048-b7fb151f1ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:44.002361 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367c620-e16d-4d33-8048-b7fb151f1ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:44.003273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367c620-e16d-4d33-8048-b7fb151f1ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:44.006410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367c620-e16d-4d33-8048-b7fb151f1ab7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:44.061654 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9e4c9b8c-fa30-4c14-a565-b446ce9b484e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c211d4986994fafa4ab93e3a342491d', 'request_id': 'req-9e4c9b8c-fa30-4c14-a565-b446ce9b484e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:44.085665 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9e4c9b8c-fa30-4c14-a565-b446ce9b484e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c211d4986994fafa4ab93e3a342491d', 'request_id': 'req-9e4c9b8c-fa30-4c14-a565-b446ce9b484e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:44.102503 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9e4c9b8c-fa30-4c14-a565-b446ce9b484e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c211d4986994fafa4ab93e3a342491d', 'request_id': 'req-9e4c9b8c-fa30-4c14-a565-b446ce9b484e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:44.114240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1012/2018] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:43 2022] POST /identity/v3/projects => generated 389 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:35:44.115466 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367c620-e16d-4d33-8048-b7fb151f1ab7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:44.123381 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9e4c9b8c-fa30-4c14-a565-b446ce9b484e admin admin] The token cache is being invalidate because project 3c211d4986994fafa4ab93e3a342491d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:44.123381 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9e4c9b8c-fa30-4c14-a565-b446ce9b484e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:44.124156 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-9e4c9b8c-fa30-4c14-a565-b446ce9b484e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:44.132104 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1007/2019] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:43 2022] DELETE /identity/v3/projects/3c211d4986994fafa4ab93e3a342491d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:44.133296 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c9b8c-fa30-4c14-a565-b446ce9b484e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:44.134885 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9e4c9b8c-fa30-4c14-a565-b446ce9b484e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:44.188787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367c620-e16d-4d33-8048-b7fb151f1ab7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:44.195377 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d3e6d-46a1-4861-8aa7-ecde8d600a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:44.195810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d3e6d-46a1-4861-8aa7-ecde8d600a71 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:44.196756 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d3e6d-46a1-4861-8aa7-ecde8d600a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:44.197207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d3e6d-46a1-4861-8aa7-ecde8d600a71 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:44.198223 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d3e6d-46a1-4861-8aa7-ecde8d600a71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:44.201751 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d3e6d-46a1-4861-8aa7-ecde8d600a71 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:44.231750 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1013/2020] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:44 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:44.235420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d3e6d-46a1-4861-8aa7-ecde8d600a71 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:44.237830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c9b8c-fa30-4c14-a565-b446ce9b484e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:44.243934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-803d3e6d-46a1-4861-8aa7-ecde8d600a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:44.246638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537dfc1-93ac-4f3b-85c7-66b483cc4182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:44.247677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537dfc1-93ac-4f3b-85c7-66b483cc4182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:44.247960 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537dfc1-93ac-4f3b-85c7-66b483cc4182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:44.248316 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537dfc1-93ac-4f3b-85c7-66b483cc4182 admin admin] PATH_INFO: `/v3/users/df2b835b46c244df80241d06f8c22ac4` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:44.249771 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537dfc1-93ac-4f3b-85c7-66b483cc4182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2b835b46c244df80241d06f8c22ac4)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:44.256885 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537dfc1-93ac-4f3b-85c7-66b483cc4182 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:44.276712 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d3e6d-46a1-4861-8aa7-ecde8d600a71 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:44.297068 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77dbd8-d813-4a9f-8420-3305ce2c5629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:44.298151 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77dbd8-d813-4a9f-8420-3305ce2c5629 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:44.298676 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77dbd8-d813-4a9f-8420-3305ce2c5629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:44.299258 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77dbd8-d813-4a9f-8420-3305ce2c5629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:44.300311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77dbd8-d813-4a9f-8420-3305ce2c5629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:44.302929 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77dbd8-d813-4a9f-8420-3305ce2c5629 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:44.309785 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:44.316280 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1014/2021] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:35:44.321709 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77dbd8-d813-4a9f-8420-3305ce2c5629 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:44.351549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77dbd8-d813-4a9f-8420-3305ce2c5629 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:44.353857 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0537dfc1-93ac-4f3b-85c7-66b483cc4182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2b835b46c244df80241d06f8c22ac4'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:44.364219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484af828-f3ea-4646-a61c-e6ff0fbc67a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:44.367085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484af828-f3ea-4646-a61c-e6ff0fbc67a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:44.367430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484af828-f3ea-4646-a61c-e6ff0fbc67a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:44.367665 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484af828-f3ea-4646-a61c-e6ff0fbc67a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:44.368461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484af828-f3ea-4646-a61c-e6ff0fbc67a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:44.370159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484af828-f3ea-4646-a61c-e6ff0fbc67a8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:44.372500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0537dfc1-93ac-4f3b-85c7-66b483cc4182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2b835b46c244df80241d06f8c22ac4'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:44.394814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1015/2022] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:44.394814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484af828-f3ea-4646-a61c-e6ff0fbc67a8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:44.394814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-484af828-f3ea-4646-a61c-e6ff0fbc67a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:44.406163 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0537dfc1-93ac-4f3b-85c7-66b483cc4182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2b835b46c244df80241d06f8c22ac4'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:44.410469 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484af828-f3ea-4646-a61c-e6ff0fbc67a8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:44.420420 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0537dfc1-93ac-4f3b-85c7-66b483cc4182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2b835b46c244df80241d06f8c22ac4'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:44.421155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0537dfc1-93ac-4f3b-85c7-66b483cc4182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2b835b46c244df80241d06f8c22ac4'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:44.421297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb602a5-a311-4f0d-a1fc-ed0a0ec1e782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:44.422245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb602a5-a311-4f0d-a1fc-ed0a0ec1e782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:44.422790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb602a5-a311-4f0d-a1fc-ed0a0ec1e782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:44.423071 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb602a5-a311-4f0d-a1fc-ed0a0ec1e782 admin admin] PATH_INFO: `/v3/projects/1e847831dc384e6e90b5128317da2e8d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:44.424812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb602a5-a311-4f0d-a1fc-ed0a0ec1e782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e847831dc384e6e90b5128317da2e8d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:44.427634 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb602a5-a311-4f0d-a1fc-ed0a0ec1e782 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:44.430824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1008/2023] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:44 2022] DELETE /identity/v3/users/df2b835b46c244df80241d06f8c22ac4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:44.431921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537dfc1-93ac-4f3b-85c7-66b483cc4182 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:44.433439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0537dfc1-93ac-4f3b-85c7-66b483cc4182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:44.452634 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:44.511069 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dcb602a5-a311-4f0d-a1fc-ed0a0ec1e782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e847831dc384e6e90b5128317da2e8d', 'request_id': 'req-dcb602a5-a311-4f0d-a1fc-ed0a0ec1e782'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:44.524299 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dcb602a5-a311-4f0d-a1fc-ed0a0ec1e782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e847831dc384e6e90b5128317da2e8d', 'request_id': 'req-dcb602a5-a311-4f0d-a1fc-ed0a0ec1e782'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:44.532935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dcb602a5-a311-4f0d-a1fc-ed0a0ec1e782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e847831dc384e6e90b5128317da2e8d', 'request_id': 'req-dcb602a5-a311-4f0d-a1fc-ed0a0ec1e782'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:44.547448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dcb602a5-a311-4f0d-a1fc-ed0a0ec1e782 admin admin] The token cache is being invalidate because project 1e847831dc384e6e90b5128317da2e8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:44.547987 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dcb602a5-a311-4f0d-a1fc-ed0a0ec1e782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:44.548943 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dcb602a5-a311-4f0d-a1fc-ed0a0ec1e782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:44.550715 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1016/2024] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:44 2022] DELETE /identity/v3/projects/1e847831dc384e6e90b5128317da2e8d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:44.556302 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819bb8c-f567-4c67-81f7-e481854bd446 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:44.561222 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537dfc1-93ac-4f3b-85c7-66b483cc4182 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:44.565828 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819bb8c-f567-4c67-81f7-e481854bd446 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:44.567379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819bb8c-f567-4c67-81f7-e481854bd446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:44.600548 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8819bb8c-f567-4c67-81f7-e481854bd446 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:44.602164 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8819bb8c-f567-4c67-81f7-e481854bd446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:44.722018 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1017/2025] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:44.728308 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aaec82-fbb5-427c-86fe-57d937c314d3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:44.728623 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aaec82-fbb5-427c-86fe-57d937c314d3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:44.728753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aaec82-fbb5-427c-86fe-57d937c314d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:44.731002 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3530cd-8c80-415a-9c98-b02917347250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:44.731936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3530cd-8c80-415a-9c98-b02917347250 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:44.732242 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3530cd-8c80-415a-9c98-b02917347250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:44.732518 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3530cd-8c80-415a-9c98-b02917347250 admin admin] PATH_INFO: `/v3/projects/80015d034f1c416f8e51a4e48cc03e4f/users/9bbd8b19128d4a19a0d6fdd81d787237/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:44.755286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3530cd-8c80-415a-9c98-b02917347250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80015d034f1c416f8e51a4e48cc03e4f, user_id=9bbd8b19128d4a19a0d6fdd81d787237, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:44.759032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3530cd-8c80-415a-9c98-b02917347250 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:44.759730 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-61aaec82-fbb5-427c-86fe-57d937c314d3 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:44.761268 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-61aaec82-fbb5-427c-86fe-57d937c314d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:44.778270 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1018/2026] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:44.779425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aaec82-fbb5-427c-86fe-57d937c314d3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:44.798446 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1009/2027] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:44 2022] PUT /identity/v3/projects/80015d034f1c416f8e51a4e48cc03e4f/users/9bbd8b19128d4a19a0d6fdd81d787237/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:44.798658 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aaec82-fbb5-427c-86fe-57d937c314d3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:44.800239 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8965b-d98a-4c5b-a146-65f7fc5c2ee4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:44.800652 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8965b-d98a-4c5b-a146-65f7fc5c2ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:44.801433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8965b-d98a-4c5b-a146-65f7fc5c2ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:44.842222 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-93f8965b-d98a-4c5b-a146-65f7fc5c2ee4 None None] MFA Rules not processed for user `9bbd8b19128d4a19a0d6fdd81d787237`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:44.844310 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-93f8965b-d98a-4c5b-a146-65f7fc5c2ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:44.873834 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517434e0-fd65-49ad-8545-32f877228690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:44.875096 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517434e0-fd65-49ad-8545-32f877228690 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:44.875578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517434e0-fd65-49ad-8545-32f877228690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:44.876078 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517434e0-fd65-49ad-8545-32f877228690 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:44.877112 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517434e0-fd65-49ad-8545-32f877228690 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:44.877769 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517434e0-fd65-49ad-8545-32f877228690 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:44.879671 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517434e0-fd65-49ad-8545-32f877228690 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:44.885099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:44.899528 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1019/2028] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:35:44.901374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517434e0-fd65-49ad-8545-32f877228690 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:44.903779 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-517434e0-fd65-49ad-8545-32f877228690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:44.919148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517434e0-fd65-49ad-8545-32f877228690 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:44.925828 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82800243-8f65-43af-8116-ca29e67011f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:44.926025 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82800243-8f65-43af-8116-ca29e67011f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:44.926261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82800243-8f65-43af-8116-ca29e67011f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:44.926489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82800243-8f65-43af-8116-ca29e67011f0 admin admin] PATH_INFO: `/v3/projects/6230179549b8491cb57270ef06ef8730` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:44.928538 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82800243-8f65-43af-8116-ca29e67011f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6230179549b8491cb57270ef06ef8730)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:44.930478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82800243-8f65-43af-8116-ca29e67011f0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:44.947794 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1010/2029] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:44.949250 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8965b-d98a-4c5b-a146-65f7fc5c2ee4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:44.957346 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:44.965193 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8965b-d98a-4c5b-a146-65f7fc5c2ee4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:44.970756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55769cea-d978-48e8-ac72-da0e96d68c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:44.971638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55769cea-d978-48e8-ac72-da0e96d68c4e admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:44.972288 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55769cea-d978-48e8-ac72-da0e96d68c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:44.972622 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55769cea-d978-48e8-ac72-da0e96d68c4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:44.973394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55769cea-d978-48e8-ac72-da0e96d68c4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:44.975956 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55769cea-d978-48e8-ac72-da0e96d68c4e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:44.987017 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-82800243-8f65-43af-8116-ca29e67011f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6230179549b8491cb57270ef06ef8730', 'request_id': 'req-82800243-8f65-43af-8116-ca29e67011f0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:44.997725 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-82800243-8f65-43af-8116-ca29e67011f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6230179549b8491cb57270ef06ef8730', 'request_id': 'req-82800243-8f65-43af-8116-ca29e67011f0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:45.012254 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-82800243-8f65-43af-8116-ca29e67011f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6230179549b8491cb57270ef06ef8730', 'request_id': 'req-82800243-8f65-43af-8116-ca29e67011f0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:45.017150 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1011/2030] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:44 2022] POST /identity/v3/projects => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:45.017150 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55769cea-d978-48e8-ac72-da0e96d68c4e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:45.017150 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-55769cea-d978-48e8-ac72-da0e96d68c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:45.030384 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-82800243-8f65-43af-8116-ca29e67011f0 admin admin] The token cache is being invalidate because project 6230179549b8491cb57270ef06ef8730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:45.031079 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-82800243-8f65-43af-8116-ca29e67011f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:45.031892 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-82800243-8f65-43af-8116-ca29e67011f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:45.034244 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1020/2031] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:44 2022] DELETE /identity/v3/projects/6230179549b8491cb57270ef06ef8730 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:45.035078 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82800243-8f65-43af-8116-ca29e67011f0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:45.036561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-82800243-8f65-43af-8116-ca29e67011f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:45.126028 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55769cea-d978-48e8-ac72-da0e96d68c4e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:45.127849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82800243-8f65-43af-8116-ca29e67011f0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:45.132483 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ce5ba-4487-4f49-baba-834512833fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:45.132483 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ce5ba-4487-4f49-baba-834512833fda admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:45.132874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ce5ba-4487-4f49-baba-834512833fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:45.133002 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ce5ba-4487-4f49-baba-834512833fda admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:45.133927 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ce5ba-4487-4f49-baba-834512833fda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:45.135987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ce5ba-4487-4f49-baba-834512833fda admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:45.147405 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd7e2c-392f-4706-b927-7d704e993061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:45.150554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd7e2c-392f-4706-b927-7d704e993061 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:45.151877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd7e2c-392f-4706-b927-7d704e993061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:45.152380 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd7e2c-392f-4706-b927-7d704e993061 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:45.153581 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd7e2c-392f-4706-b927-7d704e993061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:45.159199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd7e2c-392f-4706-b927-7d704e993061 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:45.175628 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1012/2032] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:45 2022] POST /identity/v3/projects => generated 389 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:45.177569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adeb2f-685e-49ee-b18c-045e611ba05a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:45.177863 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adeb2f-685e-49ee-b18c-045e611ba05a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:45.178153 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adeb2f-685e-49ee-b18c-045e611ba05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:45.195817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1021/2033] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:45 2022] POST /identity/v3/users => generated 284 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:45.197352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd7e2c-392f-4706-b927-7d704e993061 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:45.200385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c5bd7e2c-392f-4706-b927-7d704e993061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:45.201495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-53adeb2f-685e-49ee-b18c-045e611ba05a None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:45.202855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-53adeb2f-685e-49ee-b18c-045e611ba05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:45.217488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd7e2c-392f-4706-b927-7d704e993061 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:45.304985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1013/2034] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:45.304985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adeb2f-685e-49ee-b18c-045e611ba05a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:45.311807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adeb2f-685e-49ee-b18c-045e611ba05a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:45.316929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98da055-d5d7-4b02-9046-3e93168a69fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:45.317769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da055-d5d7-4b02-9046-3e93168a69fc admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:45.318116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da055-d5d7-4b02-9046-3e93168a69fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:45.318344 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c19965-2c12-45f6-99ba-225967b5bd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:45.318485 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da055-d5d7-4b02-9046-3e93168a69fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:45.319217 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98da055-d5d7-4b02-9046-3e93168a69fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:45.319460 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c19965-2c12-45f6-99ba-225967b5bd85 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:45.319885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c19965-2c12-45f6-99ba-225967b5bd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:45.320355 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c19965-2c12-45f6-99ba-225967b5bd85 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:45.321054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98da055-d5d7-4b02-9046-3e93168a69fc admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:45.321369 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c19965-2c12-45f6-99ba-225967b5bd85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:45.324685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c19965-2c12-45f6-99ba-225967b5bd85 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:45.336246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1014/2035] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:45.338157 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0328628-86db-482c-b8ac-72a210d2be44 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:45.338456 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0328628-86db-482c-b8ac-72a210d2be44 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:45.338751 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0328628-86db-482c-b8ac-72a210d2be44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:45.356338 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1022/2036] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:45 2022] POST /identity/v3/users => generated 301 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:45.358553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c19965-2c12-45f6-99ba-225967b5bd85 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:45.363521 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e0328628-86db-482c-b8ac-72a210d2be44 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:45.365224 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e0328628-86db-482c-b8ac-72a210d2be44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:45.372952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c19965-2c12-45f6-99ba-225967b5bd85 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:45.377431 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1015/2037] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:45.377431 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0328628-86db-482c-b8ac-72a210d2be44 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:45.385523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4903c9-d41b-4a0c-9b0a-da97380ad19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:45.386949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4903c9-d41b-4a0c-9b0a-da97380ad19e admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:45.387306 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0328628-86db-482c-b8ac-72a210d2be44 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:45.387576 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4903c9-d41b-4a0c-9b0a-da97380ad19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:45.387999 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4903c9-d41b-4a0c-9b0a-da97380ad19e admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:45.388964 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4903c9-d41b-4a0c-9b0a-da97380ad19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:45.392403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e9384-7ed9-4da9-9f86-d855e748f6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:45.392562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4903c9-d41b-4a0c-9b0a-da97380ad19e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:45.393371 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e9384-7ed9-4da9-9f86-d855e748f6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:45.393658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e9384-7ed9-4da9-9f86-d855e748f6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:45.393934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e9384-7ed9-4da9-9f86-d855e748f6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:45.394664 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e9384-7ed9-4da9-9f86-d855e748f6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:45.405969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e9384-7ed9-4da9-9f86-d855e748f6e8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:45.408382 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1023/2038] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:45.409807 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4903c9-d41b-4a0c-9b0a-da97380ad19e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:45.415610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:45.422583 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4903c9-d41b-4a0c-9b0a-da97380ad19e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:45.425572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1016/2039] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:45.428085 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e9384-7ed9-4da9-9f86-d855e748f6e8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:45.431492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0a356-6b19-4612-8bba-7a7b3f8fd2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:45.432222 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0a356-6b19-4612-8bba-7a7b3f8fd2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:45.432512 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0a356-6b19-4612-8bba-7a7b3f8fd2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:45.432791 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0a356-6b19-4612-8bba-7a7b3f8fd2c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:45.433527 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0a356-6b19-4612-8bba-7a7b3f8fd2c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:45.433847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0a356-6b19-4612-8bba-7a7b3f8fd2c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:45.435724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0a356-6b19-4612-8bba-7a7b3f8fd2c0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:45.442230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e9384-7ed9-4da9-9f86-d855e748f6e8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:45.450864 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67527477-77a9-40ef-9baa-867190cc5889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:45.451665 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1024/2040] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:35:45.452226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67527477-77a9-40ef-9baa-867190cc5889 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:45.452592 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67527477-77a9-40ef-9baa-867190cc5889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:45.452927 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67527477-77a9-40ef-9baa-867190cc5889 admin admin] PATH_INFO: `/v3/projects/c8757862df174d08a1fe3722a20f19c3/users/c15f076376d149b2a0fb3bb9b9061374/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:45.456509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0a356-6b19-4612-8bba-7a7b3f8fd2c0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:45.469093 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0a356-6b19-4612-8bba-7a7b3f8fd2c0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:45.475500 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12708472-7f12-4d42-8969-9a0409998a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:45.476404 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67527477-77a9-40ef-9baa-867190cc5889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8757862df174d08a1fe3722a20f19c3, user_id=c15f076376d149b2a0fb3bb9b9061374, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:45.476940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12708472-7f12-4d42-8969-9a0409998a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:45.477419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12708472-7f12-4d42-8969-9a0409998a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:45.477841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12708472-7f12-4d42-8969-9a0409998a47 admin admin] PATH_INFO: `/v3/projects/942af122133042fdae4736182976d4e9/users/ee8d16ed5ce443939e822d2befe70135/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:45.480972 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=87,keystone:DELETE=6,keystone:INSERT=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:45.485590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67527477-77a9-40ef-9baa-867190cc5889 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:45.504637 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12708472-7f12-4d42-8969-9a0409998a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=942af122133042fdae4736182976d4e9, user_id=ee8d16ed5ce443939e822d2befe70135, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:45.511600 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1017/2041] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:45 2022] PUT /identity/v3/projects/c8757862df174d08a1fe3722a20f19c3/users/c15f076376d149b2a0fb3bb9b9061374/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:45.513681 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67527477-77a9-40ef-9baa-867190cc5889 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:45.514647 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12708472-7f12-4d42-8969-9a0409998a47 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:45.545529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1025/2042] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:45 2022] PUT /identity/v3/projects/942af122133042fdae4736182976d4e9/users/ee8d16ed5ce443939e822d2befe70135/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:45.548709 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c259a-2736-4096-a450-56604ebb9af6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:45.551188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c259a-2736-4096-a450-56604ebb9af6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:45.552302 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c259a-2736-4096-a450-56604ebb9af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:45.609659 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-031c259a-2736-4096-a450-56604ebb9af6 None None] MFA Rules not processed for user `c15f076376d149b2a0fb3bb9b9061374`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:45.611824 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-031c259a-2736-4096-a450-56604ebb9af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:45.626991 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67527477-77a9-40ef-9baa-867190cc5889 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:45.731909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1026/2043] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:45.733455 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c259a-2736-4096-a450-56604ebb9af6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:45.820456 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955ab8a-0f36-45f8-805f-93eec30096ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:45.821510 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955ab8a-0f36-45f8-805f-93eec30096ea admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:45.822109 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955ab8a-0f36-45f8-805f-93eec30096ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:45.823767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955ab8a-0f36-45f8-805f-93eec30096ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:45.825780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955ab8a-0f36-45f8-805f-93eec30096ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:45.830256 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955ab8a-0f36-45f8-805f-93eec30096ea admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:45.860812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c259a-2736-4096-a450-56604ebb9af6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:45.873825 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdcfde-cf96-427b-aae1-e070d092e6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:45.874647 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdcfde-cf96-427b-aae1-e070d092e6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:45.875029 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdcfde-cf96-427b-aae1-e070d092e6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:45.875401 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdcfde-cf96-427b-aae1-e070d092e6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:45.876585 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdcfde-cf96-427b-aae1-e070d092e6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:45.887193 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdcfde-cf96-427b-aae1-e070d092e6e3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:45.903176 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1018/2044] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:45 2022] POST /identity/v3/projects => generated 385 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:45.904441 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955ab8a-0f36-45f8-805f-93eec30096ea admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:45.919736 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1027/2045] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:45.927013 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdcfde-cf96-427b-aae1-e070d092e6e3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:45.953029 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdcfde-cf96-427b-aae1-e070d092e6e3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:46.025499 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955ab8a-0f36-45f8-805f-93eec30096ea admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:46.033602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62125cc-8d01-4a4e-844c-a78ef2a710a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:46.033602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62125cc-8d01-4a4e-844c-a78ef2a710a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:46.033602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62125cc-8d01-4a4e-844c-a78ef2a710a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:46.033602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62125cc-8d01-4a4e-844c-a78ef2a710a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:46.034348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62125cc-8d01-4a4e-844c-a78ef2a710a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:46.036803 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62125cc-8d01-4a4e-844c-a78ef2a710a0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:46.057729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:46.075383 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0961a6-2f51-45ef-97b7-911a1e5577fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:46.076571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0961a6-2f51-45ef-97b7-911a1e5577fe admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:46.077113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0961a6-2f51-45ef-97b7-911a1e5577fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:46.077508 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0961a6-2f51-45ef-97b7-911a1e5577fe admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:46.078565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0961a6-2f51-45ef-97b7-911a1e5577fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:46.084471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1019/2046] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:45 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:46.085132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0961a6-2f51-45ef-97b7-911a1e5577fe admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:46.085660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62125cc-8d01-4a4e-844c-a78ef2a710a0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:46.111321 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:46.122997 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1028/2047] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:45 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:46.124220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0961a6-2f51-45ef-97b7-911a1e5577fe admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:46.137644 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0961a6-2f51-45ef-97b7-911a1e5577fe admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:46.207185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62125cc-8d01-4a4e-844c-a78ef2a710a0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:46.209022 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f41859-3859-4ccb-b01e-31394aa6d18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:46.210404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41859-3859-4ccb-b01e-31394aa6d18f admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:46.210404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41859-3859-4ccb-b01e-31394aa6d18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:46.210404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41859-3859-4ccb-b01e-31394aa6d18f admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:46.211091 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f41859-3859-4ccb-b01e-31394aa6d18f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:46.213311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f41859-3859-4ccb-b01e-31394aa6d18f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:46.215302 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d76ab4-1b95-44fb-9fca-8296e6725a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:46.216058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d76ab4-1b95-44fb-9fca-8296e6725a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:46.216396 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d76ab4-1b95-44fb-9fca-8296e6725a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:46.216806 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d76ab4-1b95-44fb-9fca-8296e6725a62 admin admin] PATH_INFO: `/v3/projects/942af122133042fdae4736182976d4e9/users/ee8d16ed5ce443939e822d2befe70135/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:46.219552 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d76ab4-1b95-44fb-9fca-8296e6725a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=942af122133042fdae4736182976d4e9, user_id=ee8d16ed5ce443939e822d2befe70135, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:46.223003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d76ab4-1b95-44fb-9fca-8296e6725a62 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:46.240541 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1020/2048] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:46 2022] PUT /identity/v3/projects/942af122133042fdae4736182976d4e9/users/ee8d16ed5ce443939e822d2befe70135/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:46.241731 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d76ab4-1b95-44fb-9fca-8296e6725a62 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:46.247075 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1029/2049] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:46 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:46.259709 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f41859-3859-4ccb-b01e-31394aa6d18f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:46.276457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f41859-3859-4ccb-b01e-31394aa6d18f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:46.345158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d76ab4-1b95-44fb-9fca-8296e6725a62 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:46.355553 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da149e8-9a0c-4271-8a07-5c4f5edcbb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:46.356490 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da149e8-9a0c-4271-8a07-5c4f5edcbb30 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:46.356778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da149e8-9a0c-4271-8a07-5c4f5edcbb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:46.357439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da149e8-9a0c-4271-8a07-5c4f5edcbb30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:46.358518 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da149e8-9a0c-4271-8a07-5c4f5edcbb30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:46.360677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da149e8-9a0c-4271-8a07-5c4f5edcbb30 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:46.378907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1021/2050] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:46.378907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd3781-1eaf-4142-bbfe-eaaecb25ccc2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:46.378907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd3781-1eaf-4142-bbfe-eaaecb25ccc2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:46.378907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd3781-1eaf-4142-bbfe-eaaecb25ccc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:46.389811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffab5d-2135-49ac-9f21-dabf300359ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:46.390969 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffab5d-2135-49ac-9f21-dabf300359ac admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:46.391414 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffab5d-2135-49ac-9f21-dabf300359ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:46.391779 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffab5d-2135-49ac-9f21-dabf300359ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:46.392669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffab5d-2135-49ac-9f21-dabf300359ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:46.396723 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dffab5d-2135-49ac-9f21-dabf300359ac admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:46.414059 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-39fd3781-1eaf-4142-bbfe-eaaecb25ccc2 None None] MFA Rules not processed for user `ee8d16ed5ce443939e822d2befe70135`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:46.416053 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-39fd3781-1eaf-4142-bbfe-eaaecb25ccc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:46.434808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1030/2051] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:46.435850 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffab5d-2135-49ac-9f21-dabf300359ac admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:46.460340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffab5d-2135-49ac-9f21-dabf300359ac admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:46.471147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e8524-c87f-4daa-8fb0-33d6a6f6b75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:46.471951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e8524-c87f-4daa-8fb0-33d6a6f6b75a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:46.472262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e8524-c87f-4daa-8fb0-33d6a6f6b75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:46.472532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e8524-c87f-4daa-8fb0-33d6a6f6b75a admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:46.473379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e8524-c87f-4daa-8fb0-33d6a6f6b75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:46.483363 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e8524-c87f-4daa-8fb0-33d6a6f6b75a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:46.491881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1031/2052] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:46.492850 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e8524-c87f-4daa-8fb0-33d6a6f6b75a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:46.504460 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e8524-c87f-4daa-8fb0-33d6a6f6b75a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:46.511274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab47f1-4fd5-46ea-ac62-29dfde796dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:46.512221 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab47f1-4fd5-46ea-ac62-29dfde796dba admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:46.512504 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab47f1-4fd5-46ea-ac62-29dfde796dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:46.512819 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab47f1-4fd5-46ea-ac62-29dfde796dba admin admin] PATH_INFO: `/v3/projects/2ea1ffaf3bd24cc39d9fe66d07a779b3/users/bf25acfefc4c408da0e9d5d0cfebf002/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:46.524379 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1022/2053] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:46.525218 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd3781-1eaf-4142-bbfe-eaaecb25ccc2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:46.536192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab47f1-4fd5-46ea-ac62-29dfde796dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea1ffaf3bd24cc39d9fe66d07a779b3, user_id=bf25acfefc4c408da0e9d5d0cfebf002, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:46.539567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab47f1-4fd5-46ea-ac62-29dfde796dba admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:46.549388 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd3781-1eaf-4142-bbfe-eaaecb25ccc2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:46.556109 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c2c6d-02ad-4fa6-894f-b76ba5993b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:46.557178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c2c6d-02ad-4fa6-894f-b76ba5993b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:46.557570 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c2c6d-02ad-4fa6-894f-b76ba5993b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:46.557947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c2c6d-02ad-4fa6-894f-b76ba5993b4f admin admin] PATH_INFO: `/v3/projects/df3d9903074f4c1598d032eacd853068/users/bf7161edbbcd4fbc8ddda1e55e55203b/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:46.561767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:46.564382 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1032/2054] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:46 2022] PUT /identity/v3/projects/2ea1ffaf3bd24cc39d9fe66d07a779b3/users/bf25acfefc4c408da0e9d5d0cfebf002/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:46.565266 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab47f1-4fd5-46ea-ac62-29dfde796dba admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:46.567004 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-daab47f1-4fd5-46ea-ac62-29dfde796dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:46.584116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c2c6d-02ad-4fa6-894f-b76ba5993b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=df3d9903074f4c1598d032eacd853068, user_id=bf7161edbbcd4fbc8ddda1e55e55203b, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:46.587200 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c2c6d-02ad-4fa6-894f-b76ba5993b4f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:46.616323 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1023/2055] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:46 2022] PUT /identity/v3/projects/df3d9903074f4c1598d032eacd853068/users/bf7161edbbcd4fbc8ddda1e55e55203b/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:46.616323 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c2c6d-02ad-4fa6-894f-b76ba5993b4f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:46.643141 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:46.650563 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab47f1-4fd5-46ea-ac62-29dfde796dba admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:46.710220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c2c6d-02ad-4fa6-894f-b76ba5993b4f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:46.717855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863cee6-2a19-4a87-86c8-85b9a208b649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:46.718564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863cee6-2a19-4a87-86c8-85b9a208b649 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:46.719445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863cee6-2a19-4a87-86c8-85b9a208b649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:46.719736 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863cee6-2a19-4a87-86c8-85b9a208b649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:46.720570 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863cee6-2a19-4a87-86c8-85b9a208b649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:46.722553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eaa9cf-1dfa-46ea-8051-267c9b56111f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:46.722553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eaa9cf-1dfa-46ea-8051-267c9b56111f service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:46.722776 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863cee6-2a19-4a87-86c8-85b9a208b649 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:46.722856 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eaa9cf-1dfa-46ea-8051-267c9b56111f service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:46.722856 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eaa9cf-1dfa-46ea-8051-267c9b56111f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:46.740195 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1024/2056] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:46.742346 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ee25d-9af0-4f84-a965-de4b42f80941 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:46.744538 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ee25d-9af0-4f84-a965-de4b42f80941 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:46.744854 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ee25d-9af0-4f84-a965-de4b42f80941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:46.774592 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d91ee25d-9af0-4f84-a965-de4b42f80941 None None] MFA Rules not processed for user `bf7161edbbcd4fbc8ddda1e55e55203b`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:46.775886 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d91ee25d-9af0-4f84-a965-de4b42f80941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:46.803589 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eaa9cf-1dfa-46ea-8051-267c9b56111f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:46.806036 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eaa9cf-1dfa-46ea-8051-267c9b56111f service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:46.821772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1033/2057] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:46.823165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eaa9cf-1dfa-46ea-8051-267c9b56111f service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:46.840288 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eaa9cf-1dfa-46ea-8051-267c9b56111f service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:46.853844 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10fb1f-9f13-43c6-ac88-57cc45efb732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:46.854766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10fb1f-9f13-43c6-ac88-57cc45efb732 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:46.855044 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10fb1f-9f13-43c6-ac88-57cc45efb732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:46.855323 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10fb1f-9f13-43c6-ac88-57cc45efb732 admin admin] PATH_INFO: `/v3/projects/2ea1ffaf3bd24cc39d9fe66d07a779b3/users/bf25acfefc4c408da0e9d5d0cfebf002/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:46.857420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10fb1f-9f13-43c6-ac88-57cc45efb732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea1ffaf3bd24cc39d9fe66d07a779b3, user_id=bf25acfefc4c408da0e9d5d0cfebf002, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:46.860149 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10fb1f-9f13-43c6-ac88-57cc45efb732 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:46.875575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1034/2058] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:46 2022] PUT /identity/v3/projects/2ea1ffaf3bd24cc39d9fe66d07a779b3/users/bf25acfefc4c408da0e9d5d0cfebf002/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:46.880121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1025/2059] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:46.880891 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10fb1f-9f13-43c6-ac88-57cc45efb732 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:46.891124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8578146-7a7f-4d2c-ac9f-dc18d5f06013 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:46.891828 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8578146-7a7f-4d2c-ac9f-dc18d5f06013 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:46.892514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8578146-7a7f-4d2c-ac9f-dc18d5f06013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:46.933892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f8578146-7a7f-4d2c-ac9f-dc18d5f06013 None None] MFA Rules not processed for user `bf25acfefc4c408da0e9d5d0cfebf002`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:46.935727 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f8578146-7a7f-4d2c-ac9f-dc18d5f06013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:46.971931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10fb1f-9f13-43c6-ac88-57cc45efb732 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:46.981710 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fca2a-e061-486f-913b-a8b14dd47357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:46.982396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fca2a-e061-486f-913b-a8b14dd47357 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:46.982680 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fca2a-e061-486f-913b-a8b14dd47357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:46.982989 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fca2a-e061-486f-913b-a8b14dd47357 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:46.983716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fca2a-e061-486f-913b-a8b14dd47357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:46.985794 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fca2a-e061-486f-913b-a8b14dd47357 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:47.014795 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:47.016726 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1035/2060] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:46 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:35:47.017657 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fca2a-e061-486f-913b-a8b14dd47357 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:47.025779 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1026/2061] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:47.026472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8578146-7a7f-4d2c-ac9f-dc18d5f06013 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:47.043837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8578146-7a7f-4d2c-ac9f-dc18d5f06013 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:47.069659 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:47.107385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fca2a-e061-486f-913b-a8b14dd47357 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:47.112222 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7002395-2d10-44e4-8677-71696cf9eafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:47.113226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7002395-2d10-44e4-8677-71696cf9eafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:47.113503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7002395-2d10-44e4-8677-71696cf9eafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:47.113774 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7002395-2d10-44e4-8677-71696cf9eafa admin admin] PATH_INFO: `/v3/users/9bbd8b19128d4a19a0d6fdd81d787237` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:47.115161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21a5e3-2480-47ec-adab-bc3cc4f4f291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:47.115672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7002395-2d10-44e4-8677-71696cf9eafa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bbd8b19128d4a19a0d6fdd81d787237)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:47.115842 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21a5e3-2480-47ec-adab-bc3cc4f4f291 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:47.116161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21a5e3-2480-47ec-adab-bc3cc4f4f291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:47.116437 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21a5e3-2480-47ec-adab-bc3cc4f4f291 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:47.117134 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21a5e3-2480-47ec-adab-bc3cc4f4f291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:47.117675 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7002395-2d10-44e4-8677-71696cf9eafa admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:47.119065 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21a5e3-2480-47ec-adab-bc3cc4f4f291 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:47.145434 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1027/2062] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:47 2022] POST /identity/v3/users => generated 300 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:47.145434 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21a5e3-2480-47ec-adab-bc3cc4f4f291 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:47.169279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f7002395-2d10-44e4-8677-71696cf9eafa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bbd8b19128d4a19a0d6fdd81d787237'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:47.170059 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f7002395-2d10-44e4-8677-71696cf9eafa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bbd8b19128d4a19a0d6fdd81d787237'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:47.170753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f7002395-2d10-44e4-8677-71696cf9eafa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bbd8b19128d4a19a0d6fdd81d787237'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:47.185056 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f7002395-2d10-44e4-8677-71696cf9eafa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bbd8b19128d4a19a0d6fdd81d787237'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:47.192031 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f7002395-2d10-44e4-8677-71696cf9eafa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bbd8b19128d4a19a0d6fdd81d787237'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:47.202418 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21a5e3-2480-47ec-adab-bc3cc4f4f291 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:47.206150 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923a1a0-be8f-4a0f-91e8-f12dff9134ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:47.206802 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923a1a0-be8f-4a0f-91e8-f12dff9134ae service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:47.206992 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1036/2063] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:47 2022] DELETE /identity/v3/users/9bbd8b19128d4a19a0d6fdd81d787237 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:47.210242 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923a1a0-be8f-4a0f-91e8-f12dff9134ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:47.210242 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923a1a0-be8f-4a0f-91e8-f12dff9134ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:47.210412 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7002395-2d10-44e4-8677-71696cf9eafa admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:47.210412 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f7002395-2d10-44e4-8677-71696cf9eafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:47.210589 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3923a1a0-be8f-4a0f-91e8-f12dff9134ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:47.282049 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923a1a0-be8f-4a0f-91e8-f12dff9134ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:47.284965 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923a1a0-be8f-4a0f-91e8-f12dff9134ae service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:47.295615 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7002395-2d10-44e4-8677-71696cf9eafa admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:47.302459 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122340f-cc59-40cc-b942-77853f3b6226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:47.303583 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122340f-cc59-40cc-b942-77853f3b6226 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:47.304212 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122340f-cc59-40cc-b942-77853f3b6226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:47.304721 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122340f-cc59-40cc-b942-77853f3b6226 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:47.305683 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122340f-cc59-40cc-b942-77853f3b6226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:47.307638 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122340f-cc59-40cc-b942-77853f3b6226 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:47.309379 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1028/2064] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:47.311703 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cd98b-d9b9-4b13-bac2-42e09f29af18 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:47.312257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cd98b-d9b9-4b13-bac2-42e09f29af18 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:47.312767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cd98b-d9b9-4b13-bac2-42e09f29af18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:47.323933 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1037/2065] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:47.325816 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122340f-cc59-40cc-b942-77853f3b6226 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:47.340302 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122340f-cc59-40cc-b942-77853f3b6226 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:47.341907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-989cd98b-d9b9-4b13-bac2-42e09f29af18 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:47.344827 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-989cd98b-d9b9-4b13-bac2-42e09f29af18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:47.347894 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2c979-3a15-4a30-be47-57da1809167f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:47.350429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2c979-3a15-4a30-be47-57da1809167f admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:47.350719 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2c979-3a15-4a30-be47-57da1809167f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:47.351000 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2c979-3a15-4a30-be47-57da1809167f admin admin] PATH_INFO: `/v3/projects/2640a8122b624efbb35595fbf8abf1c3/users/76a30994a895433ca538a79f46d490d9/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:47.357579 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1029/2066] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:47.369730 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cd98b-d9b9-4b13-bac2-42e09f29af18 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:47.371570 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-989cd98b-d9b9-4b13-bac2-42e09f29af18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:47.371860 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2c979-3a15-4a30-be47-57da1809167f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2640a8122b624efbb35595fbf8abf1c3, user_id=76a30994a895433ca538a79f46d490d9, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:47.375140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2c979-3a15-4a30-be47-57da1809167f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:47.399878 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1038/2067] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:47 2022] PUT /identity/v3/projects/2640a8122b624efbb35595fbf8abf1c3/users/76a30994a895433ca538a79f46d490d9/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:47.404048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2c979-3a15-4a30-be47-57da1809167f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:47.435228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:47.445198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:47.479715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cd98b-d9b9-4b13-bac2-42e09f29af18 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:47.502881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2c979-3a15-4a30-be47-57da1809167f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:47.509005 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d2131-adfc-410c-bc3d-d64c25783ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:47.510189 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d2131-adfc-410c-bc3d-d64c25783ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:47.510571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d2131-adfc-410c-bc3d-d64c25783ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:47.510848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d2131-adfc-410c-bc3d-d64c25783ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:47.511978 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d2131-adfc-410c-bc3d-d64c25783ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:47.513986 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d2131-adfc-410c-bc3d-d64c25783ac0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:47.530046 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1039/2068] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:47.531069 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d2131-adfc-410c-bc3d-d64c25783ac0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:47.533207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-897d2131-adfc-410c-bc3d-d64c25783ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:47.546840 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a357c5-8c33-4eb0-84b3-9e40d739d4c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:47.548031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a357c5-8c33-4eb0-84b3-9e40d739d4c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:47.548612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a357c5-8c33-4eb0-84b3-9e40d739d4c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:47.549188 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a357c5-8c33-4eb0-84b3-9e40d739d4c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:47.561963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a357c5-8c33-4eb0-84b3-9e40d739d4c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:47.563437 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a357c5-8c33-4eb0-84b3-9e40d739d4c4 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:47.579334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1030/2069] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:47.580236 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a357c5-8c33-4eb0-84b3-9e40d739d4c4 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:47.607358 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a357c5-8c33-4eb0-84b3-9e40d739d4c4 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:47.612612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b1ed2-2c9e-4b42-8cb5-bc38b26a01d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:47.613712 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b1ed2-2c9e-4b42-8cb5-bc38b26a01d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:47.614092 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b1ed2-2c9e-4b42-8cb5-bc38b26a01d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:47.614617 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b1ed2-2c9e-4b42-8cb5-bc38b26a01d7 admin admin] PATH_INFO: `/v3/projects/2640a8122b624efbb35595fbf8abf1c3/users/76a30994a895433ca538a79f46d490d9/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:47.617256 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b1ed2-2c9e-4b42-8cb5-bc38b26a01d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2640a8122b624efbb35595fbf8abf1c3, user_id=76a30994a895433ca538a79f46d490d9, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:47.620082 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b1ed2-2c9e-4b42-8cb5-bc38b26a01d7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:47.635986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1031/2070] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:47 2022] PUT /identity/v3/projects/2640a8122b624efbb35595fbf8abf1c3/users/76a30994a895433ca538a79f46d490d9/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:47.648249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6620-165e-429e-9163-bc5ef16fea22 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:47.649751 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6620-165e-429e-9163-bc5ef16fea22 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:47.650747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6620-165e-429e-9163-bc5ef16fea22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:47.651092 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d2131-adfc-410c-bc3d-d64c25783ac0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:47.713361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-094b6620-165e-429e-9163-bc5ef16fea22 None None] MFA Rules not processed for user `76a30994a895433ca538a79f46d490d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:47.714731 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-094b6620-165e-429e-9163-bc5ef16fea22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:47.761436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f79d9-cf05-435c-ba1e-6ba2dfecc912 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:47.762292 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f79d9-cf05-435c-ba1e-6ba2dfecc912 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:47.762572 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f79d9-cf05-435c-ba1e-6ba2dfecc912 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:47.762839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f79d9-cf05-435c-ba1e-6ba2dfecc912 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:47.765493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d46f79d9-cf05-435c-ba1e-6ba2dfecc912 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:47.859959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1032/2071] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:47.875929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b6620-165e-429e-9163-bc5ef16fea22 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:47.877898 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-094b6620-165e-429e-9163-bc5ef16fea22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:47.886922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f79d9-cf05-435c-ba1e-6ba2dfecc912 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:47.888496 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f79d9-cf05-435c-ba1e-6ba2dfecc912 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:47.893952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b6620-165e-429e-9163-bc5ef16fea22 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:47.900258 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1040/2072] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:47.903876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae3a40-1729-444b-a511-e1474d3423de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:47.904612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae3a40-1729-444b-a511-e1474d3423de service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:47.904899 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae3a40-1729-444b-a511-e1474d3423de service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:47.905194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae3a40-1729-444b-a511-e1474d3423de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:47.917658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae3a40-1729-444b-a511-e1474d3423de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:47.919273 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae3a40-1729-444b-a511-e1474d3423de service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:47.936092 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1033/2073] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:48.008365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f79d9-cf05-435c-ba1e-6ba2dfecc912 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:48.009875 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d46f79d9-cf05-435c-ba1e-6ba2dfecc912 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:48.117571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:48.180851 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f79d9-cf05-435c-ba1e-6ba2dfecc912 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:48.186313 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5342fb-c2ea-4053-b1c0-d3643cf0f0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:48.187474 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5342fb-c2ea-4053-b1c0-d3643cf0f0ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:48.187886 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5342fb-c2ea-4053-b1c0-d3643cf0f0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:48.188418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5342fb-c2ea-4053-b1c0-d3643cf0f0ba admin admin] PATH_INFO: `/v3/projects/80015d034f1c416f8e51a4e48cc03e4f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:48.189649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5342fb-c2ea-4053-b1c0-d3643cf0f0ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=80015d034f1c416f8e51a4e48cc03e4f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:48.191700 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5342fb-c2ea-4053-b1c0-d3643cf0f0ba admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:48.306864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4d5342fb-c2ea-4053-b1c0-d3643cf0f0ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80015d034f1c416f8e51a4e48cc03e4f', 'request_id': 'req-4d5342fb-c2ea-4053-b1c0-d3643cf0f0ba'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:48.325280 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4d5342fb-c2ea-4053-b1c0-d3643cf0f0ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80015d034f1c416f8e51a4e48cc03e4f', 'request_id': 'req-4d5342fb-c2ea-4053-b1c0-d3643cf0f0ba'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:48.344560 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4d5342fb-c2ea-4053-b1c0-d3643cf0f0ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80015d034f1c416f8e51a4e48cc03e4f', 'request_id': 'req-4d5342fb-c2ea-4053-b1c0-d3643cf0f0ba'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:48.374584 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4d5342fb-c2ea-4053-b1c0-d3643cf0f0ba admin admin] The token cache is being invalidate because project 80015d034f1c416f8e51a4e48cc03e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:48.374908 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4d5342fb-c2ea-4053-b1c0-d3643cf0f0ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:48.375633 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4d5342fb-c2ea-4053-b1c0-d3643cf0f0ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:48.377392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1041/2074] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:48 2022] DELETE /identity/v3/projects/80015d034f1c416f8e51a4e48cc03e4f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:48.388184 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae3a40-1729-444b-a511-e1474d3423de service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:48.403864 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae3a40-1729-444b-a511-e1474d3423de service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:48.476050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:48.500176 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1adac5f-b308-47ff-84c1-fa60c17ad4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:48.503677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adac5f-b308-47ff-84c1-fa60c17ad4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:48.504068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adac5f-b308-47ff-84c1-fa60c17ad4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:48.504493 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1adac5f-b308-47ff-84c1-fa60c17ad4ca admin admin] PATH_INFO: `/v3/users/ee8d16ed5ce443939e822d2befe70135` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:48.505829 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1adac5f-b308-47ff-84c1-fa60c17ad4ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee8d16ed5ce443939e822d2befe70135)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:48.508093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1adac5f-b308-47ff-84c1-fa60c17ad4ca admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:48.572309 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1adac5f-b308-47ff-84c1-fa60c17ad4ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee8d16ed5ce443939e822d2befe70135'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:48.585044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1adac5f-b308-47ff-84c1-fa60c17ad4ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee8d16ed5ce443939e822d2befe70135'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:48.599269 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1adac5f-b308-47ff-84c1-fa60c17ad4ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee8d16ed5ce443939e822d2befe70135'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:48.608108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1adac5f-b308-47ff-84c1-fa60c17ad4ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee8d16ed5ce443939e822d2befe70135'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:48.608927 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d1adac5f-b308-47ff-84c1-fa60c17ad4ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee8d16ed5ce443939e822d2befe70135'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:48.615860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1034/2075] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:48 2022] DELETE /identity/v3/users/ee8d16ed5ce443939e822d2befe70135 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:48.765374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5342fb-c2ea-4053-b1c0-d3643cf0f0ba admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:48.766989 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4d5342fb-c2ea-4053-b1c0-d3643cf0f0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:48.788485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5342fb-c2ea-4053-b1c0-d3643cf0f0ba admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:48.912705 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d206ca7-3949-43c4-a0d9-d8dc949225b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:48.913661 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d206ca7-3949-43c4-a0d9-d8dc949225b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:48.913949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d206ca7-3949-43c4-a0d9-d8dc949225b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:48.914235 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d206ca7-3949-43c4-a0d9-d8dc949225b4 admin admin] PATH_INFO: `/v3/users/bf7161edbbcd4fbc8ddda1e55e55203b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:48.915639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d206ca7-3949-43c4-a0d9-d8dc949225b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf7161edbbcd4fbc8ddda1e55e55203b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:48.917721 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d206ca7-3949-43c4-a0d9-d8dc949225b4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:48.986679 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1adac5f-b308-47ff-84c1-fa60c17ad4ca admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:48.989445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d1adac5f-b308-47ff-84c1-fa60c17ad4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:48.995220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0d206ca7-3949-43c4-a0d9-d8dc949225b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf7161edbbcd4fbc8ddda1e55e55203b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:48.996274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0d206ca7-3949-43c4-a0d9-d8dc949225b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf7161edbbcd4fbc8ddda1e55e55203b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:48.997120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0d206ca7-3949-43c4-a0d9-d8dc949225b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf7161edbbcd4fbc8ddda1e55e55203b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:49.007850 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:49.014129 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1adac5f-b308-47ff-84c1-fa60c17ad4ca admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:49.019568 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0d206ca7-3949-43c4-a0d9-d8dc949225b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf7161edbbcd4fbc8ddda1e55e55203b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:49.022996 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baa83e-afbe-4aef-b66d-05de580ec0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:49.025176 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baa83e-afbe-4aef-b66d-05de580ec0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.025923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baa83e-afbe-4aef-b66d-05de580ec0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.026779 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baa83e-afbe-4aef-b66d-05de580ec0b5 admin admin] PATH_INFO: `/v3/projects/942af122133042fdae4736182976d4e9` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.028612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0d206ca7-3949-43c4-a0d9-d8dc949225b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf7161edbbcd4fbc8ddda1e55e55203b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:49.029135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baa83e-afbe-4aef-b66d-05de580ec0b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=942af122133042fdae4736182976d4e9)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:49.035246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baa83e-afbe-4aef-b66d-05de580ec0b5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:49.048289 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1042/2076] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:48 2022] DELETE /identity/v3/users/bf7161edbbcd4fbc8ddda1e55e55203b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:49.054080 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa01ec-4008-4d29-abe8-22c7492611aa None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.054429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa01ec-4008-4d29-abe8-22c7492611aa None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.054716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aa01ec-4008-4d29-abe8-22c7492611aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.075200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-07aa01ec-4008-4d29-abe8-22c7492611aa None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:49.076661 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-07aa01ec-4008-4d29-abe8-22c7492611aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:49.127956 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-43baa83e-afbe-4aef-b66d-05de580ec0b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '942af122133042fdae4736182976d4e9', 'request_id': 'req-43baa83e-afbe-4aef-b66d-05de580ec0b5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:49.140878 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-43baa83e-afbe-4aef-b66d-05de580ec0b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '942af122133042fdae4736182976d4e9', 'request_id': 'req-43baa83e-afbe-4aef-b66d-05de580ec0b5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:49.154627 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-43baa83e-afbe-4aef-b66d-05de580ec0b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '942af122133042fdae4736182976d4e9', 'request_id': 'req-43baa83e-afbe-4aef-b66d-05de580ec0b5'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:49.158201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1043/2077] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:49.166951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa01ec-4008-4d29-abe8-22c7492611aa None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:49.169264 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-07aa01ec-4008-4d29-abe8-22c7492611aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:49.178861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-43baa83e-afbe-4aef-b66d-05de580ec0b5 admin admin] The token cache is being invalidate because project 942af122133042fdae4736182976d4e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:49.179154 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-43baa83e-afbe-4aef-b66d-05de580ec0b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:49.180140 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-43baa83e-afbe-4aef-b66d-05de580ec0b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:49.186357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1035/2078] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:48 2022] DELETE /identity/v3/projects/942af122133042fdae4736182976d4e9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:49.189929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34386240-4f42-458e-b0f0-6e0b4bbd0847 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.190477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34386240-4f42-458e-b0f0-6e0b4bbd0847 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.190993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34386240-4f42-458e-b0f0-6e0b4bbd0847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.219277 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-34386240-4f42-458e-b0f0-6e0b4bbd0847 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:49.220972 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-34386240-4f42-458e-b0f0-6e0b4bbd0847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:49.255910 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aa01ec-4008-4d29-abe8-22c7492611aa None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:49.279179 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:49.301310 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1036/2079] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:49.310164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba4b66-3ce4-42cd-8097-7edcf900b1d1 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.310455 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba4b66-3ce4-42cd-8097-7edcf900b1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.310742 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba4b66-3ce4-42cd-8097-7edcf900b1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.321151 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97056f51-7dc8-4819-aeb1-ad8e12d1c100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:49.321798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97056f51-7dc8-4819-aeb1-ad8e12d1c100 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.322236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97056f51-7dc8-4819-aeb1-ad8e12d1c100 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.322731 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97056f51-7dc8-4819-aeb1-ad8e12d1c100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.325826 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-97056f51-7dc8-4819-aeb1-ad8e12d1c100 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:49.331796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8aba4b66-3ce4-42cd-8097-7edcf900b1d1 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:49.333181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8aba4b66-3ce4-42cd-8097-7edcf900b1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:49.341794 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97056f51-7dc8-4819-aeb1-ad8e12d1c100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:49.342091 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1037/2080] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:49.343355 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97056f51-7dc8-4819-aeb1-ad8e12d1c100 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:49.346648 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba4b66-3ce4-42cd-8097-7edcf900b1d1 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:49.356991 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba4b66-3ce4-42cd-8097-7edcf900b1d1 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:49.358401 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1044/2081] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:35:49.362696 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d03d0a-8857-463d-8caf-1a549a144d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:49.363479 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d03d0a-8857-463d-8caf-1a549a144d5e admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.363745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d03d0a-8857-463d-8caf-1a549a144d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.364117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d03d0a-8857-463d-8caf-1a549a144d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.365096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d03d0a-8857-463d-8caf-1a549a144d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:49.365402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d03d0a-8857-463d-8caf-1a549a144d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:49.367151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d03d0a-8857-463d-8caf-1a549a144d5e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:49.382929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1038/2082] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:35:49.388161 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97056f51-7dc8-4819-aeb1-ad8e12d1c100 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:49.399943 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97056f51-7dc8-4819-aeb1-ad8e12d1c100 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:49.405293 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809d087-80e3-4f1b-8169-ad7bdf1560ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:49.406070 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809d087-80e3-4f1b-8169-ad7bdf1560ec admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.406354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809d087-80e3-4f1b-8169-ad7bdf1560ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.406615 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809d087-80e3-4f1b-8169-ad7bdf1560ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.407319 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809d087-80e3-4f1b-8169-ad7bdf1560ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:49.409413 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809d087-80e3-4f1b-8169-ad7bdf1560ec admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:49.442909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1045/2083] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:49 2022] POST /identity/v3/projects => generated 359 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:49.447316 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d03d0a-8857-463d-8caf-1a549a144d5e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:49.460659 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d03d0a-8857-463d-8caf-1a549a144d5e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:49.573371 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a2904-7143-42c8-882c-8d24f29ff354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:49.575015 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a2904-7143-42c8-882c-8d24f29ff354 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.576107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a2904-7143-42c8-882c-8d24f29ff354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.576107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a2904-7143-42c8-882c-8d24f29ff354 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.576371 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a2904-7143-42c8-882c-8d24f29ff354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:49.578424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a2904-7143-42c8-882c-8d24f29ff354 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:49.608754 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1039/2084] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:49 2022] POST /identity/v3/users => generated 280 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:49.613095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809d087-80e3-4f1b-8169-ad7bdf1560ec admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:49.624425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809d087-80e3-4f1b-8169-ad7bdf1560ec admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:49.634478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b9a42-ae6f-45a5-80f0-bcffc3178e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:49.635471 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b9a42-ae6f-45a5-80f0-bcffc3178e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.635867 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b9a42-ae6f-45a5-80f0-bcffc3178e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.636257 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b9a42-ae6f-45a5-80f0-bcffc3178e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.637166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b9a42-ae6f-45a5-80f0-bcffc3178e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:49.638917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b9a42-ae6f-45a5-80f0-bcffc3178e47 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:49.644854 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:49.655806 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a2904-7143-42c8-882c-8d24f29ff354 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:49.662784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1046/2085] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:49.668419 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a2904-7143-42c8-882c-8d24f29ff354 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:49.679569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d58035-0eaf-4c54-8f44-7456a80950f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:49.681496 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d58035-0eaf-4c54-8f44-7456a80950f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.681762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d58035-0eaf-4c54-8f44-7456a80950f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.682125 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d58035-0eaf-4c54-8f44-7456a80950f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.682874 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d58035-0eaf-4c54-8f44-7456a80950f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:49.686167 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d58035-0eaf-4c54-8f44-7456a80950f7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:49.704131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b9a42-ae6f-45a5-80f0-bcffc3178e47 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:49.706626 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-354b9a42-ae6f-45a5-80f0-bcffc3178e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:49.733061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1040/2086] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:49.737459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d58035-0eaf-4c54-8f44-7456a80950f7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:49.748519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b9a42-ae6f-45a5-80f0-bcffc3178e47 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:49.761396 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d58035-0eaf-4c54-8f44-7456a80950f7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:49.767290 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ecb0c-a7d3-4aff-aaf8-4f4091207a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:49.769502 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ecb0c-a7d3-4aff-aaf8-4f4091207a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.769502 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ecb0c-a7d3-4aff-aaf8-4f4091207a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.769502 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ecb0c-a7d3-4aff-aaf8-4f4091207a2d admin admin] PATH_INFO: `/v3/projects/ab58c1b892cb40ce9ad496bcb6461960/users/e2586ae28d6f413db76064f6e6bd2d71/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.772562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b8f94-8403-4ac4-af0b-e179a8bf2948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:49.773470 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b8f94-8403-4ac4-af0b-e179a8bf2948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.773844 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b8f94-8403-4ac4-af0b-e179a8bf2948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.774028 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b8f94-8403-4ac4-af0b-e179a8bf2948 admin admin] PATH_INFO: `/v3/projects/df3d9903074f4c1598d032eacd853068` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.775275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b8f94-8403-4ac4-af0b-e179a8bf2948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df3d9903074f4c1598d032eacd853068)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:49.777288 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b8f94-8403-4ac4-af0b-e179a8bf2948 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:49.790658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ecb0c-a7d3-4aff-aaf8-4f4091207a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab58c1b892cb40ce9ad496bcb6461960, user_id=e2586ae28d6f413db76064f6e6bd2d71, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:49.796530 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ecb0c-a7d3-4aff-aaf8-4f4091207a2d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:49.826847 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1041/2087] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:49 2022] PUT /identity/v3/projects/ab58c1b892cb40ce9ad496bcb6461960/users/e2586ae28d6f413db76064f6e6bd2d71/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:49.837857 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf9683-bed8-4d28-8925-c661877650c4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.838150 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf9683-bed8-4d28-8925-c661877650c4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.838422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf9683-bed8-4d28-8925-c661877650c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.847609 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4b8b8f94-8403-4ac4-af0b-e179a8bf2948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df3d9903074f4c1598d032eacd853068', 'request_id': 'req-4b8b8f94-8403-4ac4-af0b-e179a8bf2948'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:49.858741 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4b8b8f94-8403-4ac4-af0b-e179a8bf2948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df3d9903074f4c1598d032eacd853068', 'request_id': 'req-4b8b8f94-8403-4ac4-af0b-e179a8bf2948'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:49.867727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4b8b8f94-8403-4ac4-af0b-e179a8bf2948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df3d9903074f4c1598d032eacd853068', 'request_id': 'req-4b8b8f94-8403-4ac4-af0b-e179a8bf2948'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:49.885104 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c1cf9683-bed8-4d28-8925-c661877650c4 None None] MFA Rules not processed for user `e2586ae28d6f413db76064f6e6bd2d71`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:49.886007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4b8b8f94-8403-4ac4-af0b-e179a8bf2948 admin admin] The token cache is being invalidate because project df3d9903074f4c1598d032eacd853068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:49.886303 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4b8b8f94-8403-4ac4-af0b-e179a8bf2948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:49.886987 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4b8b8f94-8403-4ac4-af0b-e179a8bf2948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:49.887329 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c1cf9683-bed8-4d28-8925-c661877650c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:49.891553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1047/2088] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:49 2022] DELETE /identity/v3/projects/df3d9903074f4c1598d032eacd853068 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:49.893110 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b8f94-8403-4ac4-af0b-e179a8bf2948 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:49.894795 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4b8b8f94-8403-4ac4-af0b-e179a8bf2948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:49.975688 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b8f94-8403-4ac4-af0b-e179a8bf2948 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:49.979729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1042/2089] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:49 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:49.983304 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03078e-9085-406b-8ba3-42dccde6fbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:49.984143 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03078e-9085-406b-8ba3-42dccde6fbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:49.984544 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03078e-9085-406b-8ba3-42dccde6fbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:49.991023 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03078e-9085-406b-8ba3-42dccde6fbd7 admin admin] PATH_INFO: `/v3/users/76a30994a895433ca538a79f46d490d9` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:49.992981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03078e-9085-406b-8ba3-42dccde6fbd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a30994a895433ca538a79f46d490d9)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:49.995009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03078e-9085-406b-8ba3-42dccde6fbd7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:50.009064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf9683-bed8-4d28-8925-c661877650c4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:50.010596 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c1cf9683-bed8-4d28-8925-c661877650c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.045791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:50.072750 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5e03078e-9085-406b-8ba3-42dccde6fbd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a30994a895433ca538a79f46d490d9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.073649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5e03078e-9085-406b-8ba3-42dccde6fbd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a30994a895433ca538a79f46d490d9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.074720 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5e03078e-9085-406b-8ba3-42dccde6fbd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a30994a895433ca538a79f46d490d9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.093414 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5e03078e-9085-406b-8ba3-42dccde6fbd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a30994a895433ca538a79f46d490d9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.103601 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-5e03078e-9085-406b-8ba3-42dccde6fbd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a30994a895433ca538a79f46d490d9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.122065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1048/2090] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:49 2022] DELETE /identity/v3/users/76a30994a895433ca538a79f46d490d9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:50.123257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf9683-bed8-4d28-8925-c661877650c4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:50.180316 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6279a8-b9e3-43c1-a8d6-34a9ae025f52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:50.180980 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6279a8-b9e3-43c1-a8d6-34a9ae025f52 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.181265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6279a8-b9e3-43c1-a8d6-34a9ae025f52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.181614 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6279a8-b9e3-43c1-a8d6-34a9ae025f52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.183379 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6c6279a8-b9e3-43c1-a8d6-34a9ae025f52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.253442 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6279a8-b9e3-43c1-a8d6-34a9ae025f52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:50.256148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6279a8-b9e3-43c1-a8d6-34a9ae025f52 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:50.269802 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03078e-9085-406b-8ba3-42dccde6fbd7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:50.272173 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5e03078e-9085-406b-8ba3-42dccde6fbd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.277991 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:50.283994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1043/2091] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:50 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:35:50.300092 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6279a8-b9e3-43c1-a8d6-34a9ae025f52 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:50.302773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6c6279a8-b9e3-43c1-a8d6-34a9ae025f52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.372434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03078e-9085-406b-8ba3-42dccde6fbd7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:50.377246 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1df74c-645e-467a-9a72-c5716bb65422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:50.378146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1df74c-645e-467a-9a72-c5716bb65422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.378493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1df74c-645e-467a-9a72-c5716bb65422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.378776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1df74c-645e-467a-9a72-c5716bb65422 admin admin] PATH_INFO: `/v3/users/5ec23439880c4169a49012f974e52537` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.380076 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1df74c-645e-467a-9a72-c5716bb65422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec23439880c4169a49012f974e52537)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:50.382211 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1df74c-645e-467a-9a72-c5716bb65422 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:50.409064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6279a8-b9e3-43c1-a8d6-34a9ae025f52 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:50.415146 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58799c8f-23bb-403a-96e8-9e94bd08343f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:50.416258 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58799c8f-23bb-403a-96e8-9e94bd08343f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.416701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58799c8f-23bb-403a-96e8-9e94bd08343f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.416984 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58799c8f-23bb-403a-96e8-9e94bd08343f admin admin] PATH_INFO: `/v3/users/e2586ae28d6f413db76064f6e6bd2d71` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.418352 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58799c8f-23bb-403a-96e8-9e94bd08343f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2586ae28d6f413db76064f6e6bd2d71)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:50.420638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58799c8f-23bb-403a-96e8-9e94bd08343f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:50.442486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c1df74c-645e-467a-9a72-c5716bb65422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec23439880c4169a49012f974e52537'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.443398 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c1df74c-645e-467a-9a72-c5716bb65422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec23439880c4169a49012f974e52537'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.444203 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c1df74c-645e-467a-9a72-c5716bb65422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec23439880c4169a49012f974e52537'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.455901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:50.461833 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c1df74c-645e-467a-9a72-c5716bb65422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec23439880c4169a49012f974e52537'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.472951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6c1df74c-645e-467a-9a72-c5716bb65422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec23439880c4169a49012f974e52537'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.488268 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1049/2092] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:50 2022] DELETE /identity/v3/users/5ec23439880c4169a49012f974e52537 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:50.489526 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-58799c8f-23bb-403a-96e8-9e94bd08343f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2586ae28d6f413db76064f6e6bd2d71'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.497036 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162830a-7f96-41c7-ba5e-17d128be6d5d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.497616 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162830a-7f96-41c7-ba5e-17d128be6d5d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.498084 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162830a-7f96-41c7-ba5e-17d128be6d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.498609 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-58799c8f-23bb-403a-96e8-9e94bd08343f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2586ae28d6f413db76064f6e6bd2d71'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.517575 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-58799c8f-23bb-403a-96e8-9e94bd08343f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2586ae28d6f413db76064f6e6bd2d71'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.517747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4162830a-7f96-41c7-ba5e-17d128be6d5d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:50.519044 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4162830a-7f96-41c7-ba5e-17d128be6d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.531131 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-58799c8f-23bb-403a-96e8-9e94bd08343f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2586ae28d6f413db76064f6e6bd2d71'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.531898 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-58799c8f-23bb-403a-96e8-9e94bd08343f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2586ae28d6f413db76064f6e6bd2d71'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.540614 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1044/2093] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:50 2022] DELETE /identity/v3/users/e2586ae28d6f413db76064f6e6bd2d71 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:50.544979 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58799c8f-23bb-403a-96e8-9e94bd08343f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:50.546848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-58799c8f-23bb-403a-96e8-9e94bd08343f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.593153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1050/2094] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:50.593153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4f6ca-cbe1-4c09-9125-90bbe6afafea None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.593153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4f6ca-cbe1-4c09-9125-90bbe6afafea None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.593153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4f6ca-cbe1-4c09-9125-90bbe6afafea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.611731 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-36b4f6ca-cbe1-4c09-9125-90bbe6afafea None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:50.613135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-36b4f6ca-cbe1-4c09-9125-90bbe6afafea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.620923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58799c8f-23bb-403a-96e8-9e94bd08343f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:50.621777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1051/2095] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:50.625583 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4f6ca-cbe1-4c09-9125-90bbe6afafea None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:50.625583 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-36b4f6ca-cbe1-4c09-9125-90bbe6afafea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.626510 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b5d8b-5fe4-45c9-86a5-b61760be07ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:50.626875 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b5d8b-5fe4-45c9-86a5-b61760be07ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.627158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b5d8b-5fe4-45c9-86a5-b61760be07ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.627433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b5d8b-5fe4-45c9-86a5-b61760be07ae admin admin] PATH_INFO: `/v3/projects/2640a8122b624efbb35595fbf8abf1c3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.628659 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b5d8b-5fe4-45c9-86a5-b61760be07ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=2640a8122b624efbb35595fbf8abf1c3)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:50.630817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69b5d8b-5fe4-45c9-86a5-b61760be07ae admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:50.645653 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:50.698639 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a69b5d8b-5fe4-45c9-86a5-b61760be07ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2640a8122b624efbb35595fbf8abf1c3', 'request_id': 'req-a69b5d8b-5fe4-45c9-86a5-b61760be07ae'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.698971 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4f6ca-cbe1-4c09-9125-90bbe6afafea None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:50.706478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a69b5d8b-5fe4-45c9-86a5-b61760be07ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2640a8122b624efbb35595fbf8abf1c3', 'request_id': 'req-a69b5d8b-5fe4-45c9-86a5-b61760be07ae'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.717696 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a69b5d8b-5fe4-45c9-86a5-b61760be07ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2640a8122b624efbb35595fbf8abf1c3', 'request_id': 'req-a69b5d8b-5fe4-45c9-86a5-b61760be07ae'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.729707 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a69b5d8b-5fe4-45c9-86a5-b61760be07ae admin admin] The token cache is being invalidate because project 2640a8122b624efbb35595fbf8abf1c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:50.729988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a69b5d8b-5fe4-45c9-86a5-b61760be07ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.730808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a69b5d8b-5fe4-45c9-86a5-b61760be07ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:50.732658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1045/2096] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:50 2022] DELETE /identity/v3/projects/2640a8122b624efbb35595fbf8abf1c3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:50.733361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b5d8b-5fe4-45c9-86a5-b61760be07ae admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:50.734681 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a69b5d8b-5fe4-45c9-86a5-b61760be07ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.756990 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bedb99-617c-4b68-bd91-6c9941a64093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:50.757633 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bedb99-617c-4b68-bd91-6c9941a64093 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.757919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bedb99-617c-4b68-bd91-6c9941a64093 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.758191 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bedb99-617c-4b68-bd91-6c9941a64093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.760034 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-84bedb99-617c-4b68-bd91-6c9941a64093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.774296 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:50.802900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b5d8b-5fe4-45c9-86a5-b61760be07ae admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:50.807439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85443e-5c82-46c7-aab6-1b0535a36cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:50.808229 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85443e-5c82-46c7-aab6-1b0535a36cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.808573 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85443e-5c82-46c7-aab6-1b0535a36cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.808933 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85443e-5c82-46c7-aab6-1b0535a36cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.811412 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8b85443e-5c82-46c7-aab6-1b0535a36cd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.839374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bedb99-617c-4b68-bd91-6c9941a64093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:50.842044 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bedb99-617c-4b68-bd91-6c9941a64093 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:50.864085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1052/2097] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:50.866399 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358dc84-e87a-42e6-95cf-626a3f216984 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.866733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358dc84-e87a-42e6-95cf-626a3f216984 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.867038 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358dc84-e87a-42e6-95cf-626a3f216984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.888857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1358dc84-e87a-42e6-95cf-626a3f216984 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:50.890364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1358dc84-e87a-42e6-95cf-626a3f216984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.895776 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85443e-5c82-46c7-aab6-1b0535a36cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:50.899010 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b85443e-5c82-46c7-aab6-1b0535a36cd4 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:50.900891 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1053/2098] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:50.909077 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273e319-e509-4aab-92f0-84852bc79913 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.909369 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273e319-e509-4aab-92f0-84852bc79913 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.909648 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273e319-e509-4aab-92f0-84852bc79913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.925078 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1046/2099] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:50.949660 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f273e319-e509-4aab-92f0-84852bc79913 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:50.949660 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f273e319-e509-4aab-92f0-84852bc79913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:50.957178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1054/2100] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:50.962156 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85443e-5c82-46c7-aab6-1b0535a36cd4 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:50.985396 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85443e-5c82-46c7-aab6-1b0535a36cd4 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:50.994681 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2594c-5fa4-4513-b4ef-a304979d2f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:50.997496 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2594c-5fa4-4513-b4ef-a304979d2f4e admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:50.997888 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2594c-5fa4-4513-b4ef-a304979d2f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:50.998184 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2594c-5fa4-4513-b4ef-a304979d2f4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:50.998921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2594c-5fa4-4513-b4ef-a304979d2f4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:50.999356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2594c-5fa4-4513-b4ef-a304979d2f4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:51.001705 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2594c-5fa4-4513-b4ef-a304979d2f4e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:51.018611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1047/2101] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:35:51.023717 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273e319-e509-4aab-92f0-84852bc79913 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:51.047061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273e319-e509-4aab-92f0-84852bc79913 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:51.055507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a933b-9554-4812-9637-e0058cf85762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:51.056420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a933b-9554-4812-9637-e0058cf85762 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:51.056789 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a933b-9554-4812-9637-e0058cf85762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:51.057199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a933b-9554-4812-9637-e0058cf85762 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:51.059206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a933b-9554-4812-9637-e0058cf85762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:51.061397 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a933b-9554-4812-9637-e0058cf85762 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:51.123221 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1055/2102] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:51 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:51.128049 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2594c-5fa4-4513-b4ef-a304979d2f4e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:51.139337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2594c-5fa4-4513-b4ef-a304979d2f4e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:51.226512 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db72927-8f96-4532-b9c0-4e1c71005e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:51.227450 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db72927-8f96-4532-b9c0-4e1c71005e98 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:51.227850 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db72927-8f96-4532-b9c0-4e1c71005e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:51.228172 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db72927-8f96-4532-b9c0-4e1c71005e98 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:51.229983 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db72927-8f96-4532-b9c0-4e1c71005e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:51.234211 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db72927-8f96-4532-b9c0-4e1c71005e98 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:51.290929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1048/2103] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:51 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:51.294967 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a933b-9554-4812-9637-e0058cf85762 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:51.307976 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a933b-9554-4812-9637-e0058cf85762 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:51.320134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f825f97-26ae-4aae-b3cb-b14269841100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:51.320989 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f825f97-26ae-4aae-b3cb-b14269841100 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:51.321887 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f825f97-26ae-4aae-b3cb-b14269841100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:51.321887 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f825f97-26ae-4aae-b3cb-b14269841100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:51.322573 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f825f97-26ae-4aae-b3cb-b14269841100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:51.325250 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f825f97-26ae-4aae-b3cb-b14269841100 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:51.342940 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db72927-8f96-4532-b9c0-4e1c71005e98 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:51.343509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1056/2104] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:51.355752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db72927-8f96-4532-b9c0-4e1c71005e98 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:51.360644 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54891d7e-4a84-4ea9-87d4-5a2b324f7a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:51.361452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54891d7e-4a84-4ea9-87d4-5a2b324f7a6d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:51.362077 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54891d7e-4a84-4ea9-87d4-5a2b324f7a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:51.362077 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54891d7e-4a84-4ea9-87d4-5a2b324f7a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:51.362927 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54891d7e-4a84-4ea9-87d4-5a2b324f7a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:51.364859 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54891d7e-4a84-4ea9-87d4-5a2b324f7a6d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:51.376814 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1049/2105] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:51.381826 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f825f97-26ae-4aae-b3cb-b14269841100 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:51.394152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f825f97-26ae-4aae-b3cb-b14269841100 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:51.410780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134eb1e9-6ea7-4269-8611-3ae7fd14335c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:51.412491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eb1e9-6ea7-4269-8611-3ae7fd14335c admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:51.412985 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eb1e9-6ea7-4269-8611-3ae7fd14335c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:51.413545 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eb1e9-6ea7-4269-8611-3ae7fd14335c admin admin] PATH_INFO: `/v3/projects/cc6f4fea32a44d859ebe2678c23d3121/users/79d3c93ed2064c6080971f0678d56519/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:51.435249 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134eb1e9-6ea7-4269-8611-3ae7fd14335c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc6f4fea32a44d859ebe2678c23d3121, user_id=79d3c93ed2064c6080971f0678d56519, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:51.440846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134eb1e9-6ea7-4269-8611-3ae7fd14335c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:51.470340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1057/2106] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:51 2022] PUT /identity/v3/projects/cc6f4fea32a44d859ebe2678c23d3121/users/79d3c93ed2064c6080971f0678d56519/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:51.484721 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60844c87-1de7-4baf-bcaa-fc3b8852c776 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:51.485033 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60844c87-1de7-4baf-bcaa-fc3b8852c776 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:51.485716 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60844c87-1de7-4baf-bcaa-fc3b8852c776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:51.527312 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-60844c87-1de7-4baf-bcaa-fc3b8852c776 None None] MFA Rules not processed for user `79d3c93ed2064c6080971f0678d56519`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:51.528714 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-60844c87-1de7-4baf-bcaa-fc3b8852c776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:51.594947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:51.634719 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1050/2107] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:51.639022 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134eb1e9-6ea7-4269-8611-3ae7fd14335c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:51.657064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60844c87-1de7-4baf-bcaa-fc3b8852c776 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:51.659249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-60844c87-1de7-4baf-bcaa-fc3b8852c776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:51.682692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:51.802320 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60844c87-1de7-4baf-bcaa-fc3b8852c776 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:51.816493 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac3228-acce-4a52-bb01-788971226709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:51.818980 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac3228-acce-4a52-bb01-788971226709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:51.819169 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134eb1e9-6ea7-4269-8611-3ae7fd14335c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:51.819278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac3228-acce-4a52-bb01-788971226709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:51.819963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac3228-acce-4a52-bb01-788971226709 admin admin] PATH_INFO: `/v3/projects/1abb6ddc3f1d4eeb8234c5b8341b8b4e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:51.822732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac3228-acce-4a52-bb01-788971226709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1abb6ddc3f1d4eeb8234c5b8341b8b4e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:51.828621 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac3228-acce-4a52-bb01-788971226709 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:51.831534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aae9c4-9fa7-4226-8062-a13da14b869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:51.832465 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aae9c4-9fa7-4226-8062-a13da14b869a admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:51.832811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aae9c4-9fa7-4226-8062-a13da14b869a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:51.833077 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aae9c4-9fa7-4226-8062-a13da14b869a admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:51.834121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aae9c4-9fa7-4226-8062-a13da14b869a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:51.836354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aae9c4-9fa7-4226-8062-a13da14b869a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:51.873400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1058/2108] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:51 2022] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:35:51.892718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aae9c4-9fa7-4226-8062-a13da14b869a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:51.898588 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-67aae9c4-9fa7-4226-8062-a13da14b869a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:51.936058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-14ac3228-acce-4a52-bb01-788971226709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1abb6ddc3f1d4eeb8234c5b8341b8b4e', 'request_id': 'req-14ac3228-acce-4a52-bb01-788971226709'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:51.943612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-14ac3228-acce-4a52-bb01-788971226709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1abb6ddc3f1d4eeb8234c5b8341b8b4e', 'request_id': 'req-14ac3228-acce-4a52-bb01-788971226709'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:51.960958 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-14ac3228-acce-4a52-bb01-788971226709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1abb6ddc3f1d4eeb8234c5b8341b8b4e', 'request_id': 'req-14ac3228-acce-4a52-bb01-788971226709'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:51.998032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-14ac3228-acce-4a52-bb01-788971226709 admin admin] The token cache is being invalidate because project 1abb6ddc3f1d4eeb8234c5b8341b8b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:51.998365 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-14ac3228-acce-4a52-bb01-788971226709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:52.000719 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-14ac3228-acce-4a52-bb01-788971226709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:52.004146 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1051/2109] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:51 2022] DELETE /identity/v3/projects/1abb6ddc3f1d4eeb8234c5b8341b8b4e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:52.006145 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac3228-acce-4a52-bb01-788971226709 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:52.012741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-14ac3228-acce-4a52-bb01-788971226709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:52.054982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aae9c4-9fa7-4226-8062-a13da14b869a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:52.132341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac3228-acce-4a52-bb01-788971226709 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:52.140970 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ad5c2-dd04-4603-8c0a-44103d8549c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:52.142163 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ad5c2-dd04-4603-8c0a-44103d8549c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.142723 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ad5c2-dd04-4603-8c0a-44103d8549c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.143243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ad5c2-dd04-4603-8c0a-44103d8549c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.148475 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377aed48-849a-4a13-9737-564bb56be1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:52.148762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ad5c2-dd04-4603-8c0a-44103d8549c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:52.149044 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aed48-849a-4a13-9737-564bb56be1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.149044 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aed48-849a-4a13-9737-564bb56be1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.149044 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aed48-849a-4a13-9737-564bb56be1c7 admin admin] PATH_INFO: `/v3/projects/ab58c1b892cb40ce9ad496bcb6461960` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.149044 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377aed48-849a-4a13-9737-564bb56be1c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab58c1b892cb40ce9ad496bcb6461960)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:52.149365 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ad5c2-dd04-4603-8c0a-44103d8549c9 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:52.149821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377aed48-849a-4a13-9737-564bb56be1c7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:52.174303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:52.185710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1052/2110] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:52 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:52.186962 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cc74a-1d97-40af-82fd-b4f5da251785 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.187221 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cc74a-1d97-40af-82fd-b4f5da251785 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.187572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cc74a-1d97-40af-82fd-b4f5da251785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.217748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-347cc74a-1d97-40af-82fd-b4f5da251785 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:52.218993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-347cc74a-1d97-40af-82fd-b4f5da251785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:52.222864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:52.227218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-377aed48-849a-4a13-9737-564bb56be1c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab58c1b892cb40ce9ad496bcb6461960', 'request_id': 'req-377aed48-849a-4a13-9737-564bb56be1c7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:52.244606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-377aed48-849a-4a13-9737-564bb56be1c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab58c1b892cb40ce9ad496bcb6461960', 'request_id': 'req-377aed48-849a-4a13-9737-564bb56be1c7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:52.252629 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-377aed48-849a-4a13-9737-564bb56be1c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab58c1b892cb40ce9ad496bcb6461960', 'request_id': 'req-377aed48-849a-4a13-9737-564bb56be1c7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:52.267211 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-377aed48-849a-4a13-9737-564bb56be1c7 admin admin] The token cache is being invalidate because project ab58c1b892cb40ce9ad496bcb6461960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:52.268494 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-377aed48-849a-4a13-9737-564bb56be1c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:52.269291 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-377aed48-849a-4a13-9737-564bb56be1c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:52.271284 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1059/2111] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:51 2022] DELETE /identity/v3/projects/ab58c1b892cb40ce9ad496bcb6461960 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:52.271853 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377aed48-849a-4a13-9737-564bb56be1c7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:52.273333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-377aed48-849a-4a13-9737-564bb56be1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:52.308650 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1053/2112] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:52.315207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b5a8d-87d3-4a47-b4b9-770909f3d5a0 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.315207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b5a8d-87d3-4a47-b4b9-770909f3d5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.315592 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b5a8d-87d3-4a47-b4b9-770909f3d5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.343475 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-dc7b5a8d-87d3-4a47-b4b9-770909f3d5a0 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:52.345103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-dc7b5a8d-87d3-4a47-b4b9-770909f3d5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:52.354326 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1054/2113] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:52.355844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3e52c-f083-401d-8307-6c5da8cdfea1 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.356212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3e52c-f083-401d-8307-6c5da8cdfea1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.356460 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3e52c-f083-401d-8307-6c5da8cdfea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.381732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377aed48-849a-4a13-9737-564bb56be1c7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:52.383643 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-47e3e52c-f083-401d-8307-6c5da8cdfea1 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:52.384982 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-47e3e52c-f083-401d-8307-6c5da8cdfea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:52.390743 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36adae3-6369-4d5b-bba9-03563ba0aaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:52.392217 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36adae3-6369-4d5b-bba9-03563ba0aaee admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.392217 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36adae3-6369-4d5b-bba9-03563ba0aaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.392217 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36adae3-6369-4d5b-bba9-03563ba0aaee admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.393009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36adae3-6369-4d5b-bba9-03563ba0aaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:52.394475 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1055/2114] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:52.395856 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad40d66-0b1f-43ec-9c7e-4af997602bd9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.396102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad40d66-0b1f-43ec-9c7e-4af997602bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.396493 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad40d66-0b1f-43ec-9c7e-4af997602bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.399108 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36adae3-6369-4d5b-bba9-03563ba0aaee admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:52.415908 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1060/2115] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:52.415908 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36adae3-6369-4d5b-bba9-03563ba0aaee admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:52.444688 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36adae3-6369-4d5b-bba9-03563ba0aaee admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:52.451617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec83aa-fcdd-46f4-9df3-39cb35174e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:52.452360 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec83aa-fcdd-46f4-9df3-39cb35174e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.452525 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-aad40d66-0b1f-43ec-9c7e-4af997602bd9 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:52.452658 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec83aa-fcdd-46f4-9df3-39cb35174e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.453022 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec83aa-fcdd-46f4-9df3-39cb35174e10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.453686 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec83aa-fcdd-46f4-9df3-39cb35174e10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:52.454053 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec83aa-fcdd-46f4-9df3-39cb35174e10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:52.454824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-aad40d66-0b1f-43ec-9c7e-4af997602bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:52.455762 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec83aa-fcdd-46f4-9df3-39cb35174e10 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:52.467064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1056/2116] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:52.468387 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad40d66-0b1f-43ec-9c7e-4af997602bd9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:52.476220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1061/2117] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:35:52.478405 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec83aa-fcdd-46f4-9df3-39cb35174e10 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:52.482913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad40d66-0b1f-43ec-9c7e-4af997602bd9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:52.488981 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470407a5-fe42-40fc-b1c1-27c92611655b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:52.491107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470407a5-fe42-40fc-b1c1-27c92611655b admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.491107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470407a5-fe42-40fc-b1c1-27c92611655b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.491475 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470407a5-fe42-40fc-b1c1-27c92611655b admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.492318 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470407a5-fe42-40fc-b1c1-27c92611655b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:52.493971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470407a5-fe42-40fc-b1c1-27c92611655b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:52.498616 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec83aa-fcdd-46f4-9df3-39cb35174e10 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:52.507165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83407b-19f8-4e40-a2e0-afad65dc68f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:52.511241 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1057/2118] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:52.511435 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83407b-19f8-4e40-a2e0-afad65dc68f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.511565 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470407a5-fe42-40fc-b1c1-27c92611655b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:52.511664 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83407b-19f8-4e40-a2e0-afad65dc68f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.511664 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83407b-19f8-4e40-a2e0-afad65dc68f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.512196 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83407b-19f8-4e40-a2e0-afad65dc68f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:52.512513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83407b-19f8-4e40-a2e0-afad65dc68f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:52.514407 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83407b-19f8-4e40-a2e0-afad65dc68f6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:52.528060 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470407a5-fe42-40fc-b1c1-27c92611655b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:52.534782 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1062/2119] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:35:52.534782 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83407b-19f8-4e40-a2e0-afad65dc68f6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:52.539858 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be680b0b-2620-4b7f-96de-1db973fcd500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:52.539858 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be680b0b-2620-4b7f-96de-1db973fcd500 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.539858 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be680b0b-2620-4b7f-96de-1db973fcd500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.539858 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be680b0b-2620-4b7f-96de-1db973fcd500 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.540272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be680b0b-2620-4b7f-96de-1db973fcd500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:52.541119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be680b0b-2620-4b7f-96de-1db973fcd500 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:52.552709 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83407b-19f8-4e40-a2e0-afad65dc68f6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:52.559561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf251b70-7278-4e76-bec8-7637334640cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:52.560738 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf251b70-7278-4e76-bec8-7637334640cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.564272 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf251b70-7278-4e76-bec8-7637334640cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.565858 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf251b70-7278-4e76-bec8-7637334640cc admin admin] PATH_INFO: `/v3/projects/a2854a5e81ab464b9b05ecbef27cc4fa/users/6f49737dacc849c09f2b74eae340ef24/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.576576 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1058/2120] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:52 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:52.577594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be680b0b-2620-4b7f-96de-1db973fcd500 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:52.585598 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf251b70-7278-4e76-bec8-7637334640cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2854a5e81ab464b9b05ecbef27cc4fa, user_id=6f49737dacc849c09f2b74eae340ef24, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:52.588434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf251b70-7278-4e76-bec8-7637334640cc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:52.604662 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1063/2121] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:52 2022] PUT /identity/v3/projects/a2854a5e81ab464b9b05ecbef27cc4fa/users/6f49737dacc849c09f2b74eae340ef24/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:52.614749 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf251b70-7278-4e76-bec8-7637334640cc admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:52.686009 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be680b0b-2620-4b7f-96de-1db973fcd500 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:52.703352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf251b70-7278-4e76-bec8-7637334640cc admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:52.709940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa34c5-2619-42ec-81d2-31f8ba4b8ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:52.710935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa34c5-2619-42ec-81d2-31f8ba4b8ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.711288 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa34c5-2619-42ec-81d2-31f8ba4b8ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.711569 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa34c5-2619-42ec-81d2-31f8ba4b8ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.712363 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa34c5-2619-42ec-81d2-31f8ba4b8ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:52.714857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa34c5-2619-42ec-81d2-31f8ba4b8ad7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:52.741188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1064/2122] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:52 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:52.742527 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca71ec-96cb-4a81-9032-dbd05e24acea None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.742854 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca71ec-96cb-4a81-9032-dbd05e24acea None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.743175 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca71ec-96cb-4a81-9032-dbd05e24acea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.757658 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:52.771495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f54a8b-cccf-459e-b289-192f3afe243c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:52.771733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:52.772644 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f54a8b-cccf-459e-b289-192f3afe243c admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.772911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f54a8b-cccf-459e-b289-192f3afe243c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.774560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f54a8b-cccf-459e-b289-192f3afe243c admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.775440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f54a8b-cccf-459e-b289-192f3afe243c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:52.778294 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f54a8b-cccf-459e-b289-192f3afe243c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:52.788229 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b6ca71ec-96cb-4a81-9032-dbd05e24acea None None] MFA Rules not processed for user `6f49737dacc849c09f2b74eae340ef24`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:52.790206 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b6ca71ec-96cb-4a81-9032-dbd05e24acea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:52.826416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1059/2123] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:52 2022] POST /identity/v3/projects => generated 375 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:52.827515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f54a8b-cccf-459e-b289-192f3afe243c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:52.877227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1065/2124] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:52.878541 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca71ec-96cb-4a81-9032-dbd05e24acea None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:52.890226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca71ec-96cb-4a81-9032-dbd05e24acea None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:52.918801 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f54a8b-cccf-459e-b289-192f3afe243c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:52.924087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0f96b-b51c-498d-99ff-ca4e5b42ae2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:52.924764 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0f96b-b51c-498d-99ff-ca4e5b42ae2a admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.925048 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0f96b-b51c-498d-99ff-ca4e5b42ae2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.925319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0f96b-b51c-498d-99ff-ca4e5b42ae2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.926049 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0f96b-b51c-498d-99ff-ca4e5b42ae2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:52.927751 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0f96b-b51c-498d-99ff-ca4e5b42ae2a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:52.938282 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1060/2125] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:52.939104 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0f96b-b51c-498d-99ff-ca4e5b42ae2a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:52.949685 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0f96b-b51c-498d-99ff-ca4e5b42ae2a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:52.954544 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4e1c8-3535-4afb-8507-22553294690c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:52.955233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4e1c8-3535-4afb-8507-22553294690c admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.955519 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4e1c8-3535-4afb-8507-22553294690c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.955798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4e1c8-3535-4afb-8507-22553294690c admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.956518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f478a-691a-47a8-bf5f-6330d2b0d9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:52.956648 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4e1c8-3535-4afb-8507-22553294690c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:52.957245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f478a-691a-47a8-bf5f-6330d2b0d9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:52.957713 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f478a-691a-47a8-bf5f-6330d2b0d9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:52.958022 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f478a-691a-47a8-bf5f-6330d2b0d9e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:52.958584 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4e1c8-3535-4afb-8507-22553294690c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:52.958939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f478a-691a-47a8-bf5f-6330d2b0d9e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:52.960973 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f478a-691a-47a8-bf5f-6330d2b0d9e4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:52.984387 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1066/2126] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:52 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:52.984387 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f478a-691a-47a8-bf5f-6330d2b0d9e4 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:52.993680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1061/2127] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:52 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:52.993680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4e1c8-3535-4afb-8507-22553294690c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:52.996354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f478a-691a-47a8-bf5f-6330d2b0d9e4 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.064637 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4e1c8-3535-4afb-8507-22553294690c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.066413 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af288a-c470-4fae-bfbc-bf13f20e28f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.067122 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af288a-c470-4fae-bfbc-bf13f20e28f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.067399 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af288a-c470-4fae-bfbc-bf13f20e28f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.067673 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af288a-c470-4fae-bfbc-bf13f20e28f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.068429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af288a-c470-4fae-bfbc-bf13f20e28f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.070058 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af288a-c470-4fae-bfbc-bf13f20e28f2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.070374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8350a-fad9-44f1-bfe1-6a03b71df72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.071053 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8350a-fad9-44f1-bfe1-6a03b71df72b admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.071340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8350a-fad9-44f1-bfe1-6a03b71df72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.071648 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8350a-fad9-44f1-bfe1-6a03b71df72b admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.072410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8350a-fad9-44f1-bfe1-6a03b71df72b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.074030 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8350a-fad9-44f1-bfe1-6a03b71df72b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.084331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1067/2128] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:53.084331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af288a-c470-4fae-bfbc-bf13f20e28f2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.085616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1062/2129] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:53.086335 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8350a-fad9-44f1-bfe1-6a03b71df72b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.099617 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8350a-fad9-44f1-bfe1-6a03b71df72b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.104490 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af288a-c470-4fae-bfbc-bf13f20e28f2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.104678 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1027960-b536-4f3a-8223-99b7921f613c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.105582 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1027960-b536-4f3a-8223-99b7921f613c admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.105865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1027960-b536-4f3a-8223-99b7921f613c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.106136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1027960-b536-4f3a-8223-99b7921f613c admin admin] PATH_INFO: `/v3/projects/55e5aadb2de64fe7980551ac2baa4023/users/dba7c8f023cb4b22857db1d127f92f42/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.109393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57701f84-c687-4a49-9ad2-e3b095f9958e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.110094 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57701f84-c687-4a49-9ad2-e3b095f9958e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.110399 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57701f84-c687-4a49-9ad2-e3b095f9958e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.110696 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57701f84-c687-4a49-9ad2-e3b095f9958e admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.111384 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57701f84-c687-4a49-9ad2-e3b095f9958e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.113368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57701f84-c687-4a49-9ad2-e3b095f9958e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.123738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1027960-b536-4f3a-8223-99b7921f613c admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e5aadb2de64fe7980551ac2baa4023, user_id=dba7c8f023cb4b22857db1d127f92f42, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.127560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1027960-b536-4f3a-8223-99b7921f613c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.136772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1068/2130] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:53 2022] POST /identity/v3/users => generated 299 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:53.137705 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57701f84-c687-4a49-9ad2-e3b095f9958e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.147176 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1063/2131] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:53 2022] PUT /identity/v3/projects/55e5aadb2de64fe7980551ac2baa4023/users/dba7c8f023cb4b22857db1d127f92f42/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:53.147868 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57701f84-c687-4a49-9ad2-e3b095f9958e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.147992 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1027960-b536-4f3a-8223-99b7921f613c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.156428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:53.180784 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:53.218267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47100c0a-c3cc-4f7d-84fb-4326d9ad540d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.218949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47100c0a-c3cc-4f7d-84fb-4326d9ad540d admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.219230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47100c0a-c3cc-4f7d-84fb-4326d9ad540d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.219506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47100c0a-c3cc-4f7d-84fb-4326d9ad540d admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.220274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47100c0a-c3cc-4f7d-84fb-4326d9ad540d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.220796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1027960-b536-4f3a-8223-99b7921f613c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.221903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47100c0a-c3cc-4f7d-84fb-4326d9ad540d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.226316 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f53e4-eede-41c6-aede-50cdf6a5eeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.226985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f53e4-eede-41c6-aede-50cdf6a5eeef admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.227302 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f53e4-eede-41c6-aede-50cdf6a5eeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.227547 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f53e4-eede-41c6-aede-50cdf6a5eeef admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.228315 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f53e4-eede-41c6-aede-50cdf6a5eeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.229930 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f53e4-eede-41c6-aede-50cdf6a5eeef admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.235631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1069/2132] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:53.235631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8b1e6-65c4-4ce0-b6f3-1a311395e9e5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.235631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8b1e6-65c4-4ce0-b6f3-1a311395e9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.235631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8b1e6-65c4-4ce0-b6f3-1a311395e9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.250905 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1064/2133] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:53.250905 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f53e4-eede-41c6-aede-50cdf6a5eeef admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.263632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f53e4-eede-41c6-aede-50cdf6a5eeef admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.270022 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b92919-efda-45e5-b940-b02f310e92bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.270878 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b7d8b1e6-65c4-4ce0-b6f3-1a311395e9e5 None None] MFA Rules not processed for user `dba7c8f023cb4b22857db1d127f92f42`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:53.271430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b92919-efda-45e5-b940-b02f310e92bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.271698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b92919-efda-45e5-b940-b02f310e92bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.272001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b92919-efda-45e5-b940-b02f310e92bb admin admin] PATH_INFO: `/v3/projects/a98de32cb0504577be36b37a01fdd0c0/users/0fdd3d5682c94bb2a9e2f05475a3ad54/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.272194 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b7d8b1e6-65c4-4ce0-b6f3-1a311395e9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:53.298073 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b92919-efda-45e5-b940-b02f310e92bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98de32cb0504577be36b37a01fdd0c0, user_id=0fdd3d5682c94bb2a9e2f05475a3ad54, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.301841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b92919-efda-45e5-b940-b02f310e92bb admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.318944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1065/2134] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:53 2022] PUT /identity/v3/projects/a98de32cb0504577be36b37a01fdd0c0/users/0fdd3d5682c94bb2a9e2f05475a3ad54/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:53.320094 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b92919-efda-45e5-b940-b02f310e92bb admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.363496 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1070/2135] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:53.365014 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb227fb6-3770-49a2-a461-9d6739b39c71 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.365295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb227fb6-3770-49a2-a461-9d6739b39c71 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.365565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb227fb6-3770-49a2-a461-9d6739b39c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.397972 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fb227fb6-3770-49a2-a461-9d6739b39c71 None None] MFA Rules not processed for user `0fdd3d5682c94bb2a9e2f05475a3ad54`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:53.399449 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fb227fb6-3770-49a2-a461-9d6739b39c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:53.410966 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b92919-efda-45e5-b940-b02f310e92bb admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.419209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d587a9-8e41-4703-896a-135485086f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.420641 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d587a9-8e41-4703-896a-135485086f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.420931 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d587a9-8e41-4703-896a-135485086f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.421209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d587a9-8e41-4703-896a-135485086f68 admin admin] PATH_INFO: `/v3/projects/d9175f3d4a1747d69000636e80e2605c/users/d3d10874110d40c0b65cc867f6c97613/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.438983 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d587a9-8e41-4703-896a-135485086f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9175f3d4a1747d69000636e80e2605c, user_id=d3d10874110d40c0b65cc867f6c97613, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.442911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d587a9-8e41-4703-896a-135485086f68 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.459808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1066/2136] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:53 2022] PUT /identity/v3/projects/d9175f3d4a1747d69000636e80e2605c/users/d3d10874110d40c0b65cc867f6c97613/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:53.460923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d587a9-8e41-4703-896a-135485086f68 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.476062 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1071/2137] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:53.476983 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb227fb6-3770-49a2-a461-9d6739b39c71 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.478437 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fb227fb6-3770-49a2-a461-9d6739b39c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:53.495818 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb227fb6-3770-49a2-a461-9d6739b39c71 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.517675 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:53.530668 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d587a9-8e41-4703-896a-135485086f68 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.536616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df24290-6330-4c48-bedf-6044b6ac0824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.536616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df24290-6330-4c48-bedf-6044b6ac0824 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.537117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df24290-6330-4c48-bedf-6044b6ac0824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.537422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df24290-6330-4c48-bedf-6044b6ac0824 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.538164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df24290-6330-4c48-bedf-6044b6ac0824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.540160 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df24290-6330-4c48-bedf-6044b6ac0824 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.561034 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7bf4e-7ce7-4021-80c7-c81cd8e801b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.561935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7bf4e-7ce7-4021-80c7-c81cd8e801b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.562222 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7bf4e-7ce7-4021-80c7-c81cd8e801b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.562494 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7bf4e-7ce7-4021-80c7-c81cd8e801b6 admin admin] PATH_INFO: `/v3/users/c15f076376d149b2a0fb3bb9b9061374` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.563766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7bf4e-7ce7-4021-80c7-c81cd8e801b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c15f076376d149b2a0fb3bb9b9061374)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.565796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7bf4e-7ce7-4021-80c7-c81cd8e801b6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.568353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1067/2138] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:53 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:53.572758 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df24290-6330-4c48-bedf-6044b6ac0824 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.579538 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:53.629787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-08f7bf4e-7ce7-4021-80c7-c81cd8e801b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c15f076376d149b2a0fb3bb9b9061374'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:53.631167 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-08f7bf4e-7ce7-4021-80c7-c81cd8e801b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c15f076376d149b2a0fb3bb9b9061374'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:53.631806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-08f7bf4e-7ce7-4021-80c7-c81cd8e801b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c15f076376d149b2a0fb3bb9b9061374'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:53.649999 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-08f7bf4e-7ce7-4021-80c7-c81cd8e801b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c15f076376d149b2a0fb3bb9b9061374'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:53.657877 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df24290-6330-4c48-bedf-6044b6ac0824 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.659848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-08f7bf4e-7ce7-4021-80c7-c81cd8e801b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c15f076376d149b2a0fb3bb9b9061374'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:53.665552 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c5455-9b12-430c-a04d-582c77c468ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.666496 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c5455-9b12-430c-a04d-582c77c468ab admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.666837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c5455-9b12-430c-a04d-582c77c468ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.667321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c5455-9b12-430c-a04d-582c77c468ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.668456 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c5455-9b12-430c-a04d-582c77c468ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.671121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c5455-9b12-430c-a04d-582c77c468ab admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.685140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1072/2139] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:53 2022] DELETE /identity/v3/users/c15f076376d149b2a0fb3bb9b9061374 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:53.686165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7bf4e-7ce7-4021-80c7-c81cd8e801b6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.686434 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1068/2140] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:53.687362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c5455-9b12-430c-a04d-582c77c468ab admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.689587 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5f4c5455-9b12-430c-a04d-582c77c468ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:53.691557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-08f7bf4e-7ce7-4021-80c7-c81cd8e801b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:53.705074 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c5455-9b12-430c-a04d-582c77c468ab admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.774637 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce07d4a-9b88-4839-814e-2db3ec39463b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.776076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce07d4a-9b88-4839-814e-2db3ec39463b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.776364 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce07d4a-9b88-4839-814e-2db3ec39463b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.776643 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce07d4a-9b88-4839-814e-2db3ec39463b admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.777341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce07d4a-9b88-4839-814e-2db3ec39463b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.779301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce07d4a-9b88-4839-814e-2db3ec39463b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.785668 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7bf4e-7ce7-4021-80c7-c81cd8e801b6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.790356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400d12e-c5cf-4bb7-8c23-73dade22a001 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.791153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400d12e-c5cf-4bb7-8c23-73dade22a001 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.791542 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400d12e-c5cf-4bb7-8c23-73dade22a001 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.791813 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400d12e-c5cf-4bb7-8c23-73dade22a001 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.795782 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9400d12e-c5cf-4bb7-8c23-73dade22a001 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:53.805935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1069/2141] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:53 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:53.807148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088a833-f185-4756-9897-44ca8f617251 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.807443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088a833-f185-4756-9897-44ca8f617251 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.807730 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088a833-f185-4756-9897-44ca8f617251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.828574 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-4088a833-f185-4756-9897-44ca8f617251 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:53.829827 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4088a833-f185-4756-9897-44ca8f617251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:53.838174 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1070/2142] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:53.838975 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088a833-f185-4756-9897-44ca8f617251 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.849134 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4088a833-f185-4756-9897-44ca8f617251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:53.857478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:53.860339 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400d12e-c5cf-4bb7-8c23-73dade22a001 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.862506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400d12e-c5cf-4bb7-8c23-73dade22a001 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.865770 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088a833-f185-4756-9897-44ca8f617251 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.871694 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c5e8a-0986-4e0f-8dc9-fac2b0a70d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.872722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c5e8a-0986-4e0f-8dc9-fac2b0a70d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.873186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c5e8a-0986-4e0f-8dc9-fac2b0a70d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.873461 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c5e8a-0986-4e0f-8dc9-fac2b0a70d55 admin admin] PATH_INFO: `/v3/projects/d9175f3d4a1747d69000636e80e2605c/users/d3d10874110d40c0b65cc867f6c97613/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.874918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1073/2143] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:53.875832 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400d12e-c5cf-4bb7-8c23-73dade22a001 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.882688 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c5e8a-0986-4e0f-8dc9-fac2b0a70d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9175f3d4a1747d69000636e80e2605c, user_id=d3d10874110d40c0b65cc867f6c97613, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.887362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c5e8a-0986-4e0f-8dc9-fac2b0a70d55 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.893121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400d12e-c5cf-4bb7-8c23-73dade22a001 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:53.900170 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9a419-c1b9-4cf0-a574-764e269307c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:53.900838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9a419-c1b9-4cf0-a574-764e269307c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.901128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9a419-c1b9-4cf0-a574-764e269307c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.901539 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9a419-c1b9-4cf0-a574-764e269307c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.902314 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9a419-c1b9-4cf0-a574-764e269307c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:53.914415 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1071/2144] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:53 2022] PUT /identity/v3/projects/d9175f3d4a1747d69000636e80e2605c/users/d3d10874110d40c0b65cc867f6c97613/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:53.914659 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9a419-c1b9-4cf0-a574-764e269307c8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:53.914767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c5e8a-0986-4e0f-8dc9-fac2b0a70d55 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:53.914767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c74c5e8a-0986-4e0f-8dc9-fac2b0a70d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:53.922054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1074/2145] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:53.923830 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6c133-dd5f-4078-a064-175d0f424a60 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:53.924278 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6c133-dd5f-4078-a064-175d0f424a60 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:53.924590 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6c133-dd5f-4078-a064-175d0f424a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:53.958163 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-dae6c133-dd5f-4078-a064-175d0f424a60 None None] MFA Rules not processed for user `d3d10874110d40c0b65cc867f6c97613`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:53.959598 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dae6c133-dd5f-4078-a064-175d0f424a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:53.998120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c5e8a-0986-4e0f-8dc9-fac2b0a70d55 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:54.010517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6daec-fca3-4335-a657-21f5fe0e3e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:54.011197 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6daec-fca3-4335-a657-21f5fe0e3e4b service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:54.011511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6daec-fca3-4335-a657-21f5fe0e3e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:54.011788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6daec-fca3-4335-a657-21f5fe0e3e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:54.055494 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:54.083153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1075/2146] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:54.083153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6c133-dd5f-4078-a064-175d0f424a60 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:54.116595 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6daec-fca3-4335-a657-21f5fe0e3e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:54.118094 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6daec-fca3-4335-a657-21f5fe0e3e4b service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:54.135129 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1072/2147] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:54.136581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6daec-fca3-4335-a657-21f5fe0e3e4b service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:54.215978 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6c133-dd5f-4078-a064-175d0f424a60 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:54.223415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c967f8a-1dfb-42c2-87d4-608c56d04e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:54.224590 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c967f8a-1dfb-42c2-87d4-608c56d04e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:54.225445 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c967f8a-1dfb-42c2-87d4-608c56d04e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:54.225724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c967f8a-1dfb-42c2-87d4-608c56d04e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:54.226788 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c967f8a-1dfb-42c2-87d4-608c56d04e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:54.229603 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c967f8a-1dfb-42c2-87d4-608c56d04e30 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:54.245313 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6daec-fca3-4335-a657-21f5fe0e3e4b service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:54.249474 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2247775-c725-4689-9447-3ab1dbbdcbcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:54.253265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1076/2148] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:54.253381 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2247775-c725-4689-9447-3ab1dbbdcbcd service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:54.253381 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2247775-c725-4689-9447-3ab1dbbdcbcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:54.253381 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2247775-c725-4689-9447-3ab1dbbdcbcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:54.257610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c967f8a-1dfb-42c2-87d4-608c56d04e30 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:54.267131 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a2247775-c725-4689-9447-3ab1dbbdcbcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:54.276204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c967f8a-1dfb-42c2-87d4-608c56d04e30 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:54.283025 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a7749-2a5c-40af-a285-fbc5d6d1215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:54.283990 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a7749-2a5c-40af-a285-fbc5d6d1215a admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:54.284299 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a7749-2a5c-40af-a285-fbc5d6d1215a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:54.284648 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a7749-2a5c-40af-a285-fbc5d6d1215a admin admin] PATH_INFO: `/v3/projects/d303ec3efc3d411f9817934ce9d40d7e/users/eac378107c7d4e44ae763bbac43a1195/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:54.325748 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a7749-2a5c-40af-a285-fbc5d6d1215a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d303ec3efc3d411f9817934ce9d40d7e, user_id=eac378107c7d4e44ae763bbac43a1195, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:54.330246 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a7749-2a5c-40af-a285-fbc5d6d1215a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:54.355110 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1077/2149] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:54 2022] PUT /identity/v3/projects/d303ec3efc3d411f9817934ce9d40d7e/users/eac378107c7d4e44ae763bbac43a1195/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:54.368866 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25025bac-ee9b-491d-b8b3-ecf3744d0d75 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:54.369376 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25025bac-ee9b-491d-b8b3-ecf3744d0d75 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:54.369704 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25025bac-ee9b-491d-b8b3-ecf3744d0d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:54.399708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2247775-c725-4689-9447-3ab1dbbdcbcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:54.401702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2247775-c725-4689-9447-3ab1dbbdcbcd service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:54.418643 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-25025bac-ee9b-491d-b8b3-ecf3744d0d75 None None] MFA Rules not processed for user `eac378107c7d4e44ae763bbac43a1195`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:54.420133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-25025bac-ee9b-491d-b8b3-ecf3744d0d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:54.425909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1073/2150] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:54.466523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:54.576135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1078/2151] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:54.580744 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2247775-c725-4689-9447-3ab1dbbdcbcd service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:54.594519 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2247775-c725-4689-9447-3ab1dbbdcbcd service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:54.687870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b257ed-77e6-4b6c-97e7-d5a15b15f0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:54.688867 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b257ed-77e6-4b6c-97e7-d5a15b15f0a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:54.689403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b257ed-77e6-4b6c-97e7-d5a15b15f0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:54.689975 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b257ed-77e6-4b6c-97e7-d5a15b15f0a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:54.690530 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b257ed-77e6-4b6c-97e7-d5a15b15f0a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:54.692546 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b257ed-77e6-4b6c-97e7-d5a15b15f0a7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:54.707866 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25025bac-ee9b-491d-b8b3-ecf3744d0d75 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:54.709934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-25025bac-ee9b-491d-b8b3-ecf3744d0d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:54.718977 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:54.729593 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1074/2152] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:54 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:35:54.733342 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b257ed-77e6-4b6c-97e7-d5a15b15f0a7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:54.747813 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25025bac-ee9b-491d-b8b3-ecf3744d0d75 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:54.819355 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b257ed-77e6-4b6c-97e7-d5a15b15f0a7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:54.825047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c66e1-346a-4705-84db-0e0d7b6d0289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:54.825902 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c66e1-346a-4705-84db-0e0d7b6d0289 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:54.826191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c66e1-346a-4705-84db-0e0d7b6d0289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:54.826468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c66e1-346a-4705-84db-0e0d7b6d0289 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:54.827177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c66e1-346a-4705-84db-0e0d7b6d0289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:54.829234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c66e1-346a-4705-84db-0e0d7b6d0289 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:54.857947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ffe2c-6633-4ed3-bfc8-00f96a2a3ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:54.858908 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ffe2c-6633-4ed3-bfc8-00f96a2a3ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:54.859190 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ffe2c-6633-4ed3-bfc8-00f96a2a3ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:54.859657 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ffe2c-6633-4ed3-bfc8-00f96a2a3ae8 admin admin] PATH_INFO: `/v3/projects/c8757862df174d08a1fe3722a20f19c3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:54.861055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ffe2c-6633-4ed3-bfc8-00f96a2a3ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8757862df174d08a1fe3722a20f19c3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:54.865654 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ffe2c-6633-4ed3-bfc8-00f96a2a3ae8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:54.867924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1075/2153] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:54 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:35:54.872623 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c66e1-346a-4705-84db-0e0d7b6d0289 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:54.889795 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c66e1-346a-4705-84db-0e0d7b6d0289 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:54.895163 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc1357-847f-4eb8-a1c8-f7872bd28e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:54.896194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc1357-847f-4eb8-a1c8-f7872bd28e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:54.896517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc1357-847f-4eb8-a1c8-f7872bd28e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:54.896795 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc1357-847f-4eb8-a1c8-f7872bd28e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:54.897544 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc1357-847f-4eb8-a1c8-f7872bd28e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:54.900323 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc1357-847f-4eb8-a1c8-f7872bd28e0d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:54.917238 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1076/2154] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:54.918671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc1357-847f-4eb8-a1c8-f7872bd28e0d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:54.934977 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc1357-847f-4eb8-a1c8-f7872bd28e0d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:54.956888 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d5ffe2c-6633-4ed3-bfc8-00f96a2a3ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8757862df174d08a1fe3722a20f19c3', 'request_id': 'req-6d5ffe2c-6633-4ed3-bfc8-00f96a2a3ae8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:54.968847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d5ffe2c-6633-4ed3-bfc8-00f96a2a3ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8757862df174d08a1fe3722a20f19c3', 'request_id': 'req-6d5ffe2c-6633-4ed3-bfc8-00f96a2a3ae8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:54.978081 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d5ffe2c-6633-4ed3-bfc8-00f96a2a3ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8757862df174d08a1fe3722a20f19c3', 'request_id': 'req-6d5ffe2c-6633-4ed3-bfc8-00f96a2a3ae8'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:54.994045 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d5ffe2c-6633-4ed3-bfc8-00f96a2a3ae8 admin admin] The token cache is being invalidate because project c8757862df174d08a1fe3722a20f19c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:54.994341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d5ffe2c-6633-4ed3-bfc8-00f96a2a3ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:54.995791 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d5ffe2c-6633-4ed3-bfc8-00f96a2a3ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:54.997445 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1079/2155] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:54 2022] DELETE /identity/v3/projects/c8757862df174d08a1fe3722a20f19c3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:55.001394 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ffe2c-6633-4ed3-bfc8-00f96a2a3ae8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:55.002843 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6d5ffe2c-6633-4ed3-bfc8-00f96a2a3ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:55.024559 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a5b52-c619-40ed-ae09-4c48854f9fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:55.025734 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a5b52-c619-40ed-ae09-4c48854f9fca admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:55.026034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a5b52-c619-40ed-ae09-4c48854f9fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:55.026414 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a5b52-c619-40ed-ae09-4c48854f9fca admin admin] PATH_INFO: `/v3/projects/dc16cb0884a34753946ebefae5567c6b/users/51cf94431e8d40b7805b0e96621472af/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:55.044932 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a5b52-c619-40ed-ae09-4c48854f9fca admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc16cb0884a34753946ebefae5567c6b, user_id=51cf94431e8d40b7805b0e96621472af, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:55.047869 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a5b52-c619-40ed-ae09-4c48854f9fca admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:55.063230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1077/2156] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:54 2022] PUT /identity/v3/projects/dc16cb0884a34753946ebefae5567c6b/users/51cf94431e8d40b7805b0e96621472af/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:55.067694 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a5b52-c619-40ed-ae09-4c48854f9fca admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:55.069513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b00a5b52-c619-40ed-ae09-4c48854f9fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:55.082540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ffe2c-6633-4ed3-bfc8-00f96a2a3ae8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:55.087799 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:55.156613 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a5b52-c619-40ed-ae09-4c48854f9fca admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:55.158048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b7d7f-f862-45ae-aaee-42e3ef37b622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:55.159628 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b7d7f-f862-45ae-aaee-42e3ef37b622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:55.160158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b7d7f-f862-45ae-aaee-42e3ef37b622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:55.160652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b7d7f-f862-45ae-aaee-42e3ef37b622 admin admin] PATH_INFO: `/v3/users/bf25acfefc4c408da0e9d5d0cfebf002` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:55.161927 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974c866-4bcf-4c32-94c6-712ac1ed65fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:55.162612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974c866-4bcf-4c32-94c6-712ac1ed65fe admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:55.162898 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974c866-4bcf-4c32-94c6-712ac1ed65fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:55.163172 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974c866-4bcf-4c32-94c6-712ac1ed65fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:55.163598 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b7d7f-f862-45ae-aaee-42e3ef37b622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf25acfefc4c408da0e9d5d0cfebf002)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:55.163935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974c866-4bcf-4c32-94c6-712ac1ed65fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:55.165610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974c866-4bcf-4c32-94c6-712ac1ed65fe admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:55.166629 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b7d7f-f862-45ae-aaee-42e3ef37b622 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:55.168238 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:55.177465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1078/2157] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:35:55.184192 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974c866-4bcf-4c32-94c6-712ac1ed65fe admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:55.197769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974c866-4bcf-4c32-94c6-712ac1ed65fe admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:55.204689 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d8d4b-ef6d-4ae2-afc7-02d4db972c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:55.205947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d8d4b-ef6d-4ae2-afc7-02d4db972c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:55.206232 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d8d4b-ef6d-4ae2-afc7-02d4db972c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:55.206541 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d8d4b-ef6d-4ae2-afc7-02d4db972c9c admin admin] PATH_INFO: `/v3/projects/dc16cb0884a34753946ebefae5567c6b/users/51cf94431e8d40b7805b0e96621472af/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:55.209900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d8d4b-ef6d-4ae2-afc7-02d4db972c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc16cb0884a34753946ebefae5567c6b, user_id=51cf94431e8d40b7805b0e96621472af, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:55.213550 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d8d4b-ef6d-4ae2-afc7-02d4db972c9c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:55.225916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1079/2158] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:55 2022] PUT /identity/v3/projects/dc16cb0884a34753946ebefae5567c6b/users/51cf94431e8d40b7805b0e96621472af/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:55.228153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fa6b7d7f-f862-45ae-aaee-42e3ef37b622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf25acfefc4c408da0e9d5d0cfebf002'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:55.229045 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fa6b7d7f-f862-45ae-aaee-42e3ef37b622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf25acfefc4c408da0e9d5d0cfebf002'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:55.229681 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fa6b7d7f-f862-45ae-aaee-42e3ef37b622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf25acfefc4c408da0e9d5d0cfebf002'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:55.237851 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4821770-c281-4724-b3fa-dad8173bd44a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:55.238137 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4821770-c281-4724-b3fa-dad8173bd44a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:55.238436 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4821770-c281-4724-b3fa-dad8173bd44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:55.249957 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fa6b7d7f-f862-45ae-aaee-42e3ef37b622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf25acfefc4c408da0e9d5d0cfebf002'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:55.258847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fa6b7d7f-f862-45ae-aaee-42e3ef37b622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf25acfefc4c408da0e9d5d0cfebf002'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:55.273604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d4821770-c281-4724-b3fa-dad8173bd44a None None] MFA Rules not processed for user `51cf94431e8d40b7805b0e96621472af`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:55.274849 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d4821770-c281-4724-b3fa-dad8173bd44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:55.276402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1080/2159] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:55 2022] DELETE /identity/v3/users/bf25acfefc4c408da0e9d5d0cfebf002 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:55.366287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1080/2160] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:55.379338 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b7d7f-f862-45ae-aaee-42e3ef37b622 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:55.382056 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fa6b7d7f-f862-45ae-aaee-42e3ef37b622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:55.454710 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b7d7f-f862-45ae-aaee-42e3ef37b622 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:55.459423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ff887-ea18-4a53-91f9-be17d76f5c73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:55.460172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ff887-ea18-4a53-91f9-be17d76f5c73 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:55.460457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ff887-ea18-4a53-91f9-be17d76f5c73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:55.460855 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ff887-ea18-4a53-91f9-be17d76f5c73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:55.478379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ff887-ea18-4a53-91f9-be17d76f5c73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:55.479885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0ff887-ea18-4a53-91f9-be17d76f5c73 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:55.492953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1081/2161] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:55.548955 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4821770-c281-4724-b3fa-dad8173bd44a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:55.550570 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d4821770-c281-4724-b3fa-dad8173bd44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:55.568891 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4821770-c281-4724-b3fa-dad8173bd44a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:55.575036 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480207d-7d63-4444-83ef-71f99fdf5dc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:55.576145 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480207d-7d63-4444-83ef-71f99fdf5dc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:55.576599 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480207d-7d63-4444-83ef-71f99fdf5dc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:55.576844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480207d-7d63-4444-83ef-71f99fdf5dc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:55.579540 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9480207d-7d63-4444-83ef-71f99fdf5dc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:55.617092 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ff887-ea18-4a53-91f9-be17d76f5c73 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:55.618602 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9d0ff887-ea18-4a53-91f9-be17d76f5c73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:55.668903 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480207d-7d63-4444-83ef-71f99fdf5dc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:55.672147 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480207d-7d63-4444-83ef-71f99fdf5dc3 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:55.679806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:55.686661 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1081/2162] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:55.748654 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ff887-ea18-4a53-91f9-be17d76f5c73 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:55.760034 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f458a-1626-45a4-adb6-3623b9bff799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:55.765838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f458a-1626-45a4-adb6-3623b9bff799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:55.767144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f458a-1626-45a4-adb6-3623b9bff799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:55.767144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f458a-1626-45a4-adb6-3623b9bff799 admin admin] PATH_INFO: `/v3/projects/2ea1ffaf3bd24cc39d9fe66d07a779b3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:55.768842 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f458a-1626-45a4-adb6-3623b9bff799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea1ffaf3bd24cc39d9fe66d07a779b3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:55.770894 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f458a-1626-45a4-adb6-3623b9bff799 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:55.835125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6a3f458a-1626-45a4-adb6-3623b9bff799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea1ffaf3bd24cc39d9fe66d07a779b3', 'request_id': 'req-6a3f458a-1626-45a4-adb6-3623b9bff799'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:55.849269 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6a3f458a-1626-45a4-adb6-3623b9bff799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea1ffaf3bd24cc39d9fe66d07a779b3', 'request_id': 'req-6a3f458a-1626-45a4-adb6-3623b9bff799'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:55.860840 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6a3f458a-1626-45a4-adb6-3623b9bff799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea1ffaf3bd24cc39d9fe66d07a779b3', 'request_id': 'req-6a3f458a-1626-45a4-adb6-3623b9bff799'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:55.875117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6a3f458a-1626-45a4-adb6-3623b9bff799 admin admin] The token cache is being invalidate because project 2ea1ffaf3bd24cc39d9fe66d07a779b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:55.875669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6a3f458a-1626-45a4-adb6-3623b9bff799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:55.876684 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6a3f458a-1626-45a4-adb6-3623b9bff799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:55.879202 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1082/2163] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:55 2022] DELETE /identity/v3/projects/2ea1ffaf3bd24cc39d9fe66d07a779b3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:55.884795 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4d4f0-2c08-48a9-98ec-3788bc7a0362 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:55.885092 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4d4f0-2c08-48a9-98ec-3788bc7a0362 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:55.885375 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f4d4f0-2c08-48a9-98ec-3788bc7a0362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:55.909902 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f7f4d4f0-2c08-48a9-98ec-3788bc7a0362 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:55.911744 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f7f4d4f0-2c08-48a9-98ec-3788bc7a0362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:55.995250 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1082/2164] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:56.004638 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7142d-19be-4e53-a525-12405456060b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:56.005194 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7142d-19be-4e53-a525-12405456060b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:56.005288 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7142d-19be-4e53-a525-12405456060b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:56.027685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-53c7142d-19be-4e53-a525-12405456060b None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:56.029686 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-53c7142d-19be-4e53-a525-12405456060b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:56.048057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1083/2165] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:56.050898 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4d4f0-2c08-48a9-98ec-3788bc7a0362 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:56.073810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f4d4f0-2c08-48a9-98ec-3788bc7a0362 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:56.080322 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a9676-eedc-4f2d-bbe9-c6a15f0a9124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:56.081010 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a9676-eedc-4f2d-bbe9-c6a15f0a9124 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:56.081362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a9676-eedc-4f2d-bbe9-c6a15f0a9124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:56.081640 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a9676-eedc-4f2d-bbe9-c6a15f0a9124 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:56.082442 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a9676-eedc-4f2d-bbe9-c6a15f0a9124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:56.083002 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a9676-eedc-4f2d-bbe9-c6a15f0a9124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:56.084858 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a9676-eedc-4f2d-bbe9-c6a15f0a9124 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:56.088325 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:56.107608 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1083/2166] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:35:56.112345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7142d-19be-4e53-a525-12405456060b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:56.123149 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7142d-19be-4e53-a525-12405456060b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:56.129284 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbad785-ed8b-4f69-adcb-6eb54959b7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:56.130878 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbad785-ed8b-4f69-adcb-6eb54959b7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:56.131300 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbad785-ed8b-4f69-adcb-6eb54959b7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:56.131667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbad785-ed8b-4f69-adcb-6eb54959b7f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:56.132964 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbad785-ed8b-4f69-adcb-6eb54959b7f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:56.135712 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbad785-ed8b-4f69-adcb-6eb54959b7f0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:56.193542 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1084/2167] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:56 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:56.201747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a9676-eedc-4f2d-bbe9-c6a15f0a9124 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:56.218016 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a9676-eedc-4f2d-bbe9-c6a15f0a9124 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:56.334969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd93ca7-e7db-436b-bd48-73b86b2691eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:56.336876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd93ca7-e7db-436b-bd48-73b86b2691eb admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:56.337394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd93ca7-e7db-436b-bd48-73b86b2691eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:56.337818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd93ca7-e7db-436b-bd48-73b86b2691eb admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:56.338687 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd93ca7-e7db-436b-bd48-73b86b2691eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:56.346869 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd93ca7-e7db-436b-bd48-73b86b2691eb admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:56.389048 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1084/2168] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:56 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:35:56.389322 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbad785-ed8b-4f69-adcb-6eb54959b7f0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:56.401638 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbad785-ed8b-4f69-adcb-6eb54959b7f0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:56.408767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb9c0b-f7c1-41c3-83a5-c19f7c674a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:56.409474 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb9c0b-f7c1-41c3-83a5-c19f7c674a0e admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:56.409759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb9c0b-f7c1-41c3-83a5-c19f7c674a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:56.410032 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb9c0b-f7c1-41c3-83a5-c19f7c674a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:56.410863 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb9c0b-f7c1-41c3-83a5-c19f7c674a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:56.412689 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb9c0b-f7c1-41c3-83a5-c19f7c674a0e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:56.424028 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1085/2169] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:56.428255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd93ca7-e7db-436b-bd48-73b86b2691eb admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:56.439577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd93ca7-e7db-436b-bd48-73b86b2691eb admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:56.442620 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb9c0b-f7c1-41c3-83a5-c19f7c674a0e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:56.444480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e6cb9c0b-f7c1-41c3-83a5-c19f7c674a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:56.447092 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdba16-d829-44e0-a6bf-97018e4b4f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:56.447784 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdba16-d829-44e0-a6bf-97018e4b4f3e admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:56.448104 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdba16-d829-44e0-a6bf-97018e4b4f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:56.448388 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdba16-d829-44e0-a6bf-97018e4b4f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:56.449464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cdba16-d829-44e0-a6bf-97018e4b4f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:56.451170 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cdba16-d829-44e0-a6bf-97018e4b4f3e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:56.467619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1085/2170] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:56.468516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdba16-d829-44e0-a6bf-97018e4b4f3e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:56.478739 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cdba16-d829-44e0-a6bf-97018e4b4f3e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:56.485890 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58637de-4d64-432d-aa61-377d98f0f27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:56.486475 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58637de-4d64-432d-aa61-377d98f0f27b admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:56.486822 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58637de-4d64-432d-aa61-377d98f0f27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:56.487160 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58637de-4d64-432d-aa61-377d98f0f27b admin admin] PATH_INFO: `/v3/projects/1a8a2f4ff7b14afeb3435eb24f7e4f64/users/cd57f1ccb23140d7acdb6c582ee9e7a1/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:56.510405 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb9c0b-f7c1-41c3-83a5-c19f7c674a0e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:56.514640 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58637de-4d64-432d-aa61-377d98f0f27b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8a2f4ff7b14afeb3435eb24f7e4f64, user_id=cd57f1ccb23140d7acdb6c582ee9e7a1, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:56.515802 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5a6d8-7f90-4b80-acec-bcc39b07f59d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:56.516511 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5a6d8-7f90-4b80-acec-bcc39b07f59d service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:56.516800 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5a6d8-7f90-4b80-acec-bcc39b07f59d service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:56.517515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58637de-4d64-432d-aa61-377d98f0f27b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:56.517707 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5a6d8-7f90-4b80-acec-bcc39b07f59d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:56.522242 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c2e5a6d8-7f90-4b80-acec-bcc39b07f59d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:56.533201 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1086/2171] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:56 2022] PUT /identity/v3/projects/1a8a2f4ff7b14afeb3435eb24f7e4f64/users/cd57f1ccb23140d7acdb6c582ee9e7a1/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:56.555428 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d34be7-2618-4a83-81cc-ca865c4b78c8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:56.555718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d34be7-2618-4a83-81cc-ca865c4b78c8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:56.555996 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d34be7-2618-4a83-81cc-ca865c4b78c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:56.588688 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:56.590966 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c2d34be7-2618-4a83-81cc-ca865c4b78c8 None None] MFA Rules not processed for user `cd57f1ccb23140d7acdb6c582ee9e7a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:56.592607 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c2d34be7-2618-4a83-81cc-ca865c4b78c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:56.626867 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5a6d8-7f90-4b80-acec-bcc39b07f59d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:56.628812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5a6d8-7f90-4b80-acec-bcc39b07f59d service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:56.639975 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1086/2172] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:35:56.669705 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1087/2173] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:56.681420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5a6d8-7f90-4b80-acec-bcc39b07f59d service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:56.683568 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c2e5a6d8-7f90-4b80-acec-bcc39b07f59d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:56.699491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5a6d8-7f90-4b80-acec-bcc39b07f59d service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:56.763124 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c674c8-0778-4226-91aa-3455056161c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:56.763883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c674c8-0778-4226-91aa-3455056161c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:56.764195 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c674c8-0778-4226-91aa-3455056161c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:56.764529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c674c8-0778-4226-91aa-3455056161c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:56.775437 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c674c8-0778-4226-91aa-3455056161c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:56.777125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c674c8-0778-4226-91aa-3455056161c0 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:56.796154 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1087/2174] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:56.834322 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d34be7-2618-4a83-81cc-ca865c4b78c8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:56.927568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:56.965771 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d34be7-2618-4a83-81cc-ca865c4b78c8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:56.981568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17630dfa-5d1a-443f-822f-cc723092ef9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:56.983952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17630dfa-5d1a-443f-822f-cc723092ef9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:56.985181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17630dfa-5d1a-443f-822f-cc723092ef9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:56.987050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17630dfa-5d1a-443f-822f-cc723092ef9c admin admin] PATH_INFO: `/v3/users/cd57f1ccb23140d7acdb6c582ee9e7a1` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:56.996636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17630dfa-5d1a-443f-822f-cc723092ef9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd57f1ccb23140d7acdb6c582ee9e7a1)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:57.008889 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17630dfa-5d1a-443f-822f-cc723092ef9c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:57.090291 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-17630dfa-5d1a-443f-822f-cc723092ef9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd57f1ccb23140d7acdb6c582ee9e7a1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:57.105514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-17630dfa-5d1a-443f-822f-cc723092ef9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd57f1ccb23140d7acdb6c582ee9e7a1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:57.134290 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-17630dfa-5d1a-443f-822f-cc723092ef9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd57f1ccb23140d7acdb6c582ee9e7a1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:57.147970 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-17630dfa-5d1a-443f-822f-cc723092ef9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd57f1ccb23140d7acdb6c582ee9e7a1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:57.148925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-17630dfa-5d1a-443f-822f-cc723092ef9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd57f1ccb23140d7acdb6c582ee9e7a1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:57.156133 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1088/2175] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:56 2022] DELETE /identity/v3/users/cd57f1ccb23140d7acdb6c582ee9e7a1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:57.161992 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d44674-6fd8-424a-98c0-6a2a797d0bd7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:57.163544 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d44674-6fd8-424a-98c0-6a2a797d0bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:57.164452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d44674-6fd8-424a-98c0-6a2a797d0bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:57.186944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d1d44674-6fd8-424a-98c0-6a2a797d0bd7 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:57.188369 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d1d44674-6fd8-424a-98c0-6a2a797d0bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:57.279787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1088/2176] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:57.290001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17630dfa-5d1a-443f-822f-cc723092ef9c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:57.292339 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-17630dfa-5d1a-443f-822f-cc723092ef9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:57.401519 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17630dfa-5d1a-443f-822f-cc723092ef9c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:57.406324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f6d65-96ea-4216-b51b-6275da59f190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:57.406566 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f6d65-96ea-4216-b51b-6275da59f190 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:57.406945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f6d65-96ea-4216-b51b-6275da59f190 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:57.407288 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f6d65-96ea-4216-b51b-6275da59f190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:57.417832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f6d65-96ea-4216-b51b-6275da59f190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:57.419377 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f6d65-96ea-4216-b51b-6275da59f190 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:57.431886 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1089/2177] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:57.619346 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d44674-6fd8-424a-98c0-6a2a797d0bd7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:57.623379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d1d44674-6fd8-424a-98c0-6a2a797d0bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:57.725193 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d44674-6fd8-424a-98c0-6a2a797d0bd7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:57.730150 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c2034-bb56-4550-80c5-c08f5d0af332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:57.730884 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c2034-bb56-4550-80c5-c08f5d0af332 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:57.731200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c2034-bb56-4550-80c5-c08f5d0af332 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:57.731839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c2034-bb56-4550-80c5-c08f5d0af332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:57.733843 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-688c2034-bb56-4550-80c5-c08f5d0af332 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:57.789357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:57.838893 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c2034-bb56-4550-80c5-c08f5d0af332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:57.840513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c2034-bb56-4550-80c5-c08f5d0af332 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:57.855609 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1089/2178] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:35:58.038785 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f6d65-96ea-4216-b51b-6275da59f190 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:58.041197 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-378f6d65-96ea-4216-b51b-6275da59f190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:58.060627 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f6d65-96ea-4216-b51b-6275da59f190 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:58.066803 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a09df-b267-43f3-82f9-6c583599f44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:58.068032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a09df-b267-43f3-82f9-6c583599f44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:58.068334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a09df-b267-43f3-82f9-6c583599f44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:58.068632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a09df-b267-43f3-82f9-6c583599f44c admin admin] PATH_INFO: `/v3/projects/1a8a2f4ff7b14afeb3435eb24f7e4f64` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:58.070192 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a09df-b267-43f3-82f9-6c583599f44c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8a2f4ff7b14afeb3435eb24f7e4f64)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:58.073136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a09df-b267-43f3-82f9-6c583599f44c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:58.145599 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-759a09df-b267-43f3-82f9-6c583599f44c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8a2f4ff7b14afeb3435eb24f7e4f64', 'request_id': 'req-759a09df-b267-43f3-82f9-6c583599f44c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:58.155980 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:58.161028 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-759a09df-b267-43f3-82f9-6c583599f44c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8a2f4ff7b14afeb3435eb24f7e4f64', 'request_id': 'req-759a09df-b267-43f3-82f9-6c583599f44c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:58.177284 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-759a09df-b267-43f3-82f9-6c583599f44c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8a2f4ff7b14afeb3435eb24f7e4f64', 'request_id': 'req-759a09df-b267-43f3-82f9-6c583599f44c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:58.192031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-759a09df-b267-43f3-82f9-6c583599f44c admin admin] The token cache is being invalidate because project 1a8a2f4ff7b14afeb3435eb24f7e4f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:35:58.192445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-759a09df-b267-43f3-82f9-6c583599f44c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:58.193460 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-759a09df-b267-43f3-82f9-6c583599f44c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:58.195392 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1090/2179] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:35:58 2022] DELETE /identity/v3/projects/1a8a2f4ff7b14afeb3435eb24f7e4f64 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:58.200741 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb92cef-0f45-4fcc-9f85-a3751a8fbc13 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:58.201264 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb92cef-0f45-4fcc-9f85-a3751a8fbc13 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:58.201496 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb92cef-0f45-4fcc-9f85-a3751a8fbc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:58.225358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-deb92cef-0f45-4fcc-9f85-a3751a8fbc13 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:58.226672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-deb92cef-0f45-4fcc-9f85-a3751a8fbc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:58.307063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a643d09-bb21-45a8-afda-b8238c7f2f57 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:58.307430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a643d09-bb21-45a8-afda-b8238c7f2f57 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:58.307779 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a643d09-bb21-45a8-afda-b8238c7f2f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:58.311435 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1090/2180] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:58.320272 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7f630-a4e9-4fdf-a0bc-e14024cafeae None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:58.320634 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7f630-a4e9-4fdf-a0bc-e14024cafeae None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:58.320997 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7f630-a4e9-4fdf-a0bc-e14024cafeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:58.327487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0a643d09-bb21-45a8-afda-b8238c7f2f57 None None] MFA Rules not processed for user `2ccee0bc7e2b41f4a2fe2a891a95b318`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:58.328747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0a643d09-bb21-45a8-afda-b8238c7f2f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:58.341325 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-38e7f630-a4e9-4fdf-a0bc-e14024cafeae None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:58.343168 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-38e7f630-a4e9-4fdf-a0bc-e14024cafeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:58.351466 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1091/2181] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:58.356238 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7f630-a4e9-4fdf-a0bc-e14024cafeae None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:58.365281 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7f630-a4e9-4fdf-a0bc-e14024cafeae None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:58.369858 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce592a-b2bf-461d-8dcd-bcaeb18928d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:58.370501 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce592a-b2bf-461d-8dcd-bcaeb18928d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:58.370775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce592a-b2bf-461d-8dcd-bcaeb18928d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:58.371095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce592a-b2bf-461d-8dcd-bcaeb18928d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:58.371863 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce592a-b2bf-461d-8dcd-bcaeb18928d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:35:58.372194 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce592a-b2bf-461d-8dcd-bcaeb18928d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:58.373881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce592a-b2bf-461d-8dcd-bcaeb18928d9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:58.385706 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1092/2182] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:35:58.390187 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1091/2183] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 16:35:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:35:58.390333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce592a-b2bf-461d-8dcd-bcaeb18928d9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:58.401262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce592a-b2bf-461d-8dcd-bcaeb18928d9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:58.406050 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3f451-f4e1-4f90-a3f4-15917c18e45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:58.406491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3f451-f4e1-4f90-a3f4-15917c18e45b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:58.406792 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3f451-f4e1-4f90-a3f4-15917c18e45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:58.407103 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3f451-f4e1-4f90-a3f4-15917c18e45b admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:58.407732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3f451-f4e1-4f90-a3f4-15917c18e45b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:58.410613 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3f451-f4e1-4f90-a3f4-15917c18e45b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:58.439142 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a643d09-bb21-45a8-afda-b8238c7f2f57 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:58.440994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1093/2184] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:35:58 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:35:58.441212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0a643d09-bb21-45a8-afda-b8238c7f2f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:58.446122 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3f451-f4e1-4f90-a3f4-15917c18e45b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:58.511260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3f451-f4e1-4f90-a3f4-15917c18e45b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:58.515981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1b850-15af-4cd4-9a0c-fa61e64b41ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:58.516802 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1b850-15af-4cd4-9a0c-fa61e64b41ef admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:58.517088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1b850-15af-4cd4-9a0c-fa61e64b41ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:58.517364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1b850-15af-4cd4-9a0c-fa61e64b41ef admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:58.518086 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1b850-15af-4cd4-9a0c-fa61e64b41ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:58.519723 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a643d09-bb21-45a8-afda-b8238c7f2f57 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:58.520171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1b850-15af-4cd4-9a0c-fa61e64b41ef admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:58.546775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1094/2185] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:35:58 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:35:58.548543 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1b850-15af-4cd4-9a0c-fa61e64b41ef admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:58.570295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1b850-15af-4cd4-9a0c-fa61e64b41ef admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:58.575988 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e9880-85e0-40b4-9ad0-5cb017bb675b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:58.576695 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e9880-85e0-40b4-9ad0-5cb017bb675b admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:58.577071 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e9880-85e0-40b4-9ad0-5cb017bb675b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:58.577237 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e9880-85e0-40b4-9ad0-5cb017bb675b admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:58.577961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e9880-85e0-40b4-9ad0-5cb017bb675b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:58.579609 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e9880-85e0-40b4-9ad0-5cb017bb675b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:58.591000 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1095/2186] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:35:58.595106 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e9880-85e0-40b4-9ad0-5cb017bb675b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:58.596316 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91896bd2-4363-4817-8ae8-f99725dd0e94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbfcca96ad754692b3fb7f891013dafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:58.596980 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91896bd2-4363-4817-8ae8-f99725dd0e94 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:58.597264 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91896bd2-4363-4817-8ae8-f99725dd0e94 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:58.597607 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91896bd2-4363-4817-8ae8-f99725dd0e94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:58.605299 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e9880-85e0-40b4-9ad0-5cb017bb675b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:58.610620 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b4e0d-4c4d-4d15-ab85-4fd4f3b6135c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:58.611299 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b4e0d-4c4d-4d15-ab85-4fd4f3b6135c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:58.611608 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b4e0d-4c4d-4d15-ab85-4fd4f3b6135c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:58.611880 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b4e0d-4c4d-4d15-ab85-4fd4f3b6135c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:58.612708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b4e0d-4c4d-4d15-ab85-4fd4f3b6135c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:58.614677 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b4e0d-4c4d-4d15-ab85-4fd4f3b6135c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:58.616328 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:58.632461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1096/2187] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:35:58.633863 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b4e0d-4c4d-4d15-ab85-4fd4f3b6135c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:58.638011 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:58.644795 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b4e0d-4c4d-4d15-ab85-4fd4f3b6135c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:58.650229 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6fee2-e3e4-4a27-a1e0-77eacaf519b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:58.651179 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6fee2-e3e4-4a27-a1e0-77eacaf519b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:58.651454 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6fee2-e3e4-4a27-a1e0-77eacaf519b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:58.651727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6fee2-e3e4-4a27-a1e0-77eacaf519b5 admin admin] PATH_INFO: `/v3/projects/d890e75dc67f4687b7c4fbec1368eb03/users/6b9ad84784894a339e030d33301ca911/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:58.671545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91896bd2-4363-4817-8ae8-f99725dd0e94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:58.673485 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91896bd2-4363-4817-8ae8-f99725dd0e94 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:58.676548 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6fee2-e3e4-4a27-a1e0-77eacaf519b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d890e75dc67f4687b7c4fbec1368eb03, user_id=6b9ad84784894a339e030d33301ca911, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:58.681662 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6fee2-e3e4-4a27-a1e0-77eacaf519b5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:58.683739 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1092/2188] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 16:35:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 16:35:58.705846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1097/2189] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:35:58 2022] PUT /identity/v3/projects/d890e75dc67f4687b7c4fbec1368eb03/users/6b9ad84784894a339e030d33301ca911/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:35:58.713814 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece692a-1e66-4c5f-ad39-f6573f0e8e20 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:58.714252 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece692a-1e66-4c5f-ad39-f6573f0e8e20 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:58.714913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece692a-1e66-4c5f-ad39-f6573f0e8e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:58.736822 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9ece692a-1e66-4c5f-ad39-f6573f0e8e20 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:58.738215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9ece692a-1e66-4c5f-ad39-f6573f0e8e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:58.853986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1093/2190] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:58.863536 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6fee2-e3e4-4a27-a1e0-77eacaf519b5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:58.865836 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-73f6fee2-e3e4-4a27-a1e0-77eacaf519b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:58.943293 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6fee2-e3e4-4a27-a1e0-77eacaf519b5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:58.943994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502b117-0a1e-4927-8121-ec3b96f6e19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:58.944603 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502b117-0a1e-4927-8121-ec3b96f6e19e service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:58.944891 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502b117-0a1e-4927-8121-ec3b96f6e19e service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:58.945167 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502b117-0a1e-4927-8121-ec3b96f6e19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:58.955584 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502b117-0a1e-4927-8121-ec3b96f6e19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:58.957085 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502b117-0a1e-4927-8121-ec3b96f6e19e service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:58.967777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1098/2191] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:35:59.479314 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103694af-7f69-44c7-899c-c4fe9bc97882 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:59.479845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103694af-7f69-44c7-899c-c4fe9bc97882 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:59.479845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103694af-7f69-44c7-899c-c4fe9bc97882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:59.505262 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-103694af-7f69-44c7-899c-c4fe9bc97882 None None] MFA Rules not processed for user `2ccee0bc7e2b41f4a2fe2a891a95b318`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:59.507253 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-103694af-7f69-44c7-899c-c4fe9bc97882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:59.598842 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1094/2192] 10.222.0.41 () {58 vars in 967 bytes} [Fri May 27 16:35:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:59.604857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502b117-0a1e-4927-8121-ec3b96f6e19e service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:59.606623 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d502b117-0a1e-4927-8121-ec3b96f6e19e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:59.609435 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103694af-7f69-44c7-899c-c4fe9bc97882 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:59.621062 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502b117-0a1e-4927-8121-ec3b96f6e19e service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:59.638658 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa28b1f-ab7d-4453-845a-5b96fc4f9ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:59.640743 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa28b1f-ab7d-4453-845a-5b96fc4f9ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:59.641315 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa28b1f-ab7d-4453-845a-5b96fc4f9ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:59.641524 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa28b1f-ab7d-4453-845a-5b96fc4f9ebd admin admin] PATH_INFO: `/v3/users/dba7c8f023cb4b22857db1d127f92f42` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:59.642984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa28b1f-ab7d-4453-845a-5b96fc4f9ebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=dba7c8f023cb4b22857db1d127f92f42)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:59.645691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa28b1f-ab7d-4453-845a-5b96fc4f9ebd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:59.714393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3aa28b1f-ab7d-4453-845a-5b96fc4f9ebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dba7c8f023cb4b22857db1d127f92f42'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:59.715067 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3aa28b1f-ab7d-4453-845a-5b96fc4f9ebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dba7c8f023cb4b22857db1d127f92f42'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:59.715928 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3aa28b1f-ab7d-4453-845a-5b96fc4f9ebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dba7c8f023cb4b22857db1d127f92f42'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:59.729466 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103694af-7f69-44c7-899c-c4fe9bc97882 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:35:59.736089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ed0e9-0986-4ec9-93e0-8c4fc4655ad6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbfcca96ad754692b3fb7f891013dafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:35:59.738610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ed0e9-0986-4ec9-93e0-8c4fc4655ad6 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:59.739426 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ed0e9-0986-4ec9-93e0-8c4fc4655ad6 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:59.739910 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ed0e9-0986-4ec9-93e0-8c4fc4655ad6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:59.740705 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3aa28b1f-ab7d-4453-845a-5b96fc4f9ebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dba7c8f023cb4b22857db1d127f92f42'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:59.743566 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a08ed0e9-0986-4ec9-93e0-8c4fc4655ad6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:59.750942 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-3aa28b1f-ab7d-4453-845a-5b96fc4f9ebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dba7c8f023cb4b22857db1d127f92f42'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:35:59.763676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ed0e9-0986-4ec9-93e0-8c4fc4655ad6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:35:59.765757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ed0e9-0986-4ec9-93e0-8c4fc4655ad6 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:35:59.777871 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1099/2193] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:35:59 2022] DELETE /identity/v3/users/dba7c8f023cb4b22857db1d127f92f42 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:35:59.780752 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1095/2194] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 16:35:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:35:59.790299 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dc82a-f743-4f9c-9da6-66dfe66a2868 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:59.791073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dc82a-f743-4f9c-9da6-66dfe66a2868 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:59.791489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848dc82a-f743-4f9c-9da6-66dfe66a2868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:59.819009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-848dc82a-f743-4f9c-9da6-66dfe66a2868 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:35:59.821294 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-848dc82a-f743-4f9c-9da6-66dfe66a2868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:59.883367 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:35:59.920051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1100/2195] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:35:59.929944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fb4d8-7f0e-4097-ac9b-e46fd6109850 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:35:59.930686 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fb4d8-7f0e-4097-ac9b-e46fd6109850 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:35:59.930895 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fb4d8-7f0e-4097-ac9b-e46fd6109850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:35:59.934027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848dc82a-f743-4f9c-9da6-66dfe66a2868 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:35:59.935546 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-848dc82a-f743-4f9c-9da6-66dfe66a2868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:35:59.977219 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:00.003519 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-061fb4d8-7f0e-4097-ac9b-e46fd6109850 None None] MFA Rules not processed for user `6b9ad84784894a339e030d33301ca911`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:00.005039 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-061fb4d8-7f0e-4097-ac9b-e46fd6109850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:00.071549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848dc82a-f743-4f9c-9da6-66dfe66a2868 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:00.077901 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97cbe2-0366-4212-acc7-d4cb8d180fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:00.079105 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97cbe2-0366-4212-acc7-d4cb8d180fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:00.079577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97cbe2-0366-4212-acc7-d4cb8d180fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:00.081248 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97cbe2-0366-4212-acc7-d4cb8d180fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:00.097190 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97cbe2-0366-4212-acc7-d4cb8d180fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:00.101287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97cbe2-0366-4212-acc7-d4cb8d180fd7 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:00.132771 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1101/2196] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:35:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:00.227513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1096/2197] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:35:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:00.238890 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97cbe2-0366-4212-acc7-d4cb8d180fd7 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:00.241586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0f97cbe2-0366-4212-acc7-d4cb8d180fd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:00.313517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcd20e-916c-496a-8fac-013c7bda0c20 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:00.313815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcd20e-916c-496a-8fac-013c7bda0c20 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:00.314102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcd20e-916c-496a-8fac-013c7bda0c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:00.338268 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-bbbcd20e-916c-496a-8fac-013c7bda0c20 None None] MFA Rules not processed for user `2ccee0bc7e2b41f4a2fe2a891a95b318`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:00.339115 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97cbe2-0366-4212-acc7-d4cb8d180fd7 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:00.340174 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bbbcd20e-916c-496a-8fac-013c7bda0c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:00.349997 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf242f-476b-4ffa-b2a6-e6cb77964d99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:00.350677 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf242f-476b-4ffa-b2a6-e6cb77964d99 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:00.350974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf242f-476b-4ffa-b2a6-e6cb77964d99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:00.351223 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf242f-476b-4ffa-b2a6-e6cb77964d99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:00.371018 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf242f-476b-4ffa-b2a6-e6cb77964d99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:00.373363 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf242f-476b-4ffa-b2a6-e6cb77964d99 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:00.393515 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1102/2198] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:36:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:00.431463 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1097/2199] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 16:36:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:36:00.445009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf242f-476b-4ffa-b2a6-e6cb77964d99 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:00.446966 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4fdf242f-476b-4ffa-b2a6-e6cb77964d99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:00.558376 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf242f-476b-4ffa-b2a6-e6cb77964d99 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:00.565886 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bb2da-bd86-4121-aad2-dea0798aedd1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbfcca96ad754692b3fb7f891013dafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:00.566825 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bb2da-bd86-4121-aad2-dea0798aedd1 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:00.567287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bb2da-bd86-4121-aad2-dea0798aedd1 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:00.567686 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bb2da-bd86-4121-aad2-dea0798aedd1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:00.577260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcd20e-916c-496a-8fac-013c7bda0c20 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:00.579335 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bbbcd20e-916c-496a-8fac-013c7bda0c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:00.585624 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bb2da-bd86-4121-aad2-dea0798aedd1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:00.587756 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bb2da-bd86-4121-aad2-dea0798aedd1 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:00.602453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1103/2200] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 16:36:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:36:00.604903 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcd20e-916c-496a-8fac-013c7bda0c20 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:00.619477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de7fe6-fd3c-4a9f-9eab-5295b98756f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:00.622306 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de7fe6-fd3c-4a9f-9eab-5295b98756f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:00.622772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de7fe6-fd3c-4a9f-9eab-5295b98756f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:00.623602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de7fe6-fd3c-4a9f-9eab-5295b98756f6 admin admin] PATH_INFO: `/v3/projects/55e5aadb2de64fe7980551ac2baa4023` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:00.625214 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de7fe6-fd3c-4a9f-9eab-5295b98756f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55e5aadb2de64fe7980551ac2baa4023)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:00.628283 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de7fe6-fd3c-4a9f-9eab-5295b98756f6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:00.727737 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d7de7fe6-fd3c-4a9f-9eab-5295b98756f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55e5aadb2de64fe7980551ac2baa4023', 'request_id': 'req-d7de7fe6-fd3c-4a9f-9eab-5295b98756f6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:00.735965 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d7de7fe6-fd3c-4a9f-9eab-5295b98756f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55e5aadb2de64fe7980551ac2baa4023', 'request_id': 'req-d7de7fe6-fd3c-4a9f-9eab-5295b98756f6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:00.750033 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d7de7fe6-fd3c-4a9f-9eab-5295b98756f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55e5aadb2de64fe7980551ac2baa4023', 'request_id': 'req-d7de7fe6-fd3c-4a9f-9eab-5295b98756f6'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:00.772069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d7de7fe6-fd3c-4a9f-9eab-5295b98756f6 admin admin] The token cache is being invalidate because project 55e5aadb2de64fe7980551ac2baa4023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:00.772521 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d7de7fe6-fd3c-4a9f-9eab-5295b98756f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:00.773365 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-d7de7fe6-fd3c-4a9f-9eab-5295b98756f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:00.775998 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1098/2201] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:36:00 2022] DELETE /identity/v3/projects/55e5aadb2de64fe7980551ac2baa4023 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:00.781036 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bb2da-bd86-4121-aad2-dea0798aedd1 service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:00.800466 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bb2da-bd86-4121-aad2-dea0798aedd1 service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:00.860848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:00.954112 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76949b2-21b0-4e3d-b983-12d8ece6be0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:00.954112 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76949b2-21b0-4e3d-b983-12d8ece6be0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:00.954112 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76949b2-21b0-4e3d-b983-12d8ece6be0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:00.954112 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76949b2-21b0-4e3d-b983-12d8ece6be0f admin admin] PATH_INFO: `/v3/users/eac378107c7d4e44ae763bbac43a1195` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:00.955807 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76949b2-21b0-4e3d-b983-12d8ece6be0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eac378107c7d4e44ae763bbac43a1195)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:00.958139 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76949b2-21b0-4e3d-b983-12d8ece6be0f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:01.053215 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b76949b2-21b0-4e3d-b983-12d8ece6be0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eac378107c7d4e44ae763bbac43a1195'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:01.054658 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b76949b2-21b0-4e3d-b983-12d8ece6be0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eac378107c7d4e44ae763bbac43a1195'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:01.056076 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b76949b2-21b0-4e3d-b983-12d8ece6be0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eac378107c7d4e44ae763bbac43a1195'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:01.081427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b76949b2-21b0-4e3d-b983-12d8ece6be0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eac378107c7d4e44ae763bbac43a1195'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:01.090961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b76949b2-21b0-4e3d-b983-12d8ece6be0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eac378107c7d4e44ae763bbac43a1195'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:01.115857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1104/2202] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:36:00 2022] DELETE /identity/v3/users/eac378107c7d4e44ae763bbac43a1195 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:01.189222 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e3186-afc3-49eb-ae09-34fe60da9446 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:01.189642 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e3186-afc3-49eb-ae09-34fe60da9446 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:01.190058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e3186-afc3-49eb-ae09-34fe60da9446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:01.221997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9e6e3186-afc3-49eb-ae09-34fe60da9446 None None] MFA Rules not processed for user `2ccee0bc7e2b41f4a2fe2a891a95b318`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:01.228485 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9e6e3186-afc3-49eb-ae09-34fe60da9446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:01.280616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:01.404633 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1099/2203] 10.222.0.41 () {58 vars in 967 bytes} [Fri May 27 16:36:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:01.419684 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76949b2-21b0-4e3d-b983-12d8ece6be0f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:01.422350 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b76949b2-21b0-4e3d-b983-12d8ece6be0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:01.529942 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76949b2-21b0-4e3d-b983-12d8ece6be0f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:01.537568 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f8521-26de-4ea9-98b6-e9aa75f2a09e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbfcca96ad754692b3fb7f891013dafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:01.538747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f8521-26de-4ea9-98b6-e9aa75f2a09e service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:01.546428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f8521-26de-4ea9-98b6-e9aa75f2a09e service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:01.546648 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f8521-26de-4ea9-98b6-e9aa75f2a09e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:01.558824 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f8521-26de-4ea9-98b6-e9aa75f2a09e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:01.560796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f8521-26de-4ea9-98b6-e9aa75f2a09e service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:01.572823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1105/2204] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 16:36:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:36:01.776850 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e3186-afc3-49eb-ae09-34fe60da9446 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:01.780059 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9e6e3186-afc3-49eb-ae09-34fe60da9446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:01.891480 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e3186-afc3-49eb-ae09-34fe60da9446 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:01.904630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff822583-c4d0-4d64-9ab6-e3d35807ae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:01.905534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff822583-c4d0-4d64-9ab6-e3d35807ae00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:01.905835 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff822583-c4d0-4d64-9ab6-e3d35807ae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:01.906108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff822583-c4d0-4d64-9ab6-e3d35807ae00 admin admin] PATH_INFO: `/v3/projects/d303ec3efc3d411f9817934ce9d40d7e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:01.907766 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff822583-c4d0-4d64-9ab6-e3d35807ae00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d303ec3efc3d411f9817934ce9d40d7e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:01.909751 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff822583-c4d0-4d64-9ab6-e3d35807ae00 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:02.011963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ff822583-c4d0-4d64-9ab6-e3d35807ae00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd303ec3efc3d411f9817934ce9d40d7e', 'request_id': 'req-ff822583-c4d0-4d64-9ab6-e3d35807ae00'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:02.018774 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ff822583-c4d0-4d64-9ab6-e3d35807ae00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd303ec3efc3d411f9817934ce9d40d7e', 'request_id': 'req-ff822583-c4d0-4d64-9ab6-e3d35807ae00'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:02.039721 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993e3c2-6cd1-4aa0-89fa-658712a1a7d8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:02.040361 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993e3c2-6cd1-4aa0-89fa-658712a1a7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:02.040561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993e3c2-6cd1-4aa0-89fa-658712a1a7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:02.041797 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ff822583-c4d0-4d64-9ab6-e3d35807ae00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd303ec3efc3d411f9817934ce9d40d7e', 'request_id': 'req-ff822583-c4d0-4d64-9ab6-e3d35807ae00'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:02.064138 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ff822583-c4d0-4d64-9ab6-e3d35807ae00 admin admin] The token cache is being invalidate because project d303ec3efc3d411f9817934ce9d40d7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:02.064445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ff822583-c4d0-4d64-9ab6-e3d35807ae00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:02.068293 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ff822583-c4d0-4d64-9ab6-e3d35807ae00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:02.069375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6993e3c2-6cd1-4aa0-89fa-658712a1a7d8 None None] MFA Rules not processed for user `6b9ad84784894a339e030d33301ca911`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:02.071178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6993e3c2-6cd1-4aa0-89fa-658712a1a7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:02.072957 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1100/2205] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:36:01 2022] DELETE /identity/v3/projects/d303ec3efc3d411f9817934ce9d40d7e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:02.077376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff822583-c4d0-4d64-9ab6-e3d35807ae00 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:02.079638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ff822583-c4d0-4d64-9ab6-e3d35807ae00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:02.110194 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:02.156112 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1106/2206] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:02.163521 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff822583-c4d0-4d64-9ab6-e3d35807ae00 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:02.168697 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52193f02-475c-4f3b-8639-efc21c9b48e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:02.169619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52193f02-475c-4f3b-8639-efc21c9b48e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:02.170043 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52193f02-475c-4f3b-8639-efc21c9b48e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:02.170325 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52193f02-475c-4f3b-8639-efc21c9b48e4 admin admin] PATH_INFO: `/v3/users/51cf94431e8d40b7805b0e96621472af` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:02.171695 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52193f02-475c-4f3b-8639-efc21c9b48e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51cf94431e8d40b7805b0e96621472af)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:02.173921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52193f02-475c-4f3b-8639-efc21c9b48e4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:02.177732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:02.243990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-52193f02-475c-4f3b-8639-efc21c9b48e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51cf94431e8d40b7805b0e96621472af'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:02.270136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-52193f02-475c-4f3b-8639-efc21c9b48e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51cf94431e8d40b7805b0e96621472af'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:02.296197 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-52193f02-475c-4f3b-8639-efc21c9b48e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51cf94431e8d40b7805b0e96621472af'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:02.315118 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-52193f02-475c-4f3b-8639-efc21c9b48e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51cf94431e8d40b7805b0e96621472af'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:02.317577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-52193f02-475c-4f3b-8639-efc21c9b48e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51cf94431e8d40b7805b0e96621472af'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:02.337104 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1101/2207] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:36:02 2022] DELETE /identity/v3/users/51cf94431e8d40b7805b0e96621472af => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:02.718927 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993e3c2-6cd1-4aa0-89fa-658712a1a7d8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:02.780926 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52193f02-475c-4f3b-8639-efc21c9b48e4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:02.782641 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-52193f02-475c-4f3b-8639-efc21c9b48e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:02.828567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993e3c2-6cd1-4aa0-89fa-658712a1a7d8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:03.022477 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2c7e8-a2f5-4772-9fac-8270abab0cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:03.027163 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2c7e8-a2f5-4772-9fac-8270abab0cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.027903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2c7e8-a2f5-4772-9fac-8270abab0cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.030291 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2c7e8-a2f5-4772-9fac-8270abab0cba admin admin] PATH_INFO: `/v3/projects/dc16cb0884a34753946ebefae5567c6b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.040501 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2c7e8-a2f5-4772-9fac-8270abab0cba admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc16cb0884a34753946ebefae5567c6b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:03.054294 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2c7e8-a2f5-4772-9fac-8270abab0cba admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:03.147605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52193f02-475c-4f3b-8639-efc21c9b48e4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:03.162632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b6520-cc8f-493b-a1f3-aadc00126812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:03.169191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b6520-cc8f-493b-a1f3-aadc00126812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.169551 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b6520-cc8f-493b-a1f3-aadc00126812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.169931 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b6520-cc8f-493b-a1f3-aadc00126812 admin admin] PATH_INFO: `/v3/users/79d3c93ed2064c6080971f0678d56519` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.171600 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b6520-cc8f-493b-a1f3-aadc00126812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d3c93ed2064c6080971f0678d56519)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:03.181149 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b6520-cc8f-493b-a1f3-aadc00126812 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:03.201764 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c4e2c7e8-a2f5-4772-9fac-8270abab0cba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc16cb0884a34753946ebefae5567c6b', 'request_id': 'req-c4e2c7e8-a2f5-4772-9fac-8270abab0cba'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:03.223869 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:03.226461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c4e2c7e8-a2f5-4772-9fac-8270abab0cba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc16cb0884a34753946ebefae5567c6b', 'request_id': 'req-c4e2c7e8-a2f5-4772-9fac-8270abab0cba'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:03.244980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c4e2c7e8-a2f5-4772-9fac-8270abab0cba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc16cb0884a34753946ebefae5567c6b', 'request_id': 'req-c4e2c7e8-a2f5-4772-9fac-8270abab0cba'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:03.265888 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c4e2c7e8-a2f5-4772-9fac-8270abab0cba admin admin] The token cache is being invalidate because project dc16cb0884a34753946ebefae5567c6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:03.266293 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c4e2c7e8-a2f5-4772-9fac-8270abab0cba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:03.267011 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c4e2c7e8-a2f5-4772-9fac-8270abab0cba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:03.273338 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1107/2208] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:36:02 2022] DELETE /identity/v3/projects/dc16cb0884a34753946ebefae5567c6b => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:03.280526 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9869b8-0d55-4a50-857d-d760c575e8a1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.280811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9869b8-0d55-4a50-857d-d760c575e8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.281087 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9869b8-0d55-4a50-857d-d760c575e8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.291080 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-208b6520-cc8f-493b-a1f3-aadc00126812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d3c93ed2064c6080971f0678d56519'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:03.305668 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-208b6520-cc8f-493b-a1f3-aadc00126812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d3c93ed2064c6080971f0678d56519'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:03.337967 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-208b6520-cc8f-493b-a1f3-aadc00126812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d3c93ed2064c6080971f0678d56519'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:03.355073 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-208b6520-cc8f-493b-a1f3-aadc00126812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d3c93ed2064c6080971f0678d56519'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:03.357407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-208b6520-cc8f-493b-a1f3-aadc00126812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d3c93ed2064c6080971f0678d56519'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:03.362587 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:03.368998 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1102/2209] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:36:02 2022] DELETE /identity/v3/users/79d3c93ed2064c6080971f0678d56519 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:36:03.373356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0f802-d407-47ae-9da1-379817fa17a6 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.373718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0f802-d407-47ae-9da1-379817fa17a6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.374108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0f802-d407-47ae-9da1-379817fa17a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.391142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-de9869b8-0d55-4a50-857d-d760c575e8a1 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:03.392431 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-de9869b8-0d55-4a50-857d-d760c575e8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:03.402641 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-54b0f802-d407-47ae-9da1-379817fa17a6 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:03.404413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-54b0f802-d407-47ae-9da1-379817fa17a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:03.494634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1103/2210] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:03.505828 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0f802-d407-47ae-9da1-379817fa17a6 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:03.507725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-54b0f802-d407-47ae-9da1-379817fa17a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:03.507898 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1108/2211] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:03.518815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eab798-693e-44d3-96ce-bf634e42f1a8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.519177 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eab798-693e-44d3-96ce-bf634e42f1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.519337 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eab798-693e-44d3-96ce-bf634e42f1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.550018 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a2eab798-693e-44d3-96ce-bf634e42f1a8 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:03.551362 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a2eab798-693e-44d3-96ce-bf634e42f1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:03.561402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1109/2212] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:03.565852 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eab798-693e-44d3-96ce-bf634e42f1a8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:03.576674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eab798-693e-44d3-96ce-bf634e42f1a8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:03.581587 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f898ceb-e037-41dc-b1b3-bfbf508fad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:03.582310 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f898ceb-e037-41dc-b1b3-bfbf508fad68 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.582610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f898ceb-e037-41dc-b1b3-bfbf508fad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.583076 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f898ceb-e037-41dc-b1b3-bfbf508fad68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.584203 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f898ceb-e037-41dc-b1b3-bfbf508fad68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:36:03.584538 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f898ceb-e037-41dc-b1b3-bfbf508fad68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:03.586249 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f898ceb-e037-41dc-b1b3-bfbf508fad68 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:03.600842 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1110/2213] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:36:03.605498 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f898ceb-e037-41dc-b1b3-bfbf508fad68 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:03.619506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f898ceb-e037-41dc-b1b3-bfbf508fad68 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:03.625074 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fffbee-bf18-4820-a42c-8e2d7f930919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:03.625802 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fffbee-bf18-4820-a42c-8e2d7f930919 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.626099 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fffbee-bf18-4820-a42c-8e2d7f930919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.626644 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fffbee-bf18-4820-a42c-8e2d7f930919 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.627484 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fffbee-bf18-4820-a42c-8e2d7f930919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:03.629870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fffbee-bf18-4820-a42c-8e2d7f930919 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:03.644399 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0f802-d407-47ae-9da1-379817fa17a6 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:03.649231 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f7d7c-b8f8-4a6e-8fda-6fc300a5d6ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:03.649607 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f7d7c-b8f8-4a6e-8fda-6fc300a5d6ea service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.649886 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f7d7c-b8f8-4a6e-8fda-6fc300a5d6ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.650159 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f7d7c-b8f8-4a6e-8fda-6fc300a5d6ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.661034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f7d7c-b8f8-4a6e-8fda-6fc300a5d6ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:03.662496 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f7d7c-b8f8-4a6e-8fda-6fc300a5d6ea service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:03.664046 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1111/2214] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:36:03 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:36:03.667072 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fffbee-bf18-4820-a42c-8e2d7f930919 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:03.673626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1104/2215] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:36:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:36:03.738136 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fffbee-bf18-4820-a42c-8e2d7f930919 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:03.743862 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d85d90-b73f-47d1-9b49-508c0308f8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:03.744602 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d85d90-b73f-47d1-9b49-508c0308f8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.744939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d85d90-b73f-47d1-9b49-508c0308f8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.745232 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d85d90-b73f-47d1-9b49-508c0308f8a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.745963 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d85d90-b73f-47d1-9b49-508c0308f8a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:03.747941 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d85d90-b73f-47d1-9b49-508c0308f8a5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:03.771118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1112/2216] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:36:03 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:36:03.774415 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f7d7c-b8f8-4a6e-8fda-6fc300a5d6ea service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:03.784888 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f7d7c-b8f8-4a6e-8fda-6fc300a5d6ea service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:03.790732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897f363-376d-4566-b6ca-0e58277b7086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:03.791424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897f363-376d-4566-b6ca-0e58277b7086 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.791708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897f363-376d-4566-b6ca-0e58277b7086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.792221 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897f363-376d-4566-b6ca-0e58277b7086 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.792967 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897f363-376d-4566-b6ca-0e58277b7086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:03.794597 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897f363-376d-4566-b6ca-0e58277b7086 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:03.796228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:03.810074 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1105/2217] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:03.814404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d85d90-b73f-47d1-9b49-508c0308f8a5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:03.841045 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d85d90-b73f-47d1-9b49-508c0308f8a5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:03.846143 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e741b9-1913-457d-ac42-c9cd718370a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:03.846825 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e741b9-1913-457d-ac42-c9cd718370a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.847157 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e741b9-1913-457d-ac42-c9cd718370a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.847436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e741b9-1913-457d-ac42-c9cd718370a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.848257 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e741b9-1913-457d-ac42-c9cd718370a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:03.850433 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e741b9-1913-457d-ac42-c9cd718370a9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:03.864449 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1113/2218] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:36:03.865696 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897f363-376d-4566-b6ca-0e58277b7086 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:03.876728 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897f363-376d-4566-b6ca-0e58277b7086 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:03.883025 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c67c7c-0d9e-4aa4-951c-a72b94091bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:03.884630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c67c7c-0d9e-4aa4-951c-a72b94091bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.884919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c67c7c-0d9e-4aa4-951c-a72b94091bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.885201 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c67c7c-0d9e-4aa4-951c-a72b94091bf0 admin admin] PATH_INFO: `/v3/projects/32b40f3e3e3342ce8aabf23a3ae2ef77/users/8416fb1794034470ba10496439c7f416/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.905416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c67c7c-0d9e-4aa4-951c-a72b94091bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b40f3e3e3342ce8aabf23a3ae2ef77, user_id=8416fb1794034470ba10496439c7f416, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:03.908488 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c67c7c-0d9e-4aa4-951c-a72b94091bf0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:03.927327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1106/2219] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:36:03 2022] PUT /identity/v3/projects/32b40f3e3e3342ce8aabf23a3ae2ef77/users/8416fb1794034470ba10496439c7f416/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:03.940032 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d44dc-58fe-40f7-9c52-2039742ccc6c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:03.940369 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d44dc-58fe-40f7-9c52-2039742ccc6c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:03.940612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d44dc-58fe-40f7-9c52-2039742ccc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:03.957059 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c67c7c-0d9e-4aa4-951c-a72b94091bf0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:03.960659 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d1c67c7c-0d9e-4aa4-951c-a72b94091bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:03.975320 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-012d44dc-58fe-40f7-9c52-2039742ccc6c None None] MFA Rules not processed for user `8416fb1794034470ba10496439c7f416`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:03.978557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-012d44dc-58fe-40f7-9c52-2039742ccc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:04.016746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:04.047714 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c67c7c-0d9e-4aa4-951c-a72b94091bf0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:04.053145 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af4ef0-4823-42ef-85a4-7be7f7f92b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:04.054040 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af4ef0-4823-42ef-85a4-7be7f7f92b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:04.054344 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af4ef0-4823-42ef-85a4-7be7f7f92b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:04.054619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af4ef0-4823-42ef-85a4-7be7f7f92b14 admin admin] PATH_INFO: `/v3/projects/cc6f4fea32a44d859ebe2678c23d3121` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:04.055844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af4ef0-4823-42ef-85a4-7be7f7f92b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc6f4fea32a44d859ebe2678c23d3121)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:04.059031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af4ef0-4823-42ef-85a4-7be7f7f92b14 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:04.059226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1114/2220] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:04.071397 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d44dc-58fe-40f7-9c52-2039742ccc6c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:04.072961 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-012d44dc-58fe-40f7-9c52-2039742ccc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:04.125604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-22af4ef0-4823-42ef-85a4-7be7f7f92b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc6f4fea32a44d859ebe2678c23d3121', 'request_id': 'req-22af4ef0-4823-42ef-85a4-7be7f7f92b14'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.133395 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-22af4ef0-4823-42ef-85a4-7be7f7f92b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc6f4fea32a44d859ebe2678c23d3121', 'request_id': 'req-22af4ef0-4823-42ef-85a4-7be7f7f92b14'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.144053 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-22af4ef0-4823-42ef-85a4-7be7f7f92b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc6f4fea32a44d859ebe2678c23d3121', 'request_id': 'req-22af4ef0-4823-42ef-85a4-7be7f7f92b14'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.157947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d44dc-58fe-40f7-9c52-2039742ccc6c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:04.168554 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-22af4ef0-4823-42ef-85a4-7be7f7f92b14 admin admin] The token cache is being invalidate because project cc6f4fea32a44d859ebe2678c23d3121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:04.168927 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-22af4ef0-4823-42ef-85a4-7be7f7f92b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.169935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-22af4ef0-4823-42ef-85a4-7be7f7f92b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.175142 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1107/2221] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:36:03 2022] DELETE /identity/v3/projects/cc6f4fea32a44d859ebe2678c23d3121 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:04.177778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af4ef0-4823-42ef-85a4-7be7f7f92b14 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:04.179763 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-22af4ef0-4823-42ef-85a4-7be7f7f92b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:04.252816 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad8f8e-eb68-44a5-b661-7003648208e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:04.253582 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad8f8e-eb68-44a5-b661-7003648208e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:04.253868 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad8f8e-eb68-44a5-b661-7003648208e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:04.254414 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad8f8e-eb68-44a5-b661-7003648208e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:04.264932 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-eaad8f8e-eb68-44a5-b661-7003648208e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:04.325949 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af4ef0-4823-42ef-85a4-7be7f7f92b14 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:04.331681 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ef6f9-3553-40f6-88c0-6feb8c4c9a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:04.333079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ef6f9-3553-40f6-88c0-6feb8c4c9a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:04.334000 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ef6f9-3553-40f6-88c0-6feb8c4c9a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:04.334238 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ef6f9-3553-40f6-88c0-6feb8c4c9a4f admin admin] PATH_INFO: `/v3/users/6f49737dacc849c09f2b74eae340ef24` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:04.353810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ef6f9-3553-40f6-88c0-6feb8c4c9a4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f49737dacc849c09f2b74eae340ef24)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:04.353810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ef6f9-3553-40f6-88c0-6feb8c4c9a4f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:04.357429 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:04.372819 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad8f8e-eb68-44a5-b661-7003648208e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:04.374940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad8f8e-eb68-44a5-b661-7003648208e3 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:04.387953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1115/2222] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:36:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:36:04.409707 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad8f8e-eb68-44a5-b661-7003648208e3 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:04.411953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-eaad8f8e-eb68-44a5-b661-7003648208e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:04.430473 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad8f8e-eb68-44a5-b661-7003648208e3 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:04.435283 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef821585-df61-4573-ac75-01bc354cbca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:04.440061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef821585-df61-4573-ac75-01bc354cbca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:04.440061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef821585-df61-4573-ac75-01bc354cbca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:04.440061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef821585-df61-4573-ac75-01bc354cbca6 admin admin] PATH_INFO: `/v3/users/8416fb1794034470ba10496439c7f416` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:04.440061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef821585-df61-4573-ac75-01bc354cbca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8416fb1794034470ba10496439c7f416)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:04.440515 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef821585-df61-4573-ac75-01bc354cbca6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:04.452375 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c40ef6f9-3553-40f6-88c0-6feb8c4c9a4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f49737dacc849c09f2b74eae340ef24'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.466238 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c40ef6f9-3553-40f6-88c0-6feb8c4c9a4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f49737dacc849c09f2b74eae340ef24'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.483801 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c40ef6f9-3553-40f6-88c0-6feb8c4c9a4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f49737dacc849c09f2b74eae340ef24'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.491366 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:04.492771 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c40ef6f9-3553-40f6-88c0-6feb8c4c9a4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f49737dacc849c09f2b74eae340ef24'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.493751 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c40ef6f9-3553-40f6-88c0-6feb8c4c9a4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f49737dacc849c09f2b74eae340ef24'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.500959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1108/2223] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:36:04 2022] DELETE /identity/v3/users/6f49737dacc849c09f2b74eae340ef24 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:04.501633 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ef6f9-3553-40f6-88c0-6feb8c4c9a4f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:04.503002 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c40ef6f9-3553-40f6-88c0-6feb8c4c9a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:04.508805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ef821585-df61-4573-ac75-01bc354cbca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8416fb1794034470ba10496439c7f416'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.509510 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ef821585-df61-4573-ac75-01bc354cbca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8416fb1794034470ba10496439c7f416'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.510141 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ef821585-df61-4573-ac75-01bc354cbca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8416fb1794034470ba10496439c7f416'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.525405 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ef821585-df61-4573-ac75-01bc354cbca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8416fb1794034470ba10496439c7f416'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.537077 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ef821585-df61-4573-ac75-01bc354cbca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8416fb1794034470ba10496439c7f416'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.572220 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1116/2224] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:36:04 2022] DELETE /identity/v3/users/8416fb1794034470ba10496439c7f416 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:04.578428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b9e36-d940-44e5-9951-cd49d1562ed4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:04.579265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b9e36-d940-44e5-9951-cd49d1562ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:04.579725 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b9e36-d940-44e5-9951-cd49d1562ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:04.614012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-154b9e36-d940-44e5-9951-cd49d1562ed4 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:04.615396 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ef6f9-3553-40f6-88c0-6feb8c4c9a4f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:04.616453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-154b9e36-d940-44e5-9951-cd49d1562ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:04.704801 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1117/2225] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:04.708474 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8a8e6-7b87-47d9-a436-5812c320ff41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:04.709418 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8a8e6-7b87-47d9-a436-5812c320ff41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:04.709710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8a8e6-7b87-47d9-a436-5812c320ff41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:04.709985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8a8e6-7b87-47d9-a436-5812c320ff41 admin admin] PATH_INFO: `/v3/users/86f2fc2d9a68415aaf05e76e1f010d2f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:04.711525 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8a8e6-7b87-47d9-a436-5812c320ff41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86f2fc2d9a68415aaf05e76e1f010d2f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:04.713683 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8a8e6-7b87-47d9-a436-5812c320ff41 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:04.717234 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b9e36-d940-44e5-9951-cd49d1562ed4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:04.719477 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-154b9e36-d940-44e5-9951-cd49d1562ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:04.762080 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:04.784156 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c3b8a8e6-7b87-47d9-a436-5812c320ff41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86f2fc2d9a68415aaf05e76e1f010d2f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.801129 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c3b8a8e6-7b87-47d9-a436-5812c320ff41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86f2fc2d9a68415aaf05e76e1f010d2f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.805992 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b9e36-d940-44e5-9951-cd49d1562ed4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:04.811319 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c65ab-eb85-489c-bb78-6f6cd3cd123a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:04.812383 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c65ab-eb85-489c-bb78-6f6cd3cd123a service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:04.812667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c65ab-eb85-489c-bb78-6f6cd3cd123a service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:04.812947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c65ab-eb85-489c-bb78-6f6cd3cd123a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:04.818417 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c3b8a8e6-7b87-47d9-a436-5812c320ff41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86f2fc2d9a68415aaf05e76e1f010d2f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.825377 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c65ab-eb85-489c-bb78-6f6cd3cd123a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:04.827089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c65ab-eb85-489c-bb78-6f6cd3cd123a service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:04.828254 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c3b8a8e6-7b87-47d9-a436-5812c320ff41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86f2fc2d9a68415aaf05e76e1f010d2f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.829495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c3b8a8e6-7b87-47d9-a436-5812c320ff41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86f2fc2d9a68415aaf05e76e1f010d2f'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:04.838769 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1118/2226] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:04.840340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1109/2227] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:36:04 2022] DELETE /identity/v3/users/86f2fc2d9a68415aaf05e76e1f010d2f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:04.846366 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e811b3-c8fc-4023-b15f-7ad41a78b9c8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:04.846822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e811b3-c8fc-4023-b15f-7ad41a78b9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:04.846967 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e811b3-c8fc-4023-b15f-7ad41a78b9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:04.872122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8a8e6-7b87-47d9-a436-5812c320ff41 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:04.872365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b0e811b3-c8fc-4023-b15f-7ad41a78b9c8 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:04.873613 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b0e811b3-c8fc-4023-b15f-7ad41a78b9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:04.874119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c3b8a8e6-7b87-47d9-a436-5812c320ff41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:05.012324 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:05.031702 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1119/2228] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:05.032410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8a8e6-7b87-47d9-a436-5812c320ff41 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:05.042504 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21d03c-f44b-4047-81a4-c69438e5603d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:05.043884 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21d03c-f44b-4047-81a4-c69438e5603d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:05.044586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e811b3-c8fc-4023-b15f-7ad41a78b9c8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:05.044940 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21d03c-f44b-4047-81a4-c69438e5603d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:05.045234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21d03c-f44b-4047-81a4-c69438e5603d admin admin] PATH_INFO: `/v3/projects/a2854a5e81ab464b9b05ecbef27cc4fa` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:05.046075 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b0e811b3-c8fc-4023-b15f-7ad41a78b9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:05.046759 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21d03c-f44b-4047-81a4-c69438e5603d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2854a5e81ab464b9b05ecbef27cc4fa)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:05.048834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21d03c-f44b-4047-81a4-c69438e5603d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:05.121146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e811b3-c8fc-4023-b15f-7ad41a78b9c8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:05.135087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ec21d03c-f44b-4047-81a4-c69438e5603d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2854a5e81ab464b9b05ecbef27cc4fa', 'request_id': 'req-ec21d03c-f44b-4047-81a4-c69438e5603d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.142112 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ec21d03c-f44b-4047-81a4-c69438e5603d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2854a5e81ab464b9b05ecbef27cc4fa', 'request_id': 'req-ec21d03c-f44b-4047-81a4-c69438e5603d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.154792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ec21d03c-f44b-4047-81a4-c69438e5603d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2854a5e81ab464b9b05ecbef27cc4fa', 'request_id': 'req-ec21d03c-f44b-4047-81a4-c69438e5603d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.173047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ec21d03c-f44b-4047-81a4-c69438e5603d admin admin] The token cache is being invalidate because project a2854a5e81ab464b9b05ecbef27cc4fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:05.173604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ec21d03c-f44b-4047-81a4-c69438e5603d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.174383 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ec21d03c-f44b-4047-81a4-c69438e5603d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.176412 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1110/2229] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:36:04 2022] DELETE /identity/v3/projects/a2854a5e81ab464b9b05ecbef27cc4fa => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:05.180302 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21d03c-f44b-4047-81a4-c69438e5603d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:05.182057 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ec21d03c-f44b-4047-81a4-c69438e5603d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:05.186040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b27617-f60d-42e0-9bcb-62fa3e6d137a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:05.186517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27617-f60d-42e0-9bcb-62fa3e6d137a service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:05.186800 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27617-f60d-42e0-9bcb-62fa3e6d137a service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:05.187196 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b27617-f60d-42e0-9bcb-62fa3e6d137a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:05.189443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-04b27617-f60d-42e0-9bcb-62fa3e6d137a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:05.248550 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:05.278123 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21d03c-f44b-4047-81a4-c69438e5603d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:05.284534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173f2be-9f96-4572-83bb-1cbb21ef45ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:05.285925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173f2be-9f96-4572-83bb-1cbb21ef45ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:05.286278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173f2be-9f96-4572-83bb-1cbb21ef45ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:05.286618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173f2be-9f96-4572-83bb-1cbb21ef45ef admin admin] PATH_INFO: `/v3/users/d3d10874110d40c0b65cc867f6c97613` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:05.288172 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173f2be-9f96-4572-83bb-1cbb21ef45ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d10874110d40c0b65cc867f6c97613)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:05.290610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173f2be-9f96-4572-83bb-1cbb21ef45ef admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:05.309601 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b27617-f60d-42e0-9bcb-62fa3e6d137a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:05.311078 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b27617-f60d-42e0-9bcb-62fa3e6d137a service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:05.322674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1120/2230] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:36:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:36:05.323357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b27617-f60d-42e0-9bcb-62fa3e6d137a service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:05.329183 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-04b27617-f60d-42e0-9bcb-62fa3e6d137a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:05.349246 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b27617-f60d-42e0-9bcb-62fa3e6d137a service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:05.354264 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b181b3-2082-4aa5-82de-1eb9ccbc3f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:05.355344 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b181b3-2082-4aa5-82de-1eb9ccbc3f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:05.355643 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b181b3-2082-4aa5-82de-1eb9ccbc3f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:05.355924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b181b3-2082-4aa5-82de-1eb9ccbc3f97 admin admin] PATH_INFO: `/v3/projects/32b40f3e3e3342ce8aabf23a3ae2ef77` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:05.357463 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b181b3-2082-4aa5-82de-1eb9ccbc3f97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b40f3e3e3342ce8aabf23a3ae2ef77)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:05.359685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b181b3-2082-4aa5-82de-1eb9ccbc3f97 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:05.386259 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f173f2be-9f96-4572-83bb-1cbb21ef45ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d10874110d40c0b65cc867f6c97613'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.404622 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f173f2be-9f96-4572-83bb-1cbb21ef45ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d10874110d40c0b65cc867f6c97613'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.436969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f173f2be-9f96-4572-83bb-1cbb21ef45ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d10874110d40c0b65cc867f6c97613'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.448261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f173f2be-9f96-4572-83bb-1cbb21ef45ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d10874110d40c0b65cc867f6c97613'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.451207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f173f2be-9f96-4572-83bb-1cbb21ef45ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d10874110d40c0b65cc867f6c97613'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.459511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1111/2231] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:36:05 2022] DELETE /identity/v3/users/d3d10874110d40c0b65cc867f6c97613 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:36:05.490602 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e2b181b3-2082-4aa5-82de-1eb9ccbc3f97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b40f3e3e3342ce8aabf23a3ae2ef77', 'request_id': 'req-e2b181b3-2082-4aa5-82de-1eb9ccbc3f97'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.507713 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e2b181b3-2082-4aa5-82de-1eb9ccbc3f97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b40f3e3e3342ce8aabf23a3ae2ef77', 'request_id': 'req-e2b181b3-2082-4aa5-82de-1eb9ccbc3f97'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.527954 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:05.530357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e2b181b3-2082-4aa5-82de-1eb9ccbc3f97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b40f3e3e3342ce8aabf23a3ae2ef77', 'request_id': 'req-e2b181b3-2082-4aa5-82de-1eb9ccbc3f97'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.566757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e2b181b3-2082-4aa5-82de-1eb9ccbc3f97 admin admin] The token cache is being invalidate because project 32b40f3e3e3342ce8aabf23a3ae2ef77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:05.567544 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e2b181b3-2082-4aa5-82de-1eb9ccbc3f97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.568942 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e2b181b3-2082-4aa5-82de-1eb9ccbc3f97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:05.571374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1121/2232] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:36:05 2022] DELETE /identity/v3/projects/32b40f3e3e3342ce8aabf23a3ae2ef77 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:05.578577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856d2b0-ad19-4264-9133-d3ca91e36b73 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:05.580416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856d2b0-ad19-4264-9133-d3ca91e36b73 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:05.583817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856d2b0-ad19-4264-9133-d3ca91e36b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:05.630837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c856d2b0-ad19-4264-9133-d3ca91e36b73 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:05.632684 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c856d2b0-ad19-4264-9133-d3ca91e36b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:05.760417 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1112/2233] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:05.763619 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca74ad-613f-429d-89d9-d4732dd3440c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:05.764113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca74ad-613f-429d-89d9-d4732dd3440c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:05.764575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca74ad-613f-429d-89d9-d4732dd3440c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:05.810232 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-acca74ad-613f-429d-89d9-d4732dd3440c None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:05.813171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-acca74ad-613f-429d-89d9-d4732dd3440c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:05.832906 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1122/2234] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:05.837617 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856d2b0-ad19-4264-9133-d3ca91e36b73 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:05.849286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856d2b0-ad19-4264-9133-d3ca91e36b73 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:05.854902 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357ff59-3671-4039-bed8-3e52b1fc6441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:05.855804 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357ff59-3671-4039-bed8-3e52b1fc6441 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:05.856119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357ff59-3671-4039-bed8-3e52b1fc6441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:05.856417 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357ff59-3671-4039-bed8-3e52b1fc6441 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:05.857265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357ff59-3671-4039-bed8-3e52b1fc6441 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:36:05.857537 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357ff59-3671-4039-bed8-3e52b1fc6441 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:05.859402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357ff59-3671-4039-bed8-3e52b1fc6441 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:05.879852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1113/2235] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:36:05.881574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca74ad-613f-429d-89d9-d4732dd3440c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:05.895496 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca74ad-613f-429d-89d9-d4732dd3440c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:05.903384 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce24e8-e6b2-4368-a6f4-1c8e7b58de9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:05.904120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce24e8-e6b2-4368-a6f4-1c8e7b58de9a admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:05.904380 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce24e8-e6b2-4368-a6f4-1c8e7b58de9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:05.904666 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce24e8-e6b2-4368-a6f4-1c8e7b58de9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:05.906386 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce24e8-e6b2-4368-a6f4-1c8e7b58de9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:05.907402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce24e8-e6b2-4368-a6f4-1c8e7b58de9a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:05.943456 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357ff59-3671-4039-bed8-3e52b1fc6441 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:05.945750 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c357ff59-3671-4039-bed8-3e52b1fc6441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:05.947350 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1123/2236] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:36:05 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:05.951918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce24e8-e6b2-4368-a6f4-1c8e7b58de9a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:05.967188 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357ff59-3671-4039-bed8-3e52b1fc6441 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:06.043588 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:06.093675 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edca616-3fdb-4a78-9ba4-32076f39e4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:06.095552 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edca616-3fdb-4a78-9ba4-32076f39e4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:06.095843 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edca616-3fdb-4a78-9ba4-32076f39e4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:06.096175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edca616-3fdb-4a78-9ba4-32076f39e4ad admin admin] PATH_INFO: `/v3/projects/a64d3b435c714095912938e598662080` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:06.097649 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edca616-3fdb-4a78-9ba4-32076f39e4ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=a64d3b435c714095912938e598662080)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:06.101422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edca616-3fdb-4a78-9ba4-32076f39e4ad admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:06.128864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce24e8-e6b2-4368-a6f4-1c8e7b58de9a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:06.135005 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66068b-e269-4b8b-95a7-8228ad141bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:06.135698 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66068b-e269-4b8b-95a7-8228ad141bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:06.136548 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66068b-e269-4b8b-95a7-8228ad141bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:06.136548 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66068b-e269-4b8b-95a7-8228ad141bf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:06.137069 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66068b-e269-4b8b-95a7-8228ad141bf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:06.139057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66068b-e269-4b8b-95a7-8228ad141bf3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:06.171038 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1124/2237] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:36:05 2022] POST /identity/v3/users => generated 285 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:36:06.171038 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66068b-e269-4b8b-95a7-8228ad141bf3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:06.171038 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7c66068b-e269-4b8b-95a7-8228ad141bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:06.186433 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66068b-e269-4b8b-95a7-8228ad141bf3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:06.189277 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5edca616-3fdb-4a78-9ba4-32076f39e4ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a64d3b435c714095912938e598662080', 'request_id': 'req-5edca616-3fdb-4a78-9ba4-32076f39e4ad'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.199603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5edca616-3fdb-4a78-9ba4-32076f39e4ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a64d3b435c714095912938e598662080', 'request_id': 'req-5edca616-3fdb-4a78-9ba4-32076f39e4ad'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.213221 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5edca616-3fdb-4a78-9ba4-32076f39e4ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a64d3b435c714095912938e598662080', 'request_id': 'req-5edca616-3fdb-4a78-9ba4-32076f39e4ad'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.240378 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5edca616-3fdb-4a78-9ba4-32076f39e4ad admin admin] The token cache is being invalidate because project a64d3b435c714095912938e598662080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:06.240811 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5edca616-3fdb-4a78-9ba4-32076f39e4ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.242277 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-5edca616-3fdb-4a78-9ba4-32076f39e4ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.245329 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1114/2238] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:36:05 2022] DELETE /identity/v3/projects/a64d3b435c714095912938e598662080 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:36:06.247210 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edca616-3fdb-4a78-9ba4-32076f39e4ad admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:06.251554 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5edca616-3fdb-4a78-9ba4-32076f39e4ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:06.293600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8b936-1c2e-4274-8169-4523da260c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:06.294517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8b936-1c2e-4274-8169-4523da260c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:06.294817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8b936-1c2e-4274-8169-4523da260c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:06.295067 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8b936-1c2e-4274-8169-4523da260c5d admin admin] PATH_INFO: `/v3/projects/d9175f3d4a1747d69000636e80e2605c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:06.296406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8b936-1c2e-4274-8169-4523da260c5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9175f3d4a1747d69000636e80e2605c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:06.298579 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8b936-1c2e-4274-8169-4523da260c5d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:06.379640 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edca616-3fdb-4a78-9ba4-32076f39e4ad admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:06.397925 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f5c8b936-1c2e-4274-8169-4523da260c5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9175f3d4a1747d69000636e80e2605c', 'request_id': 'req-f5c8b936-1c2e-4274-8169-4523da260c5d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.401337 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:06.414564 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f5c8b936-1c2e-4274-8169-4523da260c5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9175f3d4a1747d69000636e80e2605c', 'request_id': 'req-f5c8b936-1c2e-4274-8169-4523da260c5d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.434331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f5c8b936-1c2e-4274-8169-4523da260c5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9175f3d4a1747d69000636e80e2605c', 'request_id': 'req-f5c8b936-1c2e-4274-8169-4523da260c5d'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.455441 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f5c8b936-1c2e-4274-8169-4523da260c5d admin admin] The token cache is being invalidate because project d9175f3d4a1747d69000636e80e2605c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:06.455738 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f5c8b936-1c2e-4274-8169-4523da260c5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.457018 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f5c8b936-1c2e-4274-8169-4523da260c5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.459232 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1125/2239] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:36:06 2022] DELETE /identity/v3/projects/d9175f3d4a1747d69000636e80e2605c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:06.460618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db8f0c-eb8d-4653-bf5c-24f1ca5e8651 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:06.460900 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db8f0c-eb8d-4653-bf5c-24f1ca5e8651 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:06.461348 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db8f0c-eb8d-4653-bf5c-24f1ca5e8651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:06.480520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3596d03-e32c-4965-8e50-30d8ff97e13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:06.481886 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3596d03-e32c-4965-8e50-30d8ff97e13b admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:06.482148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3596d03-e32c-4965-8e50-30d8ff97e13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:06.482604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3596d03-e32c-4965-8e50-30d8ff97e13b admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:06.483580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3596d03-e32c-4965-8e50-30d8ff97e13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:06.485704 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3596d03-e32c-4965-8e50-30d8ff97e13b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:06.487785 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-27db8f0c-eb8d-4653-bf5c-24f1ca5e8651 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:06.489473 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-27db8f0c-eb8d-4653-bf5c-24f1ca5e8651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:06.498897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1115/2240] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:06.500191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f31005-3655-4513-8a0b-8a9095e84242 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:06.500453 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f31005-3655-4513-8a0b-8a9095e84242 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:06.501166 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f31005-3655-4513-8a0b-8a9095e84242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:06.503716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1126/2241] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:06.509450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db8f0c-eb8d-4653-bf5c-24f1ca5e8651 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:06.510937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-27db8f0c-eb8d-4653-bf5c-24f1ca5e8651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:06.526306 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db8f0c-eb8d-4653-bf5c-24f1ca5e8651 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:06.544911 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9c3cc-53a7-410e-9a24-901b0d1413e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:06.545674 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9c3cc-53a7-410e-9a24-901b0d1413e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:06.545932 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9c3cc-53a7-410e-9a24-901b0d1413e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:06.546211 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9c3cc-53a7-410e-9a24-901b0d1413e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:06.547001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9c3cc-53a7-410e-9a24-901b0d1413e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:06.548706 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9c3cc-53a7-410e-9a24-901b0d1413e6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:06.578270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-58f31005-3655-4513-8a0b-8a9095e84242 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:06.579584 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-58f31005-3655-4513-8a0b-8a9095e84242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:06.580870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1127/2242] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:06.589446 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38336689-3336-428a-8675-98491bbe7e1d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:06.589874 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38336689-3336-428a-8675-98491bbe7e1d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:06.590244 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38336689-3336-428a-8675-98491bbe7e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:06.605732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1116/2243] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:06.606777 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f31005-3655-4513-8a0b-8a9095e84242 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:06.612249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-58f31005-3655-4513-8a0b-8a9095e84242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:06.618626 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-38336689-3336-428a-8675-98491bbe7e1d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:06.620238 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-38336689-3336-428a-8675-98491bbe7e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:06.631787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1128/2244] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:06.637621 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38336689-3336-428a-8675-98491bbe7e1d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:06.642491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f31005-3655-4513-8a0b-8a9095e84242 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:06.653532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38336689-3336-428a-8675-98491bbe7e1d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:06.654148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcade0-1179-49a0-a0e5-3e39aeae21cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:06.656225 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcade0-1179-49a0-a0e5-3e39aeae21cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:06.657210 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcade0-1179-49a0-a0e5-3e39aeae21cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:06.657921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcade0-1179-49a0-a0e5-3e39aeae21cf admin admin] PATH_INFO: `/v3/users/0fdd3d5682c94bb2a9e2f05475a3ad54` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:06.660218 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcade0-1179-49a0-a0e5-3e39aeae21cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fdd3d5682c94bb2a9e2f05475a3ad54)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:06.661109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac3fdc-fd85-4090-9eda-44b3d6bbec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:06.662020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac3fdc-fd85-4090-9eda-44b3d6bbec8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:06.662301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac3fdc-fd85-4090-9eda-44b3d6bbec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:06.663331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac3fdc-fd85-4090-9eda-44b3d6bbec8a admin admin] PATH_INFO: `/v3/projects/b60b67aa80a2451dadf43fa403548756/users/2e09360902b84fd3a0d9394414c31fd9/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:06.664484 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcade0-1179-49a0-a0e5-3e39aeae21cf admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:06.675302 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:06.696298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac3fdc-fd85-4090-9eda-44b3d6bbec8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60b67aa80a2451dadf43fa403548756, user_id=2e09360902b84fd3a0d9394414c31fd9, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:06.717225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac3fdc-fd85-4090-9eda-44b3d6bbec8a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:06.774269 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1129/2245] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:36:06 2022] PUT /identity/v3/projects/b60b67aa80a2451dadf43fa403548756/users/2e09360902b84fd3a0d9394414c31fd9/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:06.778295 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d87bb-9247-4eb8-aeed-1671455670a6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:06.778927 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d87bb-9247-4eb8-aeed-1671455670a6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:06.779417 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d87bb-9247-4eb8-aeed-1671455670a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:06.821274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-772d87bb-9247-4eb8-aeed-1671455670a6 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:06.823600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-772d87bb-9247-4eb8-aeed-1671455670a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:06.823739 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-17bcade0-1179-49a0-a0e5-3e39aeae21cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fdd3d5682c94bb2a9e2f05475a3ad54'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.841588 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-17bcade0-1179-49a0-a0e5-3e39aeae21cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fdd3d5682c94bb2a9e2f05475a3ad54'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.901972 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-17bcade0-1179-49a0-a0e5-3e39aeae21cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fdd3d5682c94bb2a9e2f05475a3ad54'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.920964 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-17bcade0-1179-49a0-a0e5-3e39aeae21cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fdd3d5682c94bb2a9e2f05475a3ad54'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.922086 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-17bcade0-1179-49a0-a0e5-3e39aeae21cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fdd3d5682c94bb2a9e2f05475a3ad54'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:06.941868 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1117/2246] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:36:06 2022] DELETE /identity/v3/users/0fdd3d5682c94bb2a9e2f05475a3ad54 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:06.943068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcade0-1179-49a0-a0e5-3e39aeae21cf admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:06.951811 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-17bcade0-1179-49a0-a0e5-3e39aeae21cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:06.958534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1130/2247] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:06.967391 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c8285-0c9b-490c-863b-97680fd5fd5e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:06.968319 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c8285-0c9b-490c-863b-97680fd5fd5e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:06.969028 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c8285-0c9b-490c-863b-97680fd5fd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.046913 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ef8c8285-0c9b-490c-863b-97680fd5fd5e None None] MFA Rules not processed for user `2e09360902b84fd3a0d9394414c31fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:07.049930 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ef8c8285-0c9b-490c-863b-97680fd5fd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:07.053802 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcade0-1179-49a0-a0e5-3e39aeae21cf admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:07.059980 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97decbd0-856a-4248-9634-54eb10a11c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:07.061092 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97decbd0-856a-4248-9634-54eb10a11c0e admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.061702 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97decbd0-856a-4248-9634-54eb10a11c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.061984 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97decbd0-856a-4248-9634-54eb10a11c0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.062839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97decbd0-856a-4248-9634-54eb10a11c0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:36:07.063286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97decbd0-856a-4248-9634-54eb10a11c0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:07.065495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97decbd0-856a-4248-9634-54eb10a11c0e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:07.084616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1118/2248] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:36:07.084616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921db31c-96db-46ad-8baa-173b7ac3c429 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.084616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921db31c-96db-46ad-8baa-173b7ac3c429 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.084616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921db31c-96db-46ad-8baa-173b7ac3c429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.103935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-921db31c-96db-46ad-8baa-173b7ac3c429 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:07.105361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-921db31c-96db-46ad-8baa-173b7ac3c429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:07.114952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1119/2249] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:07.115953 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921db31c-96db-46ad-8baa-173b7ac3c429 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:07.128314 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921db31c-96db-46ad-8baa-173b7ac3c429 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:07.137343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20030bee-2922-4aed-8484-ea587f50ccc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:07.138988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20030bee-2922-4aed-8484-ea587f50ccc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.140067 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20030bee-2922-4aed-8484-ea587f50ccc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.140574 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20030bee-2922-4aed-8484-ea587f50ccc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.142395 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20030bee-2922-4aed-8484-ea587f50ccc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:36:07.142940 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20030bee-2922-4aed-8484-ea587f50ccc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:07.143867 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1131/2250] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:07.144668 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c8285-0c9b-490c-863b-97680fd5fd5e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:07.152942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20030bee-2922-4aed-8484-ea587f50ccc3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:07.161588 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c8285-0c9b-490c-863b-97680fd5fd5e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:07.172885 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1120/2251] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:36:07.173225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b085a6-9e7e-4fab-95d3-30dad33ecd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:07.173378 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20030bee-2922-4aed-8484-ea587f50ccc3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:07.173503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b085a6-9e7e-4fab-95d3-30dad33ecd1a admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.173503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b085a6-9e7e-4fab-95d3-30dad33ecd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.173503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b085a6-9e7e-4fab-95d3-30dad33ecd1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.173503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b085a6-9e7e-4fab-95d3-30dad33ecd1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:07.173935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b085a6-9e7e-4fab-95d3-30dad33ecd1a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:07.175134 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-20030bee-2922-4aed-8484-ea587f50ccc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:07.199938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:07.210933 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1132/2252] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:36:07 2022] POST /identity/v3/projects => generated 389 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:07.212615 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b085a6-9e7e-4fab-95d3-30dad33ecd1a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:07.222325 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-39b085a6-9e7e-4fab-95d3-30dad33ecd1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:07.265025 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20030bee-2922-4aed-8484-ea587f50ccc3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:07.279417 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:07.314309 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b085a6-9e7e-4fab-95d3-30dad33ecd1a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:07.320938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3d12e-be81-4183-9de2-bc9ba32a3587 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b72987d279bf4767bad23918fc33302b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:07.321739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3d12e-be81-4183-9de2-bc9ba32a3587 service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.322087 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3d12e-be81-4183-9de2-bc9ba32a3587 service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.322424 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3d12e-be81-4183-9de2-bc9ba32a3587 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.333328 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee724df-ee97-46f6-9e86-cd4df15a9f3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:07.334229 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee724df-ee97-46f6-9e86-cd4df15a9f3f service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.334583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee724df-ee97-46f6-9e86-cd4df15a9f3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.334929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee724df-ee97-46f6-9e86-cd4df15a9f3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.390600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3d12e-be81-4183-9de2-bc9ba32a3587 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:07.392407 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3d12e-be81-4183-9de2-bc9ba32a3587 service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:07.403487 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1133/2253] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:36:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:07.404570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3d12e-be81-4183-9de2-bc9ba32a3587 service glance] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:07.412475 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee724df-ee97-46f6-9e86-cd4df15a9f3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:07.414681 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee724df-ee97-46f6-9e86-cd4df15a9f3f service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:07.416644 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3d12e-be81-4183-9de2-bc9ba32a3587 service glance] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:07.425609 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45c1b0-3954-484a-b13c-d23b194733ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:07.425609 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45c1b0-3954-484a-b13c-d23b194733ba admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.425609 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45c1b0-3954-484a-b13c-d23b194733ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.425609 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45c1b0-3954-484a-b13c-d23b194733ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.426027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45c1b0-3954-484a-b13c-d23b194733ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:07.428082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45c1b0-3954-484a-b13c-d23b194733ba admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:07.434151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1121/2254] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:36:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:07.435235 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee724df-ee97-46f6-9e86-cd4df15a9f3f service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:07.452127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee724df-ee97-46f6-9e86-cd4df15a9f3f service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:07.462044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5777bc-3cda-44b2-a056-fe217c8d7532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:07.463164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5777bc-3cda-44b2-a056-fe217c8d7532 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.463539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5777bc-3cda-44b2-a056-fe217c8d7532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.464159 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5777bc-3cda-44b2-a056-fe217c8d7532 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.465477 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5777bc-3cda-44b2-a056-fe217c8d7532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:07.471030 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5777bc-3cda-44b2-a056-fe217c8d7532 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:07.486367 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1134/2255] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:36:07 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:07.491034 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45c1b0-3954-484a-b13c-d23b194733ba admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:07.509987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1122/2256] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:36:07 2022] POST /identity/v3/users => generated 295 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:07.517120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5777bc-3cda-44b2-a056-fe217c8d7532 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:07.557526 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5777bc-3cda-44b2-a056-fe217c8d7532 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:07.625009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45c1b0-3954-484a-b13c-d23b194733ba admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:07.633446 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1e882-0f2e-4ef7-b8c5-e73b3d4e8916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:07.634582 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1e882-0f2e-4ef7-b8c5-e73b3d4e8916 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.634738 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1e882-0f2e-4ef7-b8c5-e73b3d4e8916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.635207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b1e882-0f2e-4ef7-b8c5-e73b3d4e8916 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.636329 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1e882-0f2e-4ef7-b8c5-e73b3d4e8916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:07.639865 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b1e882-0f2e-4ef7-b8c5-e73b3d4e8916 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:07.680946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1135/2257] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:36:07 2022] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:07.685047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1e882-0f2e-4ef7-b8c5-e73b3d4e8916 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:07.709125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b1e882-0f2e-4ef7-b8c5-e73b3d4e8916 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:07.709361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1289280-b00a-4450-a6df-8e57339ffb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:07.710060 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1289280-b00a-4450-a6df-8e57339ffb85 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.710340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1289280-b00a-4450-a6df-8e57339ffb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.710617 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1289280-b00a-4450-a6df-8e57339ffb85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.711454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1289280-b00a-4450-a6df-8e57339ffb85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:07.713323 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1289280-b00a-4450-a6df-8e57339ffb85 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:07.716437 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41672d4-e217-43a4-94c7-40b3b45148dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:07.717225 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41672d4-e217-43a4-94c7-40b3b45148dc admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.717536 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41672d4-e217-43a4-94c7-40b3b45148dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.717784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41672d4-e217-43a4-94c7-40b3b45148dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.718521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41672d4-e217-43a4-94c7-40b3b45148dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:07.721296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41672d4-e217-43a4-94c7-40b3b45148dc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:07.737631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1136/2258] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:36:07.737923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1123/2259] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:07.739553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41672d4-e217-43a4-94c7-40b3b45148dc admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:07.741980 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1289280-b00a-4450-a6df-8e57339ffb85 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:07.755168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1289280-b00a-4450-a6df-8e57339ffb85 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:07.761795 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45976db-7275-4e62-9867-8a6f4eaa42e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:07.762490 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45976db-7275-4e62-9867-8a6f4eaa42e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.762785 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45976db-7275-4e62-9867-8a6f4eaa42e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.763044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45976db-7275-4e62-9867-8a6f4eaa42e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.763795 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45976db-7275-4e62-9867-8a6f4eaa42e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:07.765999 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45976db-7275-4e62-9867-8a6f4eaa42e6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:07.768254 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41672d4-e217-43a4-94c7-40b3b45148dc admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:07.774592 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6468906-684f-4c45-9876-e6f0d39cb836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:07.775283 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6468906-684f-4c45-9876-e6f0d39cb836 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.775705 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6468906-684f-4c45-9876-e6f0d39cb836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.776148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6468906-684f-4c45-9876-e6f0d39cb836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.777179 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6468906-684f-4c45-9876-e6f0d39cb836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:07.778830 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6468906-684f-4c45-9876-e6f0d39cb836 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:07.784241 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:07.800196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1124/2260] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:36:07.805570 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45976db-7275-4e62-9867-8a6f4eaa42e6 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:07.819794 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1137/2261] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:07.822814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6468906-684f-4c45-9876-e6f0d39cb836 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:07.826226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45976db-7275-4e62-9867-8a6f4eaa42e6 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:07.835286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5fa28-3db0-4f4c-b558-31af4bd355a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:07.837259 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5fa28-3db0-4f4c-b558-31af4bd355a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.837748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5fa28-3db0-4f4c-b558-31af4bd355a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.838578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5fa28-3db0-4f4c-b558-31af4bd355a0 admin admin] PATH_INFO: `/v3/projects/ade401c5afc9468cbdf105827f6b78d1/users/5bdfea39b07b4c56bfeb3759ddd5c2db/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.857618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6468906-684f-4c45-9876-e6f0d39cb836 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:07.865617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400be449-5475-4e46-b06d-1add3dc4fe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:07.866912 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400be449-5475-4e46-b06d-1add3dc4fe81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.867387 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400be449-5475-4e46-b06d-1add3dc4fe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.867926 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400be449-5475-4e46-b06d-1add3dc4fe81 admin admin] PATH_INFO: `/v3/projects/32d38c38f0c94b45b9803c4a929d1b85/users/66f1035818f74855a1a1379730d54ea2/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.886897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5fa28-3db0-4f4c-b558-31af4bd355a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade401c5afc9468cbdf105827f6b78d1, user_id=5bdfea39b07b4c56bfeb3759ddd5c2db, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:07.891641 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5fa28-3db0-4f4c-b558-31af4bd355a0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:07.893956 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400be449-5475-4e46-b06d-1add3dc4fe81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d38c38f0c94b45b9803c4a929d1b85, user_id=66f1035818f74855a1a1379730d54ea2, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:07.898151 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400be449-5475-4e46-b06d-1add3dc4fe81 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:07.920449 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1125/2262] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:36:07 2022] PUT /identity/v3/projects/ade401c5afc9468cbdf105827f6b78d1/users/5bdfea39b07b4c56bfeb3759ddd5c2db/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:07.935221 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49c3f1-4e37-4e79-a0a7-a81aa7d84edb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:07.935484 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49c3f1-4e37-4e79-a0a7-a81aa7d84edb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:07.935762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49c3f1-4e37-4e79-a0a7-a81aa7d84edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:07.951581 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1138/2263] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:36:07 2022] PUT /identity/v3/projects/32d38c38f0c94b45b9803c4a929d1b85/users/66f1035818f74855a1a1379730d54ea2/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:07.952751 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400be449-5475-4e46-b06d-1add3dc4fe81 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:07.954549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-400be449-5475-4e46-b06d-1add3dc4fe81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:07.960350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:07.998263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1d49c3f1-4e37-4e79-a0a7-a81aa7d84edb None None] MFA Rules not processed for user `5bdfea39b07b4c56bfeb3759ddd5c2db`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:08.000739 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1d49c3f1-4e37-4e79-a0a7-a81aa7d84edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:08.060180 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400be449-5475-4e46-b06d-1add3dc4fe81 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:08.077938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b9dfb-6b16-4298-94b9-dc552859e239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:08.079256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b9dfb-6b16-4298-94b9-dc552859e239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:08.080074 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b9dfb-6b16-4298-94b9-dc552859e239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:08.080583 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b9dfb-6b16-4298-94b9-dc552859e239 admin admin] PATH_INFO: `/v3/projects/a98de32cb0504577be36b37a01fdd0c0` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:08.086096 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b9dfb-6b16-4298-94b9-dc552859e239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a98de32cb0504577be36b37a01fdd0c0)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:08.096684 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b9dfb-6b16-4298-94b9-dc552859e239 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:08.146554 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1126/2264] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:08.163645 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc25df-4a52-4f28-882a-65006a9ab819 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:08.164626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc25df-4a52-4f28-882a-65006a9ab819 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:08.165547 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc25df-4a52-4f28-882a-65006a9ab819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:08.231526 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9ebc25df-4a52-4f28-882a-65006a9ab819 None None] MFA Rules not processed for user `66f1035818f74855a1a1379730d54ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:08.235113 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9ebc25df-4a52-4f28-882a-65006a9ab819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:08.255098 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cc1b9dfb-6b16-4298-94b9-dc552859e239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98de32cb0504577be36b37a01fdd0c0', 'request_id': 'req-cc1b9dfb-6b16-4298-94b9-dc552859e239'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:08.269853 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cc1b9dfb-6b16-4298-94b9-dc552859e239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98de32cb0504577be36b37a01fdd0c0', 'request_id': 'req-cc1b9dfb-6b16-4298-94b9-dc552859e239'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:08.278110 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cc1b9dfb-6b16-4298-94b9-dc552859e239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98de32cb0504577be36b37a01fdd0c0', 'request_id': 'req-cc1b9dfb-6b16-4298-94b9-dc552859e239'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:08.293176 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cc1b9dfb-6b16-4298-94b9-dc552859e239 admin admin] The token cache is being invalidate because project a98de32cb0504577be36b37a01fdd0c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:08.293512 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cc1b9dfb-6b16-4298-94b9-dc552859e239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:08.294507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cc1b9dfb-6b16-4298-94b9-dc552859e239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:08.296355 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1139/2265] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:36:07 2022] DELETE /identity/v3/projects/a98de32cb0504577be36b37a01fdd0c0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:08.297325 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b9dfb-6b16-4298-94b9-dc552859e239 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:08.309521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-cc1b9dfb-6b16-4298-94b9-dc552859e239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:08.439430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b9dfb-6b16-4298-94b9-dc552859e239 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:08.444503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51018d-7f54-4556-ad4f-5177357d0fdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:08.445301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51018d-7f54-4556-ad4f-5177357d0fdd service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:08.445651 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51018d-7f54-4556-ad4f-5177357d0fdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:08.446000 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51018d-7f54-4556-ad4f-5177357d0fdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:08.449466 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ff51018d-7f54-4556-ad4f-5177357d0fdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:08.464825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1127/2266] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:08.478803 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:08.482003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc25df-4a52-4f28-882a-65006a9ab819 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:08.483727 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9ebc25df-4a52-4f28-882a-65006a9ab819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:08.501496 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc25df-4a52-4f28-882a-65006a9ab819 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:08.515876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468eb86-f460-40a1-869a-e2320f514052 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:08.517279 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468eb86-f460-40a1-869a-e2320f514052 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:08.519531 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468eb86-f460-40a1-869a-e2320f514052 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:08.520986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468eb86-f460-40a1-869a-e2320f514052 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:08.540045 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468eb86-f460-40a1-869a-e2320f514052 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:08.543256 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468eb86-f460-40a1-869a-e2320f514052 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:08.573088 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1128/2267] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:36:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:08.628563 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51018d-7f54-4556-ad4f-5177357d0fdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:08.631497 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51018d-7f54-4556-ad4f-5177357d0fdd service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:08.643492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1140/2268] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:36:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:18.559426 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=67 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:18.639463 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=19 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:19.430638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468eb86-f460-40a1-869a-e2320f514052 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:19.432571 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3468eb86-f460-40a1-869a-e2320f514052 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:19.525431 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468eb86-f460-40a1-869a-e2320f514052 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:19.530594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10462c00-4e70-483c-ad36-3e625ebd0829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:19.531645 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10462c00-4e70-483c-ad36-3e625ebd0829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:19.531927 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10462c00-4e70-483c-ad36-3e625ebd0829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:19.532258 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10462c00-4e70-483c-ad36-3e625ebd0829 admin admin] PATH_INFO: `/v3/users/5bdfea39b07b4c56bfeb3759ddd5c2db` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:19.533547 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10462c00-4e70-483c-ad36-3e625ebd0829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bdfea39b07b4c56bfeb3759ddd5c2db)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:19.535534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10462c00-4e70-483c-ad36-3e625ebd0829 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:19.598279 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-10462c00-4e70-483c-ad36-3e625ebd0829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bdfea39b07b4c56bfeb3759ddd5c2db'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:19.607159 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-10462c00-4e70-483c-ad36-3e625ebd0829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bdfea39b07b4c56bfeb3759ddd5c2db'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:19.620513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-10462c00-4e70-483c-ad36-3e625ebd0829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bdfea39b07b4c56bfeb3759ddd5c2db'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:19.627544 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-10462c00-4e70-483c-ad36-3e625ebd0829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bdfea39b07b4c56bfeb3759ddd5c2db'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:19.628384 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-10462c00-4e70-483c-ad36-3e625ebd0829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bdfea39b07b4c56bfeb3759ddd5c2db'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:19.634908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1129/2269] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:36:19 2022] DELETE /identity/v3/users/5bdfea39b07b4c56bfeb3759ddd5c2db => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:19.641974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea306ea-0dbd-4724-ad47-5cc1d96fa25d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:19.642622 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea306ea-0dbd-4724-ad47-5cc1d96fa25d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:19.642622 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea306ea-0dbd-4724-ad47-5cc1d96fa25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:19.662317 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-aea306ea-0dbd-4724-ad47-5cc1d96fa25d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:19.664853 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-aea306ea-0dbd-4724-ad47-5cc1d96fa25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:19.740743 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1141/2270] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:19.751507 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10462c00-4e70-483c-ad36-3e625ebd0829 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:19.753182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-10462c00-4e70-483c-ad36-3e625ebd0829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:19.829061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10462c00-4e70-483c-ad36-3e625ebd0829 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:19.833382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb02084-bbc8-4dd1-b0e8-ccb9352f704f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:19.834044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb02084-bbc8-4dd1-b0e8-ccb9352f704f service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:19.834327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb02084-bbc8-4dd1-b0e8-ccb9352f704f service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:19.834608 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb02084-bbc8-4dd1-b0e8-ccb9352f704f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:19.844554 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb02084-bbc8-4dd1-b0e8-ccb9352f704f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:19.846002 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb02084-bbc8-4dd1-b0e8-ccb9352f704f service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:19.856396 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1130/2271] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:36:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:20.155260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea306ea-0dbd-4724-ad47-5cc1d96fa25d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:20.156721 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-aea306ea-0dbd-4724-ad47-5cc1d96fa25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:20.169016 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea306ea-0dbd-4724-ad47-5cc1d96fa25d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:20.173809 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8456996-fc15-46cd-a1cd-2e4ea63502f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:20.174787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8456996-fc15-46cd-a1cd-2e4ea63502f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:20.175159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8456996-fc15-46cd-a1cd-2e4ea63502f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:20.175485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8456996-fc15-46cd-a1cd-2e4ea63502f0 admin admin] PATH_INFO: `/v3/projects/ade401c5afc9468cbdf105827f6b78d1` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:20.176787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8456996-fc15-46cd-a1cd-2e4ea63502f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ade401c5afc9468cbdf105827f6b78d1)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:20.178821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8456996-fc15-46cd-a1cd-2e4ea63502f0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:20.233692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f8456996-fc15-46cd-a1cd-2e4ea63502f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ade401c5afc9468cbdf105827f6b78d1', 'request_id': 'req-f8456996-fc15-46cd-a1cd-2e4ea63502f0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:20.241601 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f8456996-fc15-46cd-a1cd-2e4ea63502f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ade401c5afc9468cbdf105827f6b78d1', 'request_id': 'req-f8456996-fc15-46cd-a1cd-2e4ea63502f0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:20.249116 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f8456996-fc15-46cd-a1cd-2e4ea63502f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ade401c5afc9468cbdf105827f6b78d1', 'request_id': 'req-f8456996-fc15-46cd-a1cd-2e4ea63502f0'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:20.261446 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f8456996-fc15-46cd-a1cd-2e4ea63502f0 admin admin] The token cache is being invalidate because project ade401c5afc9468cbdf105827f6b78d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:20.261736 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f8456996-fc15-46cd-a1cd-2e4ea63502f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:20.262414 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-f8456996-fc15-46cd-a1cd-2e4ea63502f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:20.264356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1142/2272] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:36:20 2022] DELETE /identity/v3/projects/ade401c5afc9468cbdf105827f6b78d1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:29.851790 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:30.257604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:46.809363 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931ccfa-9e3a-4dfb-8240-75627240b612 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:46.809965 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931ccfa-9e3a-4dfb-8240-75627240b612 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:46.810196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931ccfa-9e3a-4dfb-8240-75627240b612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:46.843242 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c931ccfa-9e3a-4dfb-8240-75627240b612 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:46.845144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c931ccfa-9e3a-4dfb-8240-75627240b612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:46.912244 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1131/2273] 10.222.0.82 () {58 vars in 1016 bytes} [Fri May 27 16:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:36:46.945111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8456996-fc15-46cd-a1cd-2e4ea63502f0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:46.946755 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f8456996-fc15-46cd-a1cd-2e4ea63502f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:47.086560 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8456996-fc15-46cd-a1cd-2e4ea63502f0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:47.092572 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2f645-7142-445b-807f-ec9a1121822e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:47.093572 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2f645-7142-445b-807f-ec9a1121822e service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:47.094020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2f645-7142-445b-807f-ec9a1121822e service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:47.094434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2f645-7142-445b-807f-ec9a1121822e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:47.107504 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2f645-7142-445b-807f-ec9a1121822e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:47.110158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2f645-7142-445b-807f-ec9a1121822e service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:47.125259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1143/2274] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:47.396130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec1354-8a5d-469e-a536-967d65de7c6e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:47.396421 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec1354-8a5d-469e-a536-967d65de7c6e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:47.396701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec1354-8a5d-469e-a536-967d65de7c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:47.415169 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-bfec1354-8a5d-469e-a536-967d65de7c6e None None] MFA Rules not processed for user `2a318e87c9d6497ead119623fbf0dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:47.416402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bfec1354-8a5d-469e-a536-967d65de7c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:47.483296 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1132/2275] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:48.788265 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2f645-7142-445b-807f-ec9a1121822e service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:48.789870 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bce2f645-7142-445b-807f-ec9a1121822e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:48.809105 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2f645-7142-445b-807f-ec9a1121822e service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:48.819955 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83ffaf-3e6b-48c3-807d-06c90c514c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:48.830166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83ffaf-3e6b-48c3-807d-06c90c514c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:48.830453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83ffaf-3e6b-48c3-807d-06c90c514c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:48.830966 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83ffaf-3e6b-48c3-807d-06c90c514c35 admin admin] PATH_INFO: `/v3/users/2e09360902b84fd3a0d9394414c31fd9` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:48.832688 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83ffaf-3e6b-48c3-807d-06c90c514c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e09360902b84fd3a0d9394414c31fd9)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:48.835284 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e83ffaf-3e6b-48c3-807d-06c90c514c35 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:48.895393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8e83ffaf-3e6b-48c3-807d-06c90c514c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e09360902b84fd3a0d9394414c31fd9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:48.896659 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8e83ffaf-3e6b-48c3-807d-06c90c514c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e09360902b84fd3a0d9394414c31fd9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:48.897247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8e83ffaf-3e6b-48c3-807d-06c90c514c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e09360902b84fd3a0d9394414c31fd9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:48.913781 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8e83ffaf-3e6b-48c3-807d-06c90c514c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e09360902b84fd3a0d9394414c31fd9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:48.924067 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8e83ffaf-3e6b-48c3-807d-06c90c514c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e09360902b84fd3a0d9394414c31fd9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:48.940483 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1144/2276] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:36:48 2022] DELETE /identity/v3/users/2e09360902b84fd3a0d9394414c31fd9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:48.946603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5faf5f-4f80-49b9-94fd-6973a1358238 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:48.947144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5faf5f-4f80-49b9-94fd-6973a1358238 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:48.947381 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5faf5f-4f80-49b9-94fd-6973a1358238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:48.968644 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-dd5faf5f-4f80-49b9-94fd-6973a1358238 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:48.969807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-dd5faf5f-4f80-49b9-94fd-6973a1358238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:49.056223 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1133/2277] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:49.071572 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83ffaf-3e6b-48c3-807d-06c90c514c35 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:49.073374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8e83ffaf-3e6b-48c3-807d-06c90c514c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:49.135073 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:49.175062 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83ffaf-3e6b-48c3-807d-06c90c514c35 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:49.179936 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e98f5a-ade7-4261-b7be-0f7dba9c35c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:49.180658 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e98f5a-ade7-4261-b7be-0f7dba9c35c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:49.180994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e98f5a-ade7-4261-b7be-0f7dba9c35c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:49.181214 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e98f5a-ade7-4261-b7be-0f7dba9c35c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:49.199724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e98f5a-ade7-4261-b7be-0f7dba9c35c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:49.201351 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e98f5a-ade7-4261-b7be-0f7dba9c35c2 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:49.212799 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1145/2278] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:36:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:49.542751 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5faf5f-4f80-49b9-94fd-6973a1358238 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:49.544254 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-dd5faf5f-4f80-49b9-94fd-6973a1358238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:49.559067 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5faf5f-4f80-49b9-94fd-6973a1358238 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:49.566313 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9faadb-905a-4faf-85b8-6c3b269a9cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:49.567080 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9faadb-905a-4faf-85b8-6c3b269a9cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:49.567283 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9faadb-905a-4faf-85b8-6c3b269a9cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:49.567559 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9faadb-905a-4faf-85b8-6c3b269a9cbe admin admin] PATH_INFO: `/v3/projects/b60b67aa80a2451dadf43fa403548756` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:49.568976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9faadb-905a-4faf-85b8-6c3b269a9cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b60b67aa80a2451dadf43fa403548756)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:49.570879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9faadb-905a-4faf-85b8-6c3b269a9cbe admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:49.610385 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:49.623453 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cb9faadb-905a-4faf-85b8-6c3b269a9cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b60b67aa80a2451dadf43fa403548756', 'request_id': 'req-cb9faadb-905a-4faf-85b8-6c3b269a9cbe'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:49.631145 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cb9faadb-905a-4faf-85b8-6c3b269a9cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b60b67aa80a2451dadf43fa403548756', 'request_id': 'req-cb9faadb-905a-4faf-85b8-6c3b269a9cbe'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:49.641527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cb9faadb-905a-4faf-85b8-6c3b269a9cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b60b67aa80a2451dadf43fa403548756', 'request_id': 'req-cb9faadb-905a-4faf-85b8-6c3b269a9cbe'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:49.653590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cb9faadb-905a-4faf-85b8-6c3b269a9cbe admin admin] The token cache is being invalidate because project b60b67aa80a2451dadf43fa403548756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:49.653801 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cb9faadb-905a-4faf-85b8-6c3b269a9cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:49.654504 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cb9faadb-905a-4faf-85b8-6c3b269a9cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:49.656312 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1134/2279] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:36:49 2022] DELETE /identity/v3/projects/b60b67aa80a2451dadf43fa403548756 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:49.661599 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56087f3c-89cb-4f69-af0e-f25394e588f2 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:49.662012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56087f3c-89cb-4f69-af0e-f25394e588f2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:49.662294 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56087f3c-89cb-4f69-af0e-f25394e588f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:49.681847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-56087f3c-89cb-4f69-af0e-f25394e588f2 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:49.683337 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-56087f3c-89cb-4f69-af0e-f25394e588f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:49.744074 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1146/2280] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:49.752642 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5012310-2bed-40fa-ad9a-c59753959b56 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:49.752976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5012310-2bed-40fa-ad9a-c59753959b56 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:49.753290 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5012310-2bed-40fa-ad9a-c59753959b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:49.775586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d5012310-2bed-40fa-ad9a-c59753959b56 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:49.776841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d5012310-2bed-40fa-ad9a-c59753959b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:49.785233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1135/2281] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:49.789639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56087f3c-89cb-4f69-af0e-f25394e588f2 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:49.800097 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56087f3c-89cb-4f69-af0e-f25394e588f2 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:49.805188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880c1d9-eb81-46eb-a4d3-7e643a12546b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:49.805848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880c1d9-eb81-46eb-a4d3-7e643a12546b admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:49.806132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880c1d9-eb81-46eb-a4d3-7e643a12546b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:49.806408 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880c1d9-eb81-46eb-a4d3-7e643a12546b admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:49.807137 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880c1d9-eb81-46eb-a4d3-7e643a12546b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:36:49.807443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880c1d9-eb81-46eb-a4d3-7e643a12546b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:49.809124 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880c1d9-eb81-46eb-a4d3-7e643a12546b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:49.825397 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1147/2282] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:36:49.830957 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5012310-2bed-40fa-ad9a-c59753959b56 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:49.845319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5012310-2bed-40fa-ad9a-c59753959b56 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:49.853921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902465ce-f74e-45c2-95bb-a84c6db7ab5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:49.854856 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902465ce-f74e-45c2-95bb-a84c6db7ab5c admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:49.855234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902465ce-f74e-45c2-95bb-a84c6db7ab5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:49.855569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902465ce-f74e-45c2-95bb-a84c6db7ab5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:49.856588 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902465ce-f74e-45c2-95bb-a84c6db7ab5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:49.859587 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902465ce-f74e-45c2-95bb-a84c6db7ab5c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:49.891278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1136/2283] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:36:49 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:49.895607 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880c1d9-eb81-46eb-a4d3-7e643a12546b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:49.905993 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880c1d9-eb81-46eb-a4d3-7e643a12546b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:49.965173 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ebc99-e33b-4b1d-ac73-e43c4f72d752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:49.965827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ebc99-e33b-4b1d-ac73-e43c4f72d752 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:49.966117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ebc99-e33b-4b1d-ac73-e43c4f72d752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:49.966390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ebc99-e33b-4b1d-ac73-e43c4f72d752 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:49.967077 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ebc99-e33b-4b1d-ac73-e43c4f72d752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:49.969112 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ebc99-e33b-4b1d-ac73-e43c4f72d752 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:49.991938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1148/2284] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:36:49 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:49.995555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902465ce-f74e-45c2-95bb-a84c6db7ab5c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:50.006470 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902465ce-f74e-45c2-95bb-a84c6db7ab5c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:50.012585 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16e2ea-672b-4a7a-bef9-e053e472fe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:50.013440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16e2ea-672b-4a7a-bef9-e053e472fe0b admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:50.013725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16e2ea-672b-4a7a-bef9-e053e472fe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:50.013995 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16e2ea-672b-4a7a-bef9-e053e472fe0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:50.014748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16e2ea-672b-4a7a-bef9-e053e472fe0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:50.016595 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16e2ea-672b-4a7a-bef9-e053e472fe0b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:50.027978 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1137/2285] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:36:50.032517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ebc99-e33b-4b1d-ac73-e43c4f72d752 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:50.043185 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ebc99-e33b-4b1d-ac73-e43c4f72d752 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:50.049731 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b883a7f-fce7-41e3-a899-43204feaf81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:50.050552 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b883a7f-fce7-41e3-a899-43204feaf81b admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:50.050925 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b883a7f-fce7-41e3-a899-43204feaf81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:50.051809 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b883a7f-fce7-41e3-a899-43204feaf81b admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:50.052471 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b883a7f-fce7-41e3-a899-43204feaf81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:50.054311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b883a7f-fce7-41e3-a899-43204feaf81b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:50.066957 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1149/2286] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:50.071466 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16e2ea-672b-4a7a-bef9-e053e472fe0b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:50.083206 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16e2ea-672b-4a7a-bef9-e053e472fe0b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:50.087896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cafdf-36b7-486c-9c56-53a53c24be9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:50.089240 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cafdf-36b7-486c-9c56-53a53c24be9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:50.089240 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cafdf-36b7-486c-9c56-53a53c24be9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:50.089445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cafdf-36b7-486c-9c56-53a53c24be9e admin admin] PATH_INFO: `/v3/projects/6957e9d9bb0a4084bcdc47b179527150/users/5cdf85cc831f43abaecd0efdcb7135e1/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:50.107428 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cafdf-36b7-486c-9c56-53a53c24be9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6957e9d9bb0a4084bcdc47b179527150, user_id=5cdf85cc831f43abaecd0efdcb7135e1, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:50.113292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cafdf-36b7-486c-9c56-53a53c24be9e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:50.132402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1138/2287] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:36:50 2022] PUT /identity/v3/projects/6957e9d9bb0a4084bcdc47b179527150/users/5cdf85cc831f43abaecd0efdcb7135e1/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:36:50.142719 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950b048-bb37-4b05-b7cd-c4a708b4dd04 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:50.143007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950b048-bb37-4b05-b7cd-c4a708b4dd04 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:50.143281 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950b048-bb37-4b05-b7cd-c4a708b4dd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:50.170009 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7950b048-bb37-4b05-b7cd-c4a708b4dd04 None None] MFA Rules not processed for user `5cdf85cc831f43abaecd0efdcb7135e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:50.171127 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7950b048-bb37-4b05-b7cd-c4a708b4dd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:50.200766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:50.253443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1150/2288] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:50.260668 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cafdf-36b7-486c-9c56-53a53c24be9e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:50.263622 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-128cafdf-36b7-486c-9c56-53a53c24be9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:50.357438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cafdf-36b7-486c-9c56-53a53c24be9e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:50.361453 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d04fe6-4224-4b3e-b321-a80831c01f22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:50.362669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d04fe6-4224-4b3e-b321-a80831c01f22 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:50.362669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d04fe6-4224-4b3e-b321-a80831c01f22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:50.362669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d04fe6-4224-4b3e-b321-a80831c01f22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:50.372515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d04fe6-4224-4b3e-b321-a80831c01f22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:50.374408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d04fe6-4224-4b3e-b321-a80831c01f22 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:50.384879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1139/2289] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:36:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:50.411993 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950b048-bb37-4b05-b7cd-c4a708b4dd04 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:50.477693 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950b048-bb37-4b05-b7cd-c4a708b4dd04 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:50.482699 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4e206-c2a8-4eee-a615-bfd31d04d8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:50.483579 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4e206-c2a8-4eee-a615-bfd31d04d8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:50.484130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4e206-c2a8-4eee-a615-bfd31d04d8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:50.484525 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4e206-c2a8-4eee-a615-bfd31d04d8e4 admin admin] PATH_INFO: `/v3/users/5cdf85cc831f43abaecd0efdcb7135e1` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:50.486025 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4e206-c2a8-4eee-a615-bfd31d04d8e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cdf85cc831f43abaecd0efdcb7135e1)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:50.488151 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4e206-c2a8-4eee-a615-bfd31d04d8e4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:50.542087 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-feb4e206-c2a8-4eee-a615-bfd31d04d8e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cdf85cc831f43abaecd0efdcb7135e1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:50.542798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-feb4e206-c2a8-4eee-a615-bfd31d04d8e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cdf85cc831f43abaecd0efdcb7135e1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:50.543679 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-feb4e206-c2a8-4eee-a615-bfd31d04d8e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cdf85cc831f43abaecd0efdcb7135e1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:50.558024 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-feb4e206-c2a8-4eee-a615-bfd31d04d8e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cdf85cc831f43abaecd0efdcb7135e1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:50.565198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-feb4e206-c2a8-4eee-a615-bfd31d04d8e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cdf85cc831f43abaecd0efdcb7135e1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:50.590416 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1151/2290] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:36:50 2022] DELETE /identity/v3/users/5cdf85cc831f43abaecd0efdcb7135e1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:50.595158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd42d6-2db0-43a2-bbe9-5017f22bbb19 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:50.595452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd42d6-2db0-43a2-bbe9-5017f22bbb19 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:50.595853 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd42d6-2db0-43a2-bbe9-5017f22bbb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:50.614063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b3cd42d6-2db0-43a2-bbe9-5017f22bbb19 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:50.615481 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b3cd42d6-2db0-43a2-bbe9-5017f22bbb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:50.652224 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:50.680507 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1140/2291] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:50.693362 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4e206-c2a8-4eee-a615-bfd31d04d8e4 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:50.695398 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-feb4e206-c2a8-4eee-a615-bfd31d04d8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:50.754518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:50.758789 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4e206-c2a8-4eee-a615-bfd31d04d8e4 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:50.763396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dbecae-1d14-4e95-83bf-4b1c604a80eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:50.764090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbecae-1d14-4e95-83bf-4b1c604a80eb service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:50.764565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbecae-1d14-4e95-83bf-4b1c604a80eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:50.764942 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dbecae-1d14-4e95-83bf-4b1c604a80eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:50.775696 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dbecae-1d14-4e95-83bf-4b1c604a80eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:50.777238 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dbecae-1d14-4e95-83bf-4b1c604a80eb service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:50.789012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1152/2292] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:51.077474 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd42d6-2db0-43a2-bbe9-5017f22bbb19 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:51.088642 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b3cd42d6-2db0-43a2-bbe9-5017f22bbb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:51.106952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd42d6-2db0-43a2-bbe9-5017f22bbb19 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:51.113599 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45c73c-c46e-4d8a-acbf-2847531bae3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:51.114585 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45c73c-c46e-4d8a-acbf-2847531bae3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:51.115013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45c73c-c46e-4d8a-acbf-2847531bae3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:51.115474 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45c73c-c46e-4d8a-acbf-2847531bae3a admin admin] PATH_INFO: `/v3/projects/6957e9d9bb0a4084bcdc47b179527150` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:51.124189 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45c73c-c46e-4d8a-acbf-2847531bae3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6957e9d9bb0a4084bcdc47b179527150)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:51.126786 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45c73c-c46e-4d8a-acbf-2847531bae3a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:51.201175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ea45c73c-c46e-4d8a-acbf-2847531bae3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6957e9d9bb0a4084bcdc47b179527150', 'request_id': 'req-ea45c73c-c46e-4d8a-acbf-2847531bae3a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:51.209784 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ea45c73c-c46e-4d8a-acbf-2847531bae3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6957e9d9bb0a4084bcdc47b179527150', 'request_id': 'req-ea45c73c-c46e-4d8a-acbf-2847531bae3a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:51.221580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ea45c73c-c46e-4d8a-acbf-2847531bae3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6957e9d9bb0a4084bcdc47b179527150', 'request_id': 'req-ea45c73c-c46e-4d8a-acbf-2847531bae3a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:51.234822 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ea45c73c-c46e-4d8a-acbf-2847531bae3a admin admin] The token cache is being invalidate because project 6957e9d9bb0a4084bcdc47b179527150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:51.235189 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ea45c73c-c46e-4d8a-acbf-2847531bae3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:51.237533 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-ea45c73c-c46e-4d8a-acbf-2847531bae3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:51.239286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1141/2293] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:36:51 2022] DELETE /identity/v3/projects/6957e9d9bb0a4084bcdc47b179527150 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:51.244696 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5e1a5-78ba-4959-860c-0b51a66c9a74 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:51.245178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5e1a5-78ba-4959-860c-0b51a66c9a74 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:51.245423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d5e1a5-78ba-4959-860c-0b51a66c9a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:51.263707 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-91d5e1a5-78ba-4959-860c-0b51a66c9a74 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:51.265071 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-91d5e1a5-78ba-4959-860c-0b51a66c9a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:51.331546 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1153/2294] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:51.339830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72e2df-897c-463e-9f21-3c4cc13fb9e1 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:51.340167 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72e2df-897c-463e-9f21-3c4cc13fb9e1 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:51.340450 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72e2df-897c-463e-9f21-3c4cc13fb9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:51.360393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-dd72e2df-897c-463e-9f21-3c4cc13fb9e1 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:51.362342 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-dd72e2df-897c-463e-9f21-3c4cc13fb9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:51.371420 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1142/2295] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:36:51.376365 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5e1a5-78ba-4959-860c-0b51a66c9a74 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:51.386655 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d5e1a5-78ba-4959-860c-0b51a66c9a74 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:51.392217 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c264da-003b-478b-9f58-e3eb576c927d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:51.392881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c264da-003b-478b-9f58-e3eb576c927d admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:51.393189 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c264da-003b-478b-9f58-e3eb576c927d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:51.393467 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c264da-003b-478b-9f58-e3eb576c927d admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:51.394194 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c264da-003b-478b-9f58-e3eb576c927d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:36:51.395480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c264da-003b-478b-9f58-e3eb576c927d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:51.397243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c264da-003b-478b-9f58-e3eb576c927d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:51.410159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1154/2296] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:36:51.414917 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72e2df-897c-463e-9f21-3c4cc13fb9e1 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:51.425161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72e2df-897c-463e-9f21-3c4cc13fb9e1 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:51.429894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51599f2-ee5a-4806-9133-db31dda0422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:51.430555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51599f2-ee5a-4806-9133-db31dda0422b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:51.430824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51599f2-ee5a-4806-9133-db31dda0422b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:51.431125 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51599f2-ee5a-4806-9133-db31dda0422b admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:51.431836 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51599f2-ee5a-4806-9133-db31dda0422b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:51.433813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51599f2-ee5a-4806-9133-db31dda0422b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:51.463386 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1143/2297] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:36:51 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:51.467587 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c264da-003b-478b-9f58-e3eb576c927d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:51.478777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c264da-003b-478b-9f58-e3eb576c927d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:51.550031 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4374d-8ff1-4bca-9f34-4ffa743268e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:51.552252 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4374d-8ff1-4bca-9f34-4ffa743268e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:51.552540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4374d-8ff1-4bca-9f34-4ffa743268e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:51.552819 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4374d-8ff1-4bca-9f34-4ffa743268e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:51.553559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4374d-8ff1-4bca-9f34-4ffa743268e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:51.555681 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4374d-8ff1-4bca-9f34-4ffa743268e3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:51.587735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1155/2298] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:36:51 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:51.591688 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51599f2-ee5a-4806-9133-db31dda0422b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:51.602738 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51599f2-ee5a-4806-9133-db31dda0422b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:51.607822 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62ede2-d948-4efe-bc9e-b496c073e6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:51.608547 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62ede2-d948-4efe-bc9e-b496c073e6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:51.608832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62ede2-d948-4efe-bc9e-b496c073e6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:51.609428 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62ede2-d948-4efe-bc9e-b496c073e6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:51.610560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62ede2-d948-4efe-bc9e-b496c073e6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:51.612387 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62ede2-d948-4efe-bc9e-b496c073e6d2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:51.624690 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1144/2299] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:51.629586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4374d-8ff1-4bca-9f34-4ffa743268e3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:51.641259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4374d-8ff1-4bca-9f34-4ffa743268e3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:51.646286 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76e4aa-7a59-4600-8ae4-e44759a146d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:51.647029 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76e4aa-7a59-4600-8ae4-e44759a146d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:51.647394 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76e4aa-7a59-4600-8ae4-e44759a146d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:51.647724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76e4aa-7a59-4600-8ae4-e44759a146d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:51.648553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76e4aa-7a59-4600-8ae4-e44759a146d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:51.652051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76e4aa-7a59-4600-8ae4-e44759a146d7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:51.661531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1156/2300] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:51.666025 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62ede2-d948-4efe-bc9e-b496c073e6d2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:51.680352 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62ede2-d948-4efe-bc9e-b496c073e6d2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:51.685330 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28a6fd-d636-4408-a2ac-a6d1fff0fd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:51.686385 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28a6fd-d636-4408-a2ac-a6d1fff0fd9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:51.686671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28a6fd-d636-4408-a2ac-a6d1fff0fd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:51.686943 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28a6fd-d636-4408-a2ac-a6d1fff0fd9c admin admin] PATH_INFO: `/v3/projects/4465a892445b4e809c03d7f2b9b57466/users/0945ef8063854a758b0c80748b421eb1/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:51.704186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28a6fd-d636-4408-a2ac-a6d1fff0fd9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4465a892445b4e809c03d7f2b9b57466, user_id=0945ef8063854a758b0c80748b421eb1, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:51.707259 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28a6fd-d636-4408-a2ac-a6d1fff0fd9c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:51.723324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1145/2301] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:36:51 2022] PUT /identity/v3/projects/4465a892445b4e809c03d7f2b9b57466/users/0945ef8063854a758b0c80748b421eb1/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:51.729133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e32d92-acae-4043-b65a-724ac9310874 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:51.729424 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e32d92-acae-4043-b65a-724ac9310874 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:51.729851 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e32d92-acae-4043-b65a-724ac9310874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:51.749143 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f2e32d92-acae-4043-b65a-724ac9310874 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:51.750352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f2e32d92-acae-4043-b65a-724ac9310874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:51.803947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:51.815831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1157/2302] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:51.828140 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28a6fd-d636-4408-a2ac-a6d1fff0fd9c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:51.829919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3e28a6fd-d636-4408-a2ac-a6d1fff0fd9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:51.894882 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28a6fd-d636-4408-a2ac-a6d1fff0fd9c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:51.899049 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c8c4a-28dd-451c-837b-d9e67059d570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:51.899709 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c8c4a-28dd-451c-837b-d9e67059d570 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:51.900498 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c8c4a-28dd-451c-837b-d9e67059d570 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:51.901007 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c8c4a-28dd-451c-837b-d9e67059d570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:51.913555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c8c4a-28dd-451c-837b-d9e67059d570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:51.915231 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c8c4a-28dd-451c-837b-d9e67059d570 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:51.928201 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1146/2303] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:36:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:36:53.866718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e32d92-acae-4043-b65a-724ac9310874 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:53.868034 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f2e32d92-acae-4043-b65a-724ac9310874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:53.880896 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e32d92-acae-4043-b65a-724ac9310874 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:53.886474 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03def391-d864-46d9-9e50-e1e6efc1b359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:53.887363 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03def391-d864-46d9-9e50-e1e6efc1b359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:53.887645 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03def391-d864-46d9-9e50-e1e6efc1b359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:53.887918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03def391-d864-46d9-9e50-e1e6efc1b359 admin admin] PATH_INFO: `/v3/users/66f1035818f74855a1a1379730d54ea2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:53.889259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03def391-d864-46d9-9e50-e1e6efc1b359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f1035818f74855a1a1379730d54ea2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:53.891892 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03def391-d864-46d9-9e50-e1e6efc1b359 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:53.978565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-03def391-d864-46d9-9e50-e1e6efc1b359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f1035818f74855a1a1379730d54ea2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:53.981813 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-03def391-d864-46d9-9e50-e1e6efc1b359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f1035818f74855a1a1379730d54ea2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:53.983738 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-03def391-d864-46d9-9e50-e1e6efc1b359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f1035818f74855a1a1379730d54ea2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:54.016119 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-03def391-d864-46d9-9e50-e1e6efc1b359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f1035818f74855a1a1379730d54ea2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:54.024786 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-03def391-d864-46d9-9e50-e1e6efc1b359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f1035818f74855a1a1379730d54ea2'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:54.043628 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1158/2304] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:36:53 2022] DELETE /identity/v3/users/66f1035818f74855a1a1379730d54ea2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:54.049148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0acdb-f539-4bd7-9c47-1e96951774d3 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:54.049535 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0acdb-f539-4bd7-9c47-1e96951774d3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:54.049707 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0acdb-f539-4bd7-9c47-1e96951774d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:54.056099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:54.093120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-47b0acdb-f539-4bd7-9c47-1e96951774d3 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:54.100352 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-47b0acdb-f539-4bd7-9c47-1e96951774d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:54.235023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1147/2305] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:54.252042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03def391-d864-46d9-9e50-e1e6efc1b359 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:54.253746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-03def391-d864-46d9-9e50-e1e6efc1b359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:54.329624 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03def391-d864-46d9-9e50-e1e6efc1b359 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:54.333672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21f9bc-48cd-4d93-86c7-2fec371a8023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:54.334443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21f9bc-48cd-4d93-86c7-2fec371a8023 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:54.334792 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21f9bc-48cd-4d93-86c7-2fec371a8023 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:54.335133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21f9bc-48cd-4d93-86c7-2fec371a8023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:54.346697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21f9bc-48cd-4d93-86c7-2fec371a8023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:54.348103 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21f9bc-48cd-4d93-86c7-2fec371a8023 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:54.360111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1159/2306] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:36:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:54.714133 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0acdb-f539-4bd7-9c47-1e96951774d3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:54.715704 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-47b0acdb-f539-4bd7-9c47-1e96951774d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:54.734357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0acdb-f539-4bd7-9c47-1e96951774d3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:54.743398 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e684e-858c-4390-8367-0e01448b2c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:54.745515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e684e-858c-4390-8367-0e01448b2c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:54.745515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e684e-858c-4390-8367-0e01448b2c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:54.745515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e684e-858c-4390-8367-0e01448b2c14 admin admin] PATH_INFO: `/v3/projects/32d38c38f0c94b45b9803c4a929d1b85` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:54.746726 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e684e-858c-4390-8367-0e01448b2c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d38c38f0c94b45b9803c4a929d1b85)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:54.749035 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e684e-858c-4390-8367-0e01448b2c14 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:54.859495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cd4e684e-858c-4390-8367-0e01448b2c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d38c38f0c94b45b9803c4a929d1b85', 'request_id': 'req-cd4e684e-858c-4390-8367-0e01448b2c14'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:54.873539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cd4e684e-858c-4390-8367-0e01448b2c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d38c38f0c94b45b9803c4a929d1b85', 'request_id': 'req-cd4e684e-858c-4390-8367-0e01448b2c14'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:54.888804 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cd4e684e-858c-4390-8367-0e01448b2c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d38c38f0c94b45b9803c4a929d1b85', 'request_id': 'req-cd4e684e-858c-4390-8367-0e01448b2c14'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:54.914541 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cd4e684e-858c-4390-8367-0e01448b2c14 admin admin] The token cache is being invalidate because project 32d38c38f0c94b45b9803c4a929d1b85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:36:54.914839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cd4e684e-858c-4390-8367-0e01448b2c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:54.920530 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cd4e684e-858c-4390-8367-0e01448b2c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:36:54.922314 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1148/2307] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:36:54 2022] DELETE /identity/v3/projects/32d38c38f0c94b45b9803c4a929d1b85 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:54.927402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469e4fb-9f91-4d45-b347-b32e67bb138c None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:54.927891 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469e4fb-9f91-4d45-b347-b32e67bb138c None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:54.927989 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469e4fb-9f91-4d45-b347-b32e67bb138c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:54.965464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d469e4fb-9f91-4d45-b347-b32e67bb138c None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:54.976640 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d469e4fb-9f91-4d45-b347-b32e67bb138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:55.173721 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1160/2308] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:55.181745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7d507-0ec9-406f-baca-e242233e4a3b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:55.182235 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7d507-0ec9-406f-baca-e242233e4a3b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:55.182505 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7d507-0ec9-406f-baca-e242233e4a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:55.221563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8eb7d507-0ec9-406f-baca-e242233e4a3b None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:55.227673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8eb7d507-0ec9-406f-baca-e242233e4a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:55.253205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1149/2309] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:55.257719 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469e4fb-9f91-4d45-b347-b32e67bb138c None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:55.273191 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469e4fb-9f91-4d45-b347-b32e67bb138c None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:55.291610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e76e5b-e6ef-4328-a6a3-76fa7b26da96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:55.292425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e76e5b-e6ef-4328-a6a3-76fa7b26da96 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:55.293040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e76e5b-e6ef-4328-a6a3-76fa7b26da96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:55.293040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e76e5b-e6ef-4328-a6a3-76fa7b26da96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:55.294772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e76e5b-e6ef-4328-a6a3-76fa7b26da96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:36:55.295101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e76e5b-e6ef-4328-a6a3-76fa7b26da96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:55.297649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e76e5b-e6ef-4328-a6a3-76fa7b26da96 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:55.321067 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:55.330345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1161/2310] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:36:55.334647 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7d507-0ec9-406f-baca-e242233e4a3b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:55.351943 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7d507-0ec9-406f-baca-e242233e4a3b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:55.371008 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054b287-5351-42f4-81ff-3ce001a84db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:55.371806 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054b287-5351-42f4-81ff-3ce001a84db1 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:55.371988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054b287-5351-42f4-81ff-3ce001a84db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:55.372352 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8054b287-5351-42f4-81ff-3ce001a84db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:55.373081 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054b287-5351-42f4-81ff-3ce001a84db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:55.375110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8054b287-5351-42f4-81ff-3ce001a84db1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:55.435100 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1150/2311] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:36:55 2022] POST /identity/v3/projects => generated 397 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:55.437964 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e76e5b-e6ef-4328-a6a3-76fa7b26da96 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:55.454743 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e76e5b-e6ef-4328-a6a3-76fa7b26da96 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:55.601645 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104976d8-3f70-4230-9247-25620a2b3442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:55.603438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104976d8-3f70-4230-9247-25620a2b3442 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:55.603879 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104976d8-3f70-4230-9247-25620a2b3442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:55.604325 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104976d8-3f70-4230-9247-25620a2b3442 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:55.605209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104976d8-3f70-4230-9247-25620a2b3442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:55.607933 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104976d8-3f70-4230-9247-25620a2b3442 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:55.644948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1162/2312] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:36:55 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:55.649170 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054b287-5351-42f4-81ff-3ce001a84db1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:55.665009 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8054b287-5351-42f4-81ff-3ce001a84db1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:55.670377 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7faaef0-960d-46be-bb46-fc52837de622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:55.671330 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faaef0-960d-46be-bb46-fc52837de622 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:55.671803 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faaef0-960d-46be-bb46-fc52837de622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:55.672310 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7faaef0-960d-46be-bb46-fc52837de622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:55.673743 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7faaef0-960d-46be-bb46-fc52837de622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:55.675817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7faaef0-960d-46be-bb46-fc52837de622 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:55.691383 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1151/2313] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:36:55.695695 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104976d8-3f70-4230-9247-25620a2b3442 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:55.713645 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104976d8-3f70-4230-9247-25620a2b3442 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:55.722333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57521767-be58-4a08-ab7b-ee902a86b655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:55.723483 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57521767-be58-4a08-ab7b-ee902a86b655 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:55.723964 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57521767-be58-4a08-ab7b-ee902a86b655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:55.725209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57521767-be58-4a08-ab7b-ee902a86b655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:55.726070 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57521767-be58-4a08-ab7b-ee902a86b655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:55.727908 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57521767-be58-4a08-ab7b-ee902a86b655 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:55.746319 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1163/2314] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:36:55.747626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7faaef0-960d-46be-bb46-fc52837de622 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:55.758623 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7faaef0-960d-46be-bb46-fc52837de622 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:55.762959 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec83b06-f8c1-412f-81a4-71b31f7bb25e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:55.763292 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec83b06-f8c1-412f-81a4-71b31f7bb25e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:55.763649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec83b06-f8c1-412f-81a4-71b31f7bb25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:55.764171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d2b51-05ac-4aaf-8ed1-bea0d9de31e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:55.765126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d2b51-05ac-4aaf-8ed1-bea0d9de31e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:55.765413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d2b51-05ac-4aaf-8ed1-bea0d9de31e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:55.765689 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d2b51-05ac-4aaf-8ed1-bea0d9de31e2 admin admin] PATH_INFO: `/v3/projects/a9ae9d2b48b341c4bfc1d716a91c828e/users/4a2d56ecb9a14ad59606721b2e709817/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:55.785261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d2b51-05ac-4aaf-8ed1-bea0d9de31e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ae9d2b48b341c4bfc1d716a91c828e, user_id=4a2d56ecb9a14ad59606721b2e709817, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:55.788846 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d2b51-05ac-4aaf-8ed1-bea0d9de31e2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:55.816062 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1152/2315] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:36:55 2022] PUT /identity/v3/projects/a9ae9d2b48b341c4bfc1d716a91c828e/users/4a2d56ecb9a14ad59606721b2e709817/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:55.819334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c3daa-9264-4989-a05f-50ffa8dbdc35 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:55.819627 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c3daa-9264-4989-a05f-50ffa8dbdc35 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:55.820546 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c3daa-9264-4989-a05f-50ffa8dbdc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:55.861594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-888c3daa-9264-4989-a05f-50ffa8dbdc35 None None] MFA Rules not processed for user `4a2d56ecb9a14ad59606721b2e709817`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:55.863543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-888c3daa-9264-4989-a05f-50ffa8dbdc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:55.876578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-2ec83b06-f8c1-412f-81a4-71b31f7bb25e None None] MFA Rules not processed for user `2ccee0bc7e2b41f4a2fe2a891a95b318`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:55.878723 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2ec83b06-f8c1-412f-81a4-71b31f7bb25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:55.882122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:55.976123 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1153/2316] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:36:55.979977 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1164/2317] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 16:36:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:55.987039 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c3daa-9264-4989-a05f-50ffa8dbdc35 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:55.988887 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-888c3daa-9264-4989-a05f-50ffa8dbdc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:55.995014 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec83b06-f8c1-412f-81a4-71b31f7bb25e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:55.998643 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2ec83b06-f8c1-412f-81a4-71b31f7bb25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:56.094488 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c3daa-9264-4989-a05f-50ffa8dbdc35 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:56.102465 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:56.109185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6830c1-b14f-4c1b-82e5-5547dc871db6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:56.111177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6830c1-b14f-4c1b-82e5-5547dc871db6 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:56.111678 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6830c1-b14f-4c1b-82e5-5547dc871db6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:56.112747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6830c1-b14f-4c1b-82e5-5547dc871db6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:56.134978 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6830c1-b14f-4c1b-82e5-5547dc871db6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:56.138456 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6830c1-b14f-4c1b-82e5-5547dc871db6 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:56.158432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1154/2318] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:36:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:56.260320 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec83b06-f8c1-412f-81a4-71b31f7bb25e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:56.278292 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e558ed-4e9d-49ea-a9f0-77b19b83aadb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbfcca96ad754692b3fb7f891013dafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:56.279056 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e558ed-4e9d-49ea-a9f0-77b19b83aadb service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:56.279450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e558ed-4e9d-49ea-a9f0-77b19b83aadb service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:56.279732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e558ed-4e9d-49ea-a9f0-77b19b83aadb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:56.304032 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e558ed-4e9d-49ea-a9f0-77b19b83aadb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:56.305861 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e558ed-4e9d-49ea-a9f0-77b19b83aadb service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:56.328938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1165/2319] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 16:36:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 16:36:57.200164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b14618-8e70-4525-8f05-8ded175899cc None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:57.200715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b14618-8e70-4525-8f05-8ded175899cc None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:57.200715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b14618-8e70-4525-8f05-8ded175899cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:57.264688 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-13b14618-8e70-4525-8f05-8ded175899cc None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:57.273081 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-13b14618-8e70-4525-8f05-8ded175899cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:57.420789 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1155/2320] 10.222.0.82 () {58 vars in 1016 bytes} [Fri May 27 16:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:57.497055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e558ed-4e9d-49ea-a9f0-77b19b83aadb service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:57.499582 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c6e558ed-4e9d-49ea-a9f0-77b19b83aadb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:57.692958 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e558ed-4e9d-49ea-a9f0-77b19b83aadb service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:57.701740 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13621d-d5ef-4b43-8303-2b427d9d612a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:57.702806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13621d-d5ef-4b43-8303-2b427d9d612a service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:57.703312 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13621d-d5ef-4b43-8303-2b427d9d612a service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:57.709167 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13621d-d5ef-4b43-8303-2b427d9d612a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:57.724242 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13621d-d5ef-4b43-8303-2b427d9d612a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:57.732130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13621d-d5ef-4b43-8303-2b427d9d612a service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:57.756494 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1166/2321] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:36:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:36:57.936744 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f691fc2-b87b-4530-b315-b831886dd246 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:57.937041 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f691fc2-b87b-4530-b315-b831886dd246 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:57.937321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f691fc2-b87b-4530-b315-b831886dd246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:58.013891 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7f691fc2-b87b-4530-b315-b831886dd246 None None] MFA Rules not processed for user `0945ef8063854a758b0c80748b421eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:36:58.016759 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7f691fc2-b87b-4530-b315-b831886dd246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:58.088691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:58.116389 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1156/2322] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:36:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:36:58.120488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13621d-d5ef-4b43-8303-2b427d9d612a service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:58.122057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4f13621d-d5ef-4b43-8303-2b427d9d612a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:36:58.151155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13621d-d5ef-4b43-8303-2b427d9d612a service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:58.164176 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715139cf-0dbf-4606-a7ee-ac2394748ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:58.165403 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715139cf-0dbf-4606-a7ee-ac2394748ebc admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:58.165898 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715139cf-0dbf-4606-a7ee-ac2394748ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:58.166432 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715139cf-0dbf-4606-a7ee-ac2394748ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:58.167474 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715139cf-0dbf-4606-a7ee-ac2394748ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:58.171847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715139cf-0dbf-4606-a7ee-ac2394748ebc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:58.281553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1167/2323] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:36:58 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:36:58.281772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f691fc2-b87b-4530-b315-b831886dd246 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:58.298964 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f691fc2-b87b-4530-b315-b831886dd246 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:58.490812 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a90a32-117a-4f39-b0ca-29524bb79c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:58.491901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a90a32-117a-4f39-b0ca-29524bb79c75 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:58.492383 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a90a32-117a-4f39-b0ca-29524bb79c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:58.492863 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a90a32-117a-4f39-b0ca-29524bb79c75 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:58.493790 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a90a32-117a-4f39-b0ca-29524bb79c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:58.496102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a90a32-117a-4f39-b0ca-29524bb79c75 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:58.530971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1157/2324] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:36:58 2022] POST /identity/v3/users => generated 298 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:36:58.535263 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715139cf-0dbf-4606-a7ee-ac2394748ebc admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:58.550810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715139cf-0dbf-4606-a7ee-ac2394748ebc admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:58.570866 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13379ea8-69cc-4167-82e7-f98dc9e1dc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:58.575903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13379ea8-69cc-4167-82e7-f98dc9e1dc6b admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:58.576228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13379ea8-69cc-4167-82e7-f98dc9e1dc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:58.576512 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13379ea8-69cc-4167-82e7-f98dc9e1dc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:58.585888 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13379ea8-69cc-4167-82e7-f98dc9e1dc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:58.590825 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13379ea8-69cc-4167-82e7-f98dc9e1dc6b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:58.619419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1168/2325] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:36:58.621852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a90a32-117a-4f39-b0ca-29524bb79c75 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:58.634867 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a90a32-117a-4f39-b0ca-29524bb79c75 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:58.643052 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a01c56-658e-46ac-91a0-1abbc4e17604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:58.643962 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a01c56-658e-46ac-91a0-1abbc4e17604 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:58.644376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a01c56-658e-46ac-91a0-1abbc4e17604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:58.644619 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a01c56-658e-46ac-91a0-1abbc4e17604 admin admin] PATH_INFO: `/v3/projects/7d92b051fef44fc8b4f14e2174c15c5e/users/aee2ae7200df4e17ab9d151deaf4ab9e/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:58.666932 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a01c56-658e-46ac-91a0-1abbc4e17604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d92b051fef44fc8b4f14e2174c15c5e, user_id=aee2ae7200df4e17ab9d151deaf4ab9e, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:58.670228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a01c56-658e-46ac-91a0-1abbc4e17604 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:58.770001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1158/2326] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:36:58 2022] PUT /identity/v3/projects/7d92b051fef44fc8b4f14e2174c15c5e/users/aee2ae7200df4e17ab9d151deaf4ab9e/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:36:58.774641 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13379ea8-69cc-4167-82e7-f98dc9e1dc6b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:58.787313 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13379ea8-69cc-4167-82e7-f98dc9e1dc6b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:58.880737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d8455-8666-4f07-a4f8-607910980e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:58.881437 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d8455-8666-4f07-a4f8-607910980e58 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:58.881725 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d8455-8666-4f07-a4f8-607910980e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:58.882007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d8455-8666-4f07-a4f8-607910980e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:58.882739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d8455-8666-4f07-a4f8-607910980e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:58.884406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d8455-8666-4f07-a4f8-607910980e58 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:58.892488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:36:58.904324 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1169/2327] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:36:58.909048 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a01c56-658e-46ac-91a0-1abbc4e17604 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:36:58.927069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a01c56-658e-46ac-91a0-1abbc4e17604 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:36:58.932503 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401df7c5-e4c3-46c9-864b-04253005f408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:36:58.933612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401df7c5-e4c3-46c9-864b-04253005f408 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:36:58.934047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401df7c5-e4c3-46c9-864b-04253005f408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:36:58.934442 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401df7c5-e4c3-46c9-864b-04253005f408 admin admin] PATH_INFO: `/v3/projects/7d92b051fef44fc8b4f14e2174c15c5e/users/aee2ae7200df4e17ab9d151deaf4ab9e/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:36:58.936669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401df7c5-e4c3-46c9-864b-04253005f408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d92b051fef44fc8b4f14e2174c15c5e, user_id=aee2ae7200df4e17ab9d151deaf4ab9e, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:36:58.943540 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401df7c5-e4c3-46c9-864b-04253005f408 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:36:58.967022 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1159/2328] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:36:58 2022] PUT /identity/v3/projects/7d92b051fef44fc8b4f14e2174c15c5e/users/aee2ae7200df4e17ab9d151deaf4ab9e/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:37:00.717818 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6703e27-ebb4-4272-86aa-f0714f44995e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:00.718448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6703e27-ebb4-4272-86aa-f0714f44995e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:00.718448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6703e27-ebb4-4272-86aa-f0714f44995e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:00.759049 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a6703e27-ebb4-4272-86aa-f0714f44995e None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:00.761054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a6703e27-ebb4-4272-86aa-f0714f44995e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:00.904196 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1170/2329] 10.222.0.82 () {58 vars in 1016 bytes} [Fri May 27 16:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:37:00.931421 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401df7c5-e4c3-46c9-864b-04253005f408 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:00.933397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-401df7c5-e4c3-46c9-864b-04253005f408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:01.163754 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401df7c5-e4c3-46c9-864b-04253005f408 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:01.194931 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5be835-5929-470e-9b5d-34d40efebb1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:01.195855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5be835-5929-470e-9b5d-34d40efebb1a service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:01.196517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5be835-5929-470e-9b5d-34d40efebb1a service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:01.196952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5be835-5929-470e-9b5d-34d40efebb1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:01.226494 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5be835-5929-470e-9b5d-34d40efebb1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:01.228714 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5be835-5929-470e-9b5d-34d40efebb1a service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:01.279510 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1160/2330] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:37:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:37:02.352310 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6703e27-ebb4-4272-86aa-f0714f44995e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:02.365028 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6703e27-ebb4-4272-86aa-f0714f44995e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:02.379695 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93644c3c-1e28-413b-ab86-ad2d35df5f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:02.384244 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93644c3c-1e28-413b-ab86-ad2d35df5f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:02.384878 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93644c3c-1e28-413b-ab86-ad2d35df5f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:02.386659 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93644c3c-1e28-413b-ab86-ad2d35df5f1d admin admin] PATH_INFO: `/v3/users/4a2d56ecb9a14ad59606721b2e709817` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:02.389486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93644c3c-1e28-413b-ab86-ad2d35df5f1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a2d56ecb9a14ad59606721b2e709817)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:02.396561 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93644c3c-1e28-413b-ab86-ad2d35df5f1d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:02.510535 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-93644c3c-1e28-413b-ab86-ad2d35df5f1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a2d56ecb9a14ad59606721b2e709817'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:02.511902 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-93644c3c-1e28-413b-ab86-ad2d35df5f1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a2d56ecb9a14ad59606721b2e709817'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:02.512548 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-93644c3c-1e28-413b-ab86-ad2d35df5f1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a2d56ecb9a14ad59606721b2e709817'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:02.543002 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-93644c3c-1e28-413b-ab86-ad2d35df5f1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a2d56ecb9a14ad59606721b2e709817'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:02.556057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-93644c3c-1e28-413b-ab86-ad2d35df5f1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a2d56ecb9a14ad59606721b2e709817'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:02.586975 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1171/2331] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:37:02 2022] DELETE /identity/v3/users/4a2d56ecb9a14ad59606721b2e709817 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:37:02.591714 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08580160-3b4e-4089-8957-e26d74b4bb88 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:02.592368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08580160-3b4e-4089-8957-e26d74b4bb88 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:02.592467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08580160-3b4e-4089-8957-e26d74b4bb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:02.616499 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-08580160-3b4e-4089-8957-e26d74b4bb88 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:02.619793 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-08580160-3b4e-4089-8957-e26d74b4bb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:02.681765 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:02.764331 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1161/2332] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:37:02.774194 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93644c3c-1e28-413b-ab86-ad2d35df5f1d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:02.776720 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-93644c3c-1e28-413b-ab86-ad2d35df5f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:02.947814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93644c3c-1e28-413b-ab86-ad2d35df5f1d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:02.978444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dafc2-c411-49dd-a7e9-221874302501 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:02.980040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dafc2-c411-49dd-a7e9-221874302501 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:02.980547 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dafc2-c411-49dd-a7e9-221874302501 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:02.981351 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dafc2-c411-49dd-a7e9-221874302501 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:03.083539 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691dafc2-c411-49dd-a7e9-221874302501 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:03.085864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691dafc2-c411-49dd-a7e9-221874302501 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:03.127465 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1172/2333] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:37:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:37:03.947928 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b6343-6e1c-4bd3-9c1d-7d09e3691dcd None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:03.948898 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b6343-6e1c-4bd3-9c1d-7d09e3691dcd None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:03.949058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b6343-6e1c-4bd3-9c1d-7d09e3691dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:03.982103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8b0b6343-6e1c-4bd3-9c1d-7d09e3691dcd None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:03.984037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8b0b6343-6e1c-4bd3-9c1d-7d09e3691dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:04.005022 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1162/2334] 10.222.0.82 () {58 vars in 1016 bytes} [Fri May 27 16:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:37:04.027547 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dafc2-c411-49dd-a7e9-221874302501 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:04.031588 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-691dafc2-c411-49dd-a7e9-221874302501 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:04.077822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:04.185711 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dafc2-c411-49dd-a7e9-221874302501 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:04.195700 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9a242-4cef-48a3-97a5-eb1426092f4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:04.197954 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9a242-4cef-48a3-97a5-eb1426092f4f service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:04.198892 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9a242-4cef-48a3-97a5-eb1426092f4f service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:04.199627 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9a242-4cef-48a3-97a5-eb1426092f4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:04.211034 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9a242-4cef-48a3-97a5-eb1426092f4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:04.212873 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9a242-4cef-48a3-97a5-eb1426092f4f service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:04.228312 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1173/2335] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:37:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:37:04.271660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b6343-6e1c-4bd3-9c1d-7d09e3691dcd None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:04.273560 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8b0b6343-6e1c-4bd3-9c1d-7d09e3691dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:04.295413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b6343-6e1c-4bd3-9c1d-7d09e3691dcd None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:04.306230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89a2c8-c47e-4b83-857e-420bfd22fe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:04.307666 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89a2c8-c47e-4b83-857e-420bfd22fe7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:04.308331 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89a2c8-c47e-4b83-857e-420bfd22fe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:04.308681 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89a2c8-c47e-4b83-857e-420bfd22fe7b admin admin] PATH_INFO: `/v3/projects/a9ae9d2b48b341c4bfc1d716a91c828e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:04.314491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89a2c8-c47e-4b83-857e-420bfd22fe7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ae9d2b48b341c4bfc1d716a91c828e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:04.321991 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89a2c8-c47e-4b83-857e-420bfd22fe7b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:04.430775 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8d89a2c8-c47e-4b83-857e-420bfd22fe7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ae9d2b48b341c4bfc1d716a91c828e', 'request_id': 'req-8d89a2c8-c47e-4b83-857e-420bfd22fe7b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:04.451705 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8d89a2c8-c47e-4b83-857e-420bfd22fe7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ae9d2b48b341c4bfc1d716a91c828e', 'request_id': 'req-8d89a2c8-c47e-4b83-857e-420bfd22fe7b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:04.468321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8d89a2c8-c47e-4b83-857e-420bfd22fe7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ae9d2b48b341c4bfc1d716a91c828e', 'request_id': 'req-8d89a2c8-c47e-4b83-857e-420bfd22fe7b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:04.495144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8d89a2c8-c47e-4b83-857e-420bfd22fe7b admin admin] The token cache is being invalidate because project a9ae9d2b48b341c4bfc1d716a91c828e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:37:04.495463 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8d89a2c8-c47e-4b83-857e-420bfd22fe7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:04.496437 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-8d89a2c8-c47e-4b83-857e-420bfd22fe7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:37:04.503695 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1163/2336] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:37:04 2022] DELETE /identity/v3/projects/a9ae9d2b48b341c4bfc1d716a91c828e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:37:07.934633 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648d0dc-7afa-402d-9ee6-ff81fc8b5533 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:07.935216 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648d0dc-7afa-402d-9ee6-ff81fc8b5533 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:07.935216 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648d0dc-7afa-402d-9ee6-ff81fc8b5533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:08.018165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d648d0dc-7afa-402d-9ee6-ff81fc8b5533 None None] MFA Rules not processed for user `aee2ae7200df4e17ab9d151deaf4ab9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:08.019435 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d648d0dc-7afa-402d-9ee6-ff81fc8b5533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:08.195227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1174/2337] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:37:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:37:08.204341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89a2c8-c47e-4b83-857e-420bfd22fe7b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:08.207135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8d89a2c8-c47e-4b83-857e-420bfd22fe7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:08.322128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef877d0-1ed3-4fb1-bfb6-0e1dc329153a None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:08.322548 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef877d0-1ed3-4fb1-bfb6-0e1dc329153a None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:08.322918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef877d0-1ed3-4fb1-bfb6-0e1dc329153a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:08.360972 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-eef877d0-1ed3-4fb1-bfb6-0e1dc329153a None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:08.362285 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-eef877d0-1ed3-4fb1-bfb6-0e1dc329153a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:08.420471 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89a2c8-c47e-4b83-857e-420bfd22fe7b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:08.426907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd3ace-fe9c-4b57-bbce-21e63e2a7d28 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b72987d279bf4767bad23918fc33302b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:08.427595 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd3ace-fe9c-4b57-bbce-21e63e2a7d28 service glance] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:08.427886 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd3ace-fe9c-4b57-bbce-21e63e2a7d28 service glance] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:08.428201 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd3ace-fe9c-4b57-bbce-21e63e2a7d28 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:08.430068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a0bd3ace-fe9c-4b57-bbce-21e63e2a7d28 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:08.479214 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:08.482727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1175/2338] 10.222.0.82 () {58 vars in 1016 bytes} [Fri May 27 16:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:37:08.506791 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef877d0-1ed3-4fb1-bfb6-0e1dc329153a None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:08.508560 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-eef877d0-1ed3-4fb1-bfb6-0e1dc329153a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:08.511491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd3ace-fe9c-4b57-bbce-21e63e2a7d28 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:08.513198 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd3ace-fe9c-4b57-bbce-21e63e2a7d28 service glance] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:08.529254 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1164/2339] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:37:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:37:08.559105 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:08.647204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef877d0-1ed3-4fb1-bfb6-0e1dc329153a None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:08.658378 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229f6fe-301c-4c69-9e06-598385f6ae6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:08.659990 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229f6fe-301c-4c69-9e06-598385f6ae6d service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:08.660436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229f6fe-301c-4c69-9e06-598385f6ae6d service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:08.660935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229f6fe-301c-4c69-9e06-598385f6ae6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:08.671580 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229f6fe-301c-4c69-9e06-598385f6ae6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:08.673374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229f6fe-301c-4c69-9e06-598385f6ae6d service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:08.687146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1176/2340] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:37:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:37:08.700420 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f517ca-2fe3-4c7d-a704-638f90ed941b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:08.700720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f517ca-2fe3-4c7d-a704-638f90ed941b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:08.700996 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f517ca-2fe3-4c7d-a704-638f90ed941b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:08.725349 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c0f517ca-2fe3-4c7d-a704-638f90ed941b None None] MFA Rules not processed for user `2ccee0bc7e2b41f4a2fe2a891a95b318`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:08.727294 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c0f517ca-2fe3-4c7d-a704-638f90ed941b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:08.829516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1165/2341] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 16:37:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:37:08.851142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229f6fe-301c-4c69-9e06-598385f6ae6d service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:08.852741 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b229f6fe-301c-4c69-9e06-598385f6ae6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:08.951683 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229f6fe-301c-4c69-9e06-598385f6ae6d service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:08.964998 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d47930-1d6a-4730-8ad6-645ad5f43618 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbfcca96ad754692b3fb7f891013dafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:08.966159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d47930-1d6a-4730-8ad6-645ad5f43618 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:08.966757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d47930-1d6a-4730-8ad6-645ad5f43618 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:08.967198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d47930-1d6a-4730-8ad6-645ad5f43618 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:08.982191 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d47930-1d6a-4730-8ad6-645ad5f43618 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:08.983895 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d47930-1d6a-4730-8ad6-645ad5f43618 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:08.994886 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1177/2342] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 16:37:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:37:11.701518 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f154bb-6fb9-4e28-8244-b729e2677fae None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:11.702116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f154bb-6fb9-4e28-8244-b729e2677fae None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:11.702116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f154bb-6fb9-4e28-8244-b729e2677fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:11.741897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a9f154bb-6fb9-4e28-8244-b729e2677fae None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:11.743162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a9f154bb-6fb9-4e28-8244-b729e2677fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:11.767981 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1166/2343] 10.222.0.82 () {58 vars in 1016 bytes} [Fri May 27 16:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:37:11.813634 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d47930-1d6a-4730-8ad6-645ad5f43618 service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:11.815077 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-79d47930-1d6a-4730-8ad6-645ad5f43618 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:11.851276 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d47930-1d6a-4730-8ad6-645ad5f43618 service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:11.868683 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebd860-ade4-40a7-9e28-4cf8c3f18608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:11.869643 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebd860-ade4-40a7-9e28-4cf8c3f18608 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:11.870120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebd860-ade4-40a7-9e28-4cf8c3f18608 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:11.870396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebd860-ade4-40a7-9e28-4cf8c3f18608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:11.890244 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebd860-ade4-40a7-9e28-4cf8c3f18608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:11.892347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebd860-ade4-40a7-9e28-4cf8c3f18608 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:11.934812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1178/2344] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:37:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:37:20.611883 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b90c44-f2aa-40df-9ff8-3f0a44602486 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:20.612547 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b90c44-f2aa-40df-9ff8-3f0a44602486 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:20.612547 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b90c44-f2aa-40df-9ff8-3f0a44602486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:20.630991 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-01b90c44-f2aa-40df-9ff8-3f0a44602486 None None] MFA Rules not processed for user `0945ef8063854a758b0c80748b421eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:20.632229 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-01b90c44-f2aa-40df-9ff8-3f0a44602486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:20.640045 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1167/2345] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:37:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:37:21.906204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=60 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:25.403920 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dad8ba-080c-472a-ab62-d76b27089619 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:25.404607 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dad8ba-080c-472a-ab62-d76b27089619 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:25.404607 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dad8ba-080c-472a-ab62-d76b27089619 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:25.406518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1179/2346] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 16:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:37:25.414041 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78034c32-0112-45ca-9b0d-f203b67c5e47 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:25.414565 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78034c32-0112-45ca-9b0d-f203b67c5e47 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:25.414674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78034c32-0112-45ca-9b0d-f203b67c5e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:25.456823 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-78034c32-0112-45ca-9b0d-f203b67c5e47 None None] MFA Rules not processed for user `3caa3dbc7bd24ebba28296a1eba9cefe`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:25.458388 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-78034c32-0112-45ca-9b0d-f203b67c5e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:25.469017 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1168/2347] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 16:37:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:37:25.480848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dad8ba-080c-472a-ab62-d76b27089619 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:25.492547 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dad8ba-080c-472a-ab62-d76b27089619 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:25.496226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b9c73-7c70-46a0-ad79-25fd933d0cb4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b72987d279bf4767bad23918fc33302b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:25.496879 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b9c73-7c70-46a0-ad79-25fd933d0cb4 service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:25.497153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b9c73-7c70-46a0-ad79-25fd933d0cb4 service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:25.497420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b9c73-7c70-46a0-ad79-25fd933d0cb4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:25.509482 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b9c73-7c70-46a0-ad79-25fd933d0cb4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:25.511019 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b9c73-7c70-46a0-ad79-25fd933d0cb4 service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:25.523230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1180/2348] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:37:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:37:25.597118 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5055bf-61f8-44c7-b562-4185cb6e72b6 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:25.597318 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5055bf-61f8-44c7-b562-4185cb6e72b6 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:25.597718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5055bf-61f8-44c7-b562-4185cb6e72b6 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:25.599132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1169/2349] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 16:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:37:25.604399 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63da0d-44e0-4827-a6ac-46e53d88b123 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:25.604694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63da0d-44e0-4827-a6ac-46e53d88b123 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:25.605217 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63da0d-44e0-4827-a6ac-46e53d88b123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:25.628126 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-7e63da0d-44e0-4827-a6ac-46e53d88b123 None None] MFA Rules not processed for user `6f3fe9e871b34a8faed94550e27fefd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:25.628695 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7e63da0d-44e0-4827-a6ac-46e53d88b123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:25.707394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8131d6a-23dc-4454-a415-1e64660c5644 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:25.708262 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8131d6a-23dc-4454-a415-1e64660c5644 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:25.708594 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1181/2350] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 16:37:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:37:25.709034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8131d6a-23dc-4454-a415-1e64660c5644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:25.725065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63da0d-44e0-4827-a6ac-46e53d88b123 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:25.729607 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7e63da0d-44e0-4827-a6ac-46e53d88b123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:25.736718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d8131d6a-23dc-4454-a415-1e64660c5644 None None] MFA Rules not processed for user `2ccee0bc7e2b41f4a2fe2a891a95b318`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:25.738478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d8131d6a-23dc-4454-a415-1e64660c5644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:25.746720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1170/2351] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 16:37:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:37:25.750633 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63da0d-44e0-4827-a6ac-46e53d88b123 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:25.761414 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8131d6a-23dc-4454-a415-1e64660c5644 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:25.765274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab90d3-2926-4c13-a2ea-08d94b45c138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:25.766314 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab90d3-2926-4c13-a2ea-08d94b45c138 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:25.766833 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab90d3-2926-4c13-a2ea-08d94b45c138 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:25.767287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab90d3-2926-4c13-a2ea-08d94b45c138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:25.776802 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab90d3-2926-4c13-a2ea-08d94b45c138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:25.778056 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8131d6a-23dc-4454-a415-1e64660c5644 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:25.778419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab90d3-2926-4c13-a2ea-08d94b45c138 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:25.784397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ae126-7099-47ff-9f47-1f4848b066f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbfcca96ad754692b3fb7f891013dafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:25.785061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ae126-7099-47ff-9f47-1f4848b066f1 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:25.785549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ae126-7099-47ff-9f47-1f4848b066f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:25.785832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ae126-7099-47ff-9f47-1f4848b066f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:25.796737 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ae126-7099-47ff-9f47-1f4848b066f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:25.798844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ae126-7099-47ff-9f47-1f4848b066f1 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:25.803627 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1182/2352] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:37:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:37:25.814822 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1171/2353] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 16:37:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:37:25.912513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcf14a-9c67-4dc2-92ee-f5d5f0d44217 None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:25.913051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcf14a-9c67-4dc2-92ee-f5d5f0d44217 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:25.913701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcf14a-9c67-4dc2-92ee-f5d5f0d44217 None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:25.915432 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1183/2354] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 16:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:37:25.924911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4078e6-36c0-4cd4-970a-5e393082bca4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:25.925771 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4078e6-36c0-4cd4-970a-5e393082bca4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:25.926332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4078e6-36c0-4cd4-970a-5e393082bca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:25.988525 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ac4078e6-36c0-4cd4-970a-5e393082bca4 None None] MFA Rules not processed for user `3caa3dbc7bd24ebba28296a1eba9cefe`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:25.993297 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ac4078e6-36c0-4cd4-970a-5e393082bca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:26.029678 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1172/2355] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 16:37:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:37:26.030529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcf14a-9c67-4dc2-92ee-f5d5f0d44217 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:26.055532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcf14a-9c67-4dc2-92ee-f5d5f0d44217 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:26.068286 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201f77c-9f3e-454c-84bd-516a5a7105cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:26.069942 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201f77c-9f3e-454c-84bd-516a5a7105cc service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:26.071118 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201f77c-9f3e-454c-84bd-516a5a7105cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:26.071919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201f77c-9f3e-454c-84bd-516a5a7105cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:26.087833 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201f77c-9f3e-454c-84bd-516a5a7105cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:26.089574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201f77c-9f3e-454c-84bd-516a5a7105cc service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:26.104207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1184/2356] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:37:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:37:30.059084 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39736f6-08d4-4535-b509-469710f9a11b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:30.059821 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39736f6-08d4-4535-b509-469710f9a11b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:30.060082 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39736f6-08d4-4535-b509-469710f9a11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:30.081881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b39736f6-08d4-4535-b509-469710f9a11b None None] MFA Rules not processed for user `6b9ad84784894a339e030d33301ca911`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:30.083304 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b39736f6-08d4-4535-b509-469710f9a11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:30.163273 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1173/2357] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:37:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:37:35.105171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201f77c-9f3e-454c-84bd-516a5a7105cc service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:35.106650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5201f77c-9f3e-454c-84bd-516a5a7105cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:35.234549 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201f77c-9f3e-454c-84bd-516a5a7105cc service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:35.243985 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233f55c-0158-4a47-be18-debaa093e380 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1266a87d93da4f8d9a1ccafa03067169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:35.246368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233f55c-0158-4a47-be18-debaa093e380 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:35.246588 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233f55c-0158-4a47-be18-debaa093e380 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:35.247087 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233f55c-0158-4a47-be18-debaa093e380 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:35.250975 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9233f55c-0158-4a47-be18-debaa093e380 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:35.271756 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233f55c-0158-4a47-be18-debaa093e380 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:35.273644 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233f55c-0158-4a47-be18-debaa093e380 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:35.288424 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1185/2358] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:37:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:37:39.418122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16fedc-98d2-4c5d-b9a8-1eeac2e10423 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:39.418672 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16fedc-98d2-4c5d-b9a8-1eeac2e10423 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:39.418672 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16fedc-98d2-4c5d-b9a8-1eeac2e10423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:39.425170 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:39.438621 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-fc16fedc-98d2-4c5d-b9a8-1eeac2e10423 None None] MFA Rules not processed for user `2ccee0bc7e2b41f4a2fe2a891a95b318`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:39.439954 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fc16fedc-98d2-4c5d-b9a8-1eeac2e10423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:39.449620 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1174/2359] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 16:37:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:37:39.461678 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233f55c-0158-4a47-be18-debaa093e380 service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:39.473922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233f55c-0158-4a47-be18-debaa093e380 service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:39.479912 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33a3ea-9e13-4e4b-a2a3-a2b1f92db54d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbfcca96ad754692b3fb7f891013dafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:39.480602 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33a3ea-9e13-4e4b-a2a3-a2b1f92db54d service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:39.480887 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33a3ea-9e13-4e4b-a2a3-a2b1f92db54d service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:39.481169 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33a3ea-9e13-4e4b-a2a3-a2b1f92db54d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:39.490213 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33a3ea-9e13-4e4b-a2a3-a2b1f92db54d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:39.492050 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33a3ea-9e13-4e4b-a2a3-a2b1f92db54d service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:39.500641 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1186/2360] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 16:37:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:37:49.433965 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:49.497066 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:37:57.110489 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b956801-4a80-45db-a31c-c66528e4ea55 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:57.111010 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b956801-4a80-45db-a31c-c66528e4ea55 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:57.111108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b956801-4a80-45db-a31c-c66528e4ea55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:57.130467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9b956801-4a80-45db-a31c-c66528e4ea55 None None] MFA Rules not processed for user `2ccee0bc7e2b41f4a2fe2a891a95b318`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:37:57.131793 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9b956801-4a80-45db-a31c-c66528e4ea55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:37:57.140092 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1175/2361] 10.222.0.41 () {58 vars in 967 bytes} [Fri May 27 16:37:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:37:57.153046 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33a3ea-9e13-4e4b-a2a3-a2b1f92db54d service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:57.167956 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33a3ea-9e13-4e4b-a2a3-a2b1f92db54d service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:57.174363 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23a160-9d13-4c4c-b1fb-214455bd2cc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbfcca96ad754692b3fb7f891013dafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:57.175022 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23a160-9d13-4c4c-b1fb-214455bd2cc9 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:57.175305 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23a160-9d13-4c4c-b1fb-214455bd2cc9 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:57.175577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23a160-9d13-4c4c-b1fb-214455bd2cc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:57.185372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23a160-9d13-4c4c-b1fb-214455bd2cc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:57.187373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23a160-9d13-4c4c-b1fb-214455bd2cc9 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:57.195804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1187/2362] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 16:37:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:37:59.288078 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b956801-4a80-45db-a31c-c66528e4ea55 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:37:59.303313 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b956801-4a80-45db-a31c-c66528e4ea55 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:37:59.308289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114b174-60a0-4428-9427-26cbafbbefb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:37:59.308985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114b174-60a0-4428-9427-26cbafbbefb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:37:59.309270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114b174-60a0-4428-9427-26cbafbbefb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:37:59.309541 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114b174-60a0-4428-9427-26cbafbbefb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:37:59.320189 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114b174-60a0-4428-9427-26cbafbbefb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:37:59.321649 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114b174-60a0-4428-9427-26cbafbbefb5 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:37:59.331705 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1176/2363] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:37:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:38:04.293878 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103bc9d-ba8b-402d-9617-5d9ab23d6002 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:04.293878 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103bc9d-ba8b-402d-9617-5d9ab23d6002 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:04.293878 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103bc9d-ba8b-402d-9617-5d9ab23d6002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:04.314959 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c103bc9d-ba8b-402d-9617-5d9ab23d6002 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:38:04.316151 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c103bc9d-ba8b-402d-9617-5d9ab23d6002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:38:04.326558 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1188/2364] 10.222.0.82 () {58 vars in 1016 bytes} [Fri May 27 16:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:38:04.354351 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114b174-60a0-4428-9427-26cbafbbefb5 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:38:04.370006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114b174-60a0-4428-9427-26cbafbbefb5 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:38:04.377161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce50c8-51e4-40ca-b04a-77ec12c0fa97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:38:04.377821 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce50c8-51e4-40ca-b04a-77ec12c0fa97 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:04.378188 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce50c8-51e4-40ca-b04a-77ec12c0fa97 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:04.378552 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce50c8-51e4-40ca-b04a-77ec12c0fa97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:04.388781 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce50c8-51e4-40ca-b04a-77ec12c0fa97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:38:04.391204 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce50c8-51e4-40ca-b04a-77ec12c0fa97 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:38:04.402907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1177/2365] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:38:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:38:07.591319 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befe115-3da9-4966-ba2a-700110b36eee None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:07.593029 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befe115-3da9-4966-ba2a-700110b36eee None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:07.593307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befe115-3da9-4966-ba2a-700110b36eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:07.631353 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0befe115-3da9-4966-ba2a-700110b36eee None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:38:07.632647 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0befe115-3da9-4966-ba2a-700110b36eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:38:07.641205 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1189/2366] 10.222.0.82 () {58 vars in 1016 bytes} [Fri May 27 16:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:38:07.662934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce50c8-51e4-40ca-b04a-77ec12c0fa97 service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:38:07.674543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce50c8-51e4-40ca-b04a-77ec12c0fa97 service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:38:07.681413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af497a8-f3b3-4f7a-b632-a18836805b77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:38:07.682174 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af497a8-f3b3-4f7a-b632-a18836805b77 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:07.682521 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af497a8-f3b3-4f7a-b632-a18836805b77 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:07.682799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af497a8-f3b3-4f7a-b632-a18836805b77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:07.693149 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af497a8-f3b3-4f7a-b632-a18836805b77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:38:07.694777 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af497a8-f3b3-4f7a-b632-a18836805b77 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:38:07.709182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1178/2367] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:38:10.659516 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975b1bf-e1b0-475e-968f-dd1055c7d601 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:10.659984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975b1bf-e1b0-475e-968f-dd1055c7d601 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:10.660123 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975b1bf-e1b0-475e-968f-dd1055c7d601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:10.678522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-9975b1bf-e1b0-475e-968f-dd1055c7d601 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:38:10.679722 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-9975b1bf-e1b0-475e-968f-dd1055c7d601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:38:10.687747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1190/2368] 10.222.0.82 () {58 vars in 1016 bytes} [Fri May 27 16:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:38:10.710652 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af497a8-f3b3-4f7a-b632-a18836805b77 service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:38:10.722081 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af497a8-f3b3-4f7a-b632-a18836805b77 service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:38:10.730142 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aef6be-845c-43a8-8f0e-5dac03571494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:38:10.730435 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aef6be-845c-43a8-8f0e-5dac03571494 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:10.730721 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aef6be-845c-43a8-8f0e-5dac03571494 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:10.731012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aef6be-845c-43a8-8f0e-5dac03571494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:10.740615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aef6be-845c-43a8-8f0e-5dac03571494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:38:10.742230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aef6be-845c-43a8-8f0e-5dac03571494 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:38:10.752386 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1179/2369] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:38:13.858125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650281b-51aa-463c-83b8-fdbc79a6b92f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:13.858668 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650281b-51aa-463c-83b8-fdbc79a6b92f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:13.858668 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650281b-51aa-463c-83b8-fdbc79a6b92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:13.878093 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0650281b-51aa-463c-83b8-fdbc79a6b92f None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:38:13.879325 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0650281b-51aa-463c-83b8-fdbc79a6b92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:38:13.887710 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1191/2370] 10.222.0.82 () {58 vars in 1016 bytes} [Fri May 27 16:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:38:13.911473 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aef6be-845c-43a8-8f0e-5dac03571494 service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:38:13.923262 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aef6be-845c-43a8-8f0e-5dac03571494 service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:38:13.930470 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a8268-8a0d-4201-aa0f-d2b520e30cdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:38:13.931133 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a8268-8a0d-4201-aa0f-d2b520e30cdb service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:13.931419 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a8268-8a0d-4201-aa0f-d2b520e30cdb service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:13.931724 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a8268-8a0d-4201-aa0f-d2b520e30cdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:13.941374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a8268-8a0d-4201-aa0f-d2b520e30cdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:38:13.943044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a8268-8a0d-4201-aa0f-d2b520e30cdb service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:38:13.954167 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1180/2371] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:38:17.025595 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7c208-97a6-4908-aec4-10abe675bb17 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:17.026539 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7c208-97a6-4908-aec4-10abe675bb17 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:17.026539 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7c208-97a6-4908-aec4-10abe675bb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:17.051757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-36b7c208-97a6-4908-aec4-10abe675bb17 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:38:17.053613 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-36b7c208-97a6-4908-aec4-10abe675bb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:38:17.065188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1192/2372] 10.222.0.82 () {58 vars in 1016 bytes} [Fri May 27 16:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:38:17.089548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a8268-8a0d-4201-aa0f-d2b520e30cdb service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:38:17.103185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a8268-8a0d-4201-aa0f-d2b520e30cdb service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:38:17.109605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1e7b5-4cf9-4a1f-b61e-9112289d6a81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:38:17.110276 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1e7b5-4cf9-4a1f-b61e-9112289d6a81 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:17.110563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1e7b5-4cf9-4a1f-b61e-9112289d6a81 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:17.110852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1e7b5-4cf9-4a1f-b61e-9112289d6a81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:17.125140 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1e7b5-4cf9-4a1f-b61e-9112289d6a81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:38:17.127109 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1e7b5-4cf9-4a1f-b61e-9112289d6a81 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:38:17.139997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1181/2373] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:38:22.515473 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbf8a7-9267-4f5c-9435-24dc4099406f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:22.516098 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbf8a7-9267-4f5c-9435-24dc4099406f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:22.516250 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbf8a7-9267-4f5c-9435-24dc4099406f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:22.522883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=22 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:38:22.542081 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-07bbf8a7-9267-4f5c-9435-24dc4099406f None None] MFA Rules not processed for user `2a318e87c9d6497ead119623fbf0dcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:38:22.544231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-07bbf8a7-9267-4f5c-9435-24dc4099406f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:38:22.606400 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1193/2374] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:38:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:38:27.134205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=39 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:38:32.599417 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=24 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:38:50.092063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a50597-6e29-46ee-81cf-dab141ac69c7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:50.092846 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a50597-6e29-46ee-81cf-dab141ac69c7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:50.092846 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a50597-6e29-46ee-81cf-dab141ac69c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:50.112515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b1a50597-6e29-46ee-81cf-dab141ac69c7 None None] MFA Rules not processed for user `6d3dd7ad5436451a919ef8aaf9623f83`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:38:50.113758 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b1a50597-6e29-46ee-81cf-dab141ac69c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:38:50.178540 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1182/2375] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:38:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:38:51.647036 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbf8a7-9267-4f5c-9435-24dc4099406f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:38:51.648656 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-07bbf8a7-9267-4f5c-9435-24dc4099406f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:38:51.663459 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbf8a7-9267-4f5c-9435-24dc4099406f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:38:51.668312 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990b4ab-a51d-4a94-9aa9-16bb0991d153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:38:51.669207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990b4ab-a51d-4a94-9aa9-16bb0991d153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:51.669486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990b4ab-a51d-4a94-9aa9-16bb0991d153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:51.669788 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990b4ab-a51d-4a94-9aa9-16bb0991d153 admin admin] PATH_INFO: `/v3/users/6b9ad84784894a339e030d33301ca911` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:51.671070 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990b4ab-a51d-4a94-9aa9-16bb0991d153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b9ad84784894a339e030d33301ca911)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:38:51.673083 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990b4ab-a51d-4a94-9aa9-16bb0991d153 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:38:51.733230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d990b4ab-a51d-4a94-9aa9-16bb0991d153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b9ad84784894a339e030d33301ca911'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:51.733935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d990b4ab-a51d-4a94-9aa9-16bb0991d153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b9ad84784894a339e030d33301ca911'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:51.734592 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d990b4ab-a51d-4a94-9aa9-16bb0991d153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b9ad84784894a339e030d33301ca911'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:51.747933 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d990b4ab-a51d-4a94-9aa9-16bb0991d153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b9ad84784894a339e030d33301ca911'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:51.754784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-d990b4ab-a51d-4a94-9aa9-16bb0991d153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b9ad84784894a339e030d33301ca911'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:51.769928 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1194/2376] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:38:51 2022] DELETE /identity/v3/users/6b9ad84784894a339e030d33301ca911 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:38:51.965284 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a50597-6e29-46ee-81cf-dab141ac69c7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:38:51.977213 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a50597-6e29-46ee-81cf-dab141ac69c7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:38:52.061974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c408b4-bf99-4b8d-b40d-f97a5cab8cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:38:52.063027 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c408b4-bf99-4b8d-b40d-f97a5cab8cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:38:52.063295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c408b4-bf99-4b8d-b40d-f97a5cab8cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:38:52.063599 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c408b4-bf99-4b8d-b40d-f97a5cab8cce admin admin] PATH_INFO: `/v3/projects/d890e75dc67f4687b7c4fbec1368eb03` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:38:52.065300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c408b4-bf99-4b8d-b40d-f97a5cab8cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=d890e75dc67f4687b7c4fbec1368eb03)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:38:52.067642 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c408b4-bf99-4b8d-b40d-f97a5cab8cce admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:38:52.142171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-78c408b4-bf99-4b8d-b40d-f97a5cab8cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd890e75dc67f4687b7c4fbec1368eb03', 'request_id': 'req-78c408b4-bf99-4b8d-b40d-f97a5cab8cce'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:52.148174 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-78c408b4-bf99-4b8d-b40d-f97a5cab8cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd890e75dc67f4687b7c4fbec1368eb03', 'request_id': 'req-78c408b4-bf99-4b8d-b40d-f97a5cab8cce'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:52.165273 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-78c408b4-bf99-4b8d-b40d-f97a5cab8cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd890e75dc67f4687b7c4fbec1368eb03', 'request_id': 'req-78c408b4-bf99-4b8d-b40d-f97a5cab8cce'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:52.180261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-78c408b4-bf99-4b8d-b40d-f97a5cab8cce admin admin] The token cache is being invalidate because project d890e75dc67f4687b7c4fbec1368eb03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:38:52.180566 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-78c408b4-bf99-4b8d-b40d-f97a5cab8cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:52.181388 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-78c408b4-bf99-4b8d-b40d-f97a5cab8cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:38:52.188226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1183/2377] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:38:51 2022] DELETE /identity/v3/projects/d890e75dc67f4687b7c4fbec1368eb03 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:39:01.765928 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:02.176147 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:16.103399 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31456061-e30b-4eaa-b723-27dcb284d524 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:16.104251 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31456061-e30b-4eaa-b723-27dcb284d524 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:16.104251 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31456061-e30b-4eaa-b723-27dcb284d524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:16.127505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-31456061-e30b-4eaa-b723-27dcb284d524 None None] MFA Rules not processed for user `2ecad16f09f54327b78aab5b06f9872a`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:39:16.128832 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-31456061-e30b-4eaa-b723-27dcb284d524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:16.186126 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1195/2378] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:39:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:39:26.178550 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=25 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:31.246295 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c408b4-bf99-4b8d-b40d-f97a5cab8cce admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:31.247986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-78c408b4-bf99-4b8d-b40d-f97a5cab8cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:31.323442 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c408b4-bf99-4b8d-b40d-f97a5cab8cce admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:31.330622 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13372d89-6ef6-4e60-8d5f-da4bd4535064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:31.331591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13372d89-6ef6-4e60-8d5f-da4bd4535064 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:31.332323 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13372d89-6ef6-4e60-8d5f-da4bd4535064 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:31.332816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13372d89-6ef6-4e60-8d5f-da4bd4535064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:31.334893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-13372d89-6ef6-4e60-8d5f-da4bd4535064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:31.438189 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13372d89-6ef6-4e60-8d5f-da4bd4535064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:31.441814 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13372d89-6ef6-4e60-8d5f-da4bd4535064 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:31.458816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1184/2379] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:39:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:39:32.580688 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31456061-e30b-4eaa-b723-27dcb284d524 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:32.583387 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-31456061-e30b-4eaa-b723-27dcb284d524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:32.615078 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31456061-e30b-4eaa-b723-27dcb284d524 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:32.622652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ee59b-fda7-4692-bf6e-ed76b5a77b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:32.624255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ee59b-fda7-4692-bf6e-ed76b5a77b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:32.624759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ee59b-fda7-4692-bf6e-ed76b5a77b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:32.625241 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ee59b-fda7-4692-bf6e-ed76b5a77b0b admin admin] PATH_INFO: `/v3/users/2a318e87c9d6497ead119623fbf0dcc1` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:32.627283 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ee59b-fda7-4692-bf6e-ed76b5a77b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a318e87c9d6497ead119623fbf0dcc1)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:32.629841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ee59b-fda7-4692-bf6e-ed76b5a77b0b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:32.686130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-641ee59b-fda7-4692-bf6e-ed76b5a77b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a318e87c9d6497ead119623fbf0dcc1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:32.686879 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-641ee59b-fda7-4692-bf6e-ed76b5a77b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a318e87c9d6497ead119623fbf0dcc1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:32.687396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-641ee59b-fda7-4692-bf6e-ed76b5a77b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a318e87c9d6497ead119623fbf0dcc1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:32.701805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-641ee59b-fda7-4692-bf6e-ed76b5a77b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a318e87c9d6497ead119623fbf0dcc1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:32.709338 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-641ee59b-fda7-4692-bf6e-ed76b5a77b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a318e87c9d6497ead119623fbf0dcc1'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:32.725144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1196/2380] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:39:32 2022] DELETE /identity/v3/users/2a318e87c9d6497ead119623fbf0dcc1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:39:32.919468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13372d89-6ef6-4e60-8d5f-da4bd4535064 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:32.931244 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13372d89-6ef6-4e60-8d5f-da4bd4535064 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:33.003223 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ad75f-f747-45ef-a994-e846aa616461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:33.004620 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ad75f-f747-45ef-a994-e846aa616461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:33.004620 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ad75f-f747-45ef-a994-e846aa616461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:33.004825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ad75f-f747-45ef-a994-e846aa616461 admin admin] PATH_INFO: `/v3/projects/05ea724506e84778ba750711c932db9d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:33.006047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ad75f-f747-45ef-a994-e846aa616461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ea724506e84778ba750711c932db9d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:33.008131 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ad75f-f747-45ef-a994-e846aa616461 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:33.059484 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f70ad75f-f747-45ef-a994-e846aa616461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ea724506e84778ba750711c932db9d', 'request_id': 'req-f70ad75f-f747-45ef-a994-e846aa616461'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:33.061726 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:33.068629 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f70ad75f-f747-45ef-a994-e846aa616461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ea724506e84778ba750711c932db9d', 'request_id': 'req-f70ad75f-f747-45ef-a994-e846aa616461'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:33.078996 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f70ad75f-f747-45ef-a994-e846aa616461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ea724506e84778ba750711c932db9d', 'request_id': 'req-f70ad75f-f747-45ef-a994-e846aa616461'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:33.092599 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f70ad75f-f747-45ef-a994-e846aa616461 admin admin] The token cache is being invalidate because project 05ea724506e84778ba750711c932db9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:39:33.093544 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f70ad75f-f747-45ef-a994-e846aa616461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:33.094422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f70ad75f-f747-45ef-a994-e846aa616461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:33.096030 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1185/2381] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:39:32 2022] DELETE /identity/v3/projects/05ea724506e84778ba750711c932db9d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:39:33.101685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9ae7f-fafb-4246-a135-f0692dbd1ad6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:33.101932 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9ae7f-fafb-4246-a135-f0692dbd1ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:33.102215 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9ae7f-fafb-4246-a135-f0692dbd1ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:33.121141 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-fbe9ae7f-fafb-4246-a135-f0692dbd1ad6 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:39:33.122347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fbe9ae7f-fafb-4246-a135-f0692dbd1ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:33.184040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1197/2382] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:39:33.192033 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d013820-5ff6-457c-8389-49960122e952 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:33.192033 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d013820-5ff6-457c-8389-49960122e952 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:33.192312 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d013820-5ff6-457c-8389-49960122e952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:33.212362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-9d013820-5ff6-457c-8389-49960122e952 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:39:33.213571 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-9d013820-5ff6-457c-8389-49960122e952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:33.222163 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1186/2383] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:39:33.227528 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9ae7f-fafb-4246-a135-f0692dbd1ad6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:33.239603 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9ae7f-fafb-4246-a135-f0692dbd1ad6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:33.287701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40988f-25fa-4a4c-ac43-5f09d0e0983f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:33.288759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40988f-25fa-4a4c-ac43-5f09d0e0983f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:33.288948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40988f-25fa-4a4c-ac43-5f09d0e0983f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:33.289226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40988f-25fa-4a4c-ac43-5f09d0e0983f admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:33.290738 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40988f-25fa-4a4c-ac43-5f09d0e0983f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:39:33.291063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40988f-25fa-4a4c-ac43-5f09d0e0983f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:33.292775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40988f-25fa-4a4c-ac43-5f09d0e0983f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:33.316181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1198/2384] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:39:33.318574 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d013820-5ff6-457c-8389-49960122e952 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:33.329613 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d013820-5ff6-457c-8389-49960122e952 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:33.335344 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2b936-62aa-4a48-a626-3601e7228101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:33.336507 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2b936-62aa-4a48-a626-3601e7228101 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:33.336507 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2b936-62aa-4a48-a626-3601e7228101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:33.336980 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2b936-62aa-4a48-a626-3601e7228101 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:33.338118 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2b936-62aa-4a48-a626-3601e7228101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:33.341473 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2b936-62aa-4a48-a626-3601e7228101 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:33.389486 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1187/2385] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:39:33 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:39:33.390671 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40988f-25fa-4a4c-ac43-5f09d0e0983f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:33.409722 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40988f-25fa-4a4c-ac43-5f09d0e0983f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:33.529226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71003dda-d9a8-4f1d-93bc-017fd2868e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:33.529929 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71003dda-d9a8-4f1d-93bc-017fd2868e36 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:33.530423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71003dda-d9a8-4f1d-93bc-017fd2868e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:33.530897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71003dda-d9a8-4f1d-93bc-017fd2868e36 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:33.533006 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71003dda-d9a8-4f1d-93bc-017fd2868e36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:33.536729 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71003dda-d9a8-4f1d-93bc-017fd2868e36 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:33.551968 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:33.586063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1199/2386] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:39:33 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:39:33.586674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2b936-62aa-4a48-a626-3601e7228101 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:33.602739 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2b936-62aa-4a48-a626-3601e7228101 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:33.608467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968db816-b551-4957-a478-0b1b7b04c088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:33.609313 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968db816-b551-4957-a478-0b1b7b04c088 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:33.609594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968db816-b551-4957-a478-0b1b7b04c088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:33.610510 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968db816-b551-4957-a478-0b1b7b04c088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:33.612071 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968db816-b551-4957-a478-0b1b7b04c088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:33.614194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968db816-b551-4957-a478-0b1b7b04c088 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:33.635671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1188/2387] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:39:33.639939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71003dda-d9a8-4f1d-93bc-017fd2868e36 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:33.657670 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71003dda-d9a8-4f1d-93bc-017fd2868e36 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:33.672335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f627cd1-c00d-445d-8470-24d70657ea2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:33.673547 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f627cd1-c00d-445d-8470-24d70657ea2c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:33.673547 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f627cd1-c00d-445d-8470-24d70657ea2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:33.673765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f627cd1-c00d-445d-8470-24d70657ea2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:33.674452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f627cd1-c00d-445d-8470-24d70657ea2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:33.677139 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f627cd1-c00d-445d-8470-24d70657ea2c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:33.705359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1200/2388] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:39:33.711813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968db816-b551-4957-a478-0b1b7b04c088 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:33.724121 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968db816-b551-4957-a478-0b1b7b04c088 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:33.732286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b678c94-a40e-4172-87b5-9d998a727ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:33.733217 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b678c94-a40e-4172-87b5-9d998a727ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:33.733637 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b678c94-a40e-4172-87b5-9d998a727ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:33.734005 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b678c94-a40e-4172-87b5-9d998a727ffc admin admin] PATH_INFO: `/v3/projects/51ed0152b4a14210b54391ed5fb1f02e/users/b6264de254d24c43932f28527bea4acc/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:33.753340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b678c94-a40e-4172-87b5-9d998a727ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ed0152b4a14210b54391ed5fb1f02e, user_id=b6264de254d24c43932f28527bea4acc, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:33.757621 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b678c94-a40e-4172-87b5-9d998a727ffc admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:33.786564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1189/2389] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:39:33 2022] PUT /identity/v3/projects/51ed0152b4a14210b54391ed5fb1f02e/users/b6264de254d24c43932f28527bea4acc/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:39:33.787465 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfb929-e8f1-418c-bb75-303a864d5acd None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:33.787759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfb929-e8f1-418c-bb75-303a864d5acd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:33.788112 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfb929-e8f1-418c-bb75-303a864d5acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:33.814308 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-dbdfb929-e8f1-418c-bb75-303a864d5acd None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:39:33.815988 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dbdfb929-e8f1-418c-bb75-303a864d5acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:33.894149 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1201/2390] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:39:33.909944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b678c94-a40e-4172-87b5-9d998a727ffc admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:33.913055 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6b678c94-a40e-4172-87b5-9d998a727ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:33.981405 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b678c94-a40e-4172-87b5-9d998a727ffc admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:33.985771 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1f8c6-08cc-48fb-9ed4-aee57d4a9df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:33.986448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1f8c6-08cc-48fb-9ed4-aee57d4a9df1 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:33.986727 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1f8c6-08cc-48fb-9ed4-aee57d4a9df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:33.987002 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1f8c6-08cc-48fb-9ed4-aee57d4a9df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:34.001144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1f8c6-08cc-48fb-9ed4-aee57d4a9df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:34.002778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1f8c6-08cc-48fb-9ed4-aee57d4a9df1 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:34.015026 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1190/2391] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:39:35.147723 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfb929-e8f1-418c-bb75-303a864d5acd None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:35.149251 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dbdfb929-e8f1-418c-bb75-303a864d5acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:35.272284 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfb929-e8f1-418c-bb75-303a864d5acd None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:35.281021 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024d3f3-f797-4d0d-b037-7b72ca277209 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:35.282134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024d3f3-f797-4d0d-b037-7b72ca277209 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:35.282629 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024d3f3-f797-4d0d-b037-7b72ca277209 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:35.283267 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024d3f3-f797-4d0d-b037-7b72ca277209 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:35.289352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a024d3f3-f797-4d0d-b037-7b72ca277209 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:35.425634 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024d3f3-f797-4d0d-b037-7b72ca277209 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:35.427144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024d3f3-f797-4d0d-b037-7b72ca277209 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:35.439869 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1202/2392] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:39:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:39:36.933222 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1f8c6-08cc-48fb-9ed4-aee57d4a9df1 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:36.934675 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6ec1f8c6-08cc-48fb-9ed4-aee57d4a9df1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:36.981163 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1f8c6-08cc-48fb-9ed4-aee57d4a9df1 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:36.993744 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d21b8-c67a-4523-9bc6-e91396174c1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:36.994427 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d21b8-c67a-4523-9bc6-e91396174c1b service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:36.994711 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d21b8-c67a-4523-9bc6-e91396174c1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:36.995173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d21b8-c67a-4523-9bc6-e91396174c1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:36.997071 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ad9d21b8-c67a-4523-9bc6-e91396174c1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:37.018642 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d21b8-c67a-4523-9bc6-e91396174c1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:37.020875 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d21b8-c67a-4523-9bc6-e91396174c1b service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:37.038557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1191/2393] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:39:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:39:38.787402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eed85f-fa4e-40c3-8f0e-a98f054d471b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:38.787947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eed85f-fa4e-40c3-8f0e-a98f054d471b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:38.787947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eed85f-fa4e-40c3-8f0e-a98f054d471b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:38.822354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-78eed85f-fa4e-40c3-8f0e-a98f054d471b None None] MFA Rules not processed for user `b6264de254d24c43932f28527bea4acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:39:38.823597 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-78eed85f-fa4e-40c3-8f0e-a98f054d471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:38.838478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:38.896166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1203/2394] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:39:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:39:38.911041 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d21b8-c67a-4523-9bc6-e91396174c1b service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:38.912516 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ad9d21b8-c67a-4523-9bc6-e91396174c1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:38.926830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d21b8-c67a-4523-9bc6-e91396174c1b service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:38.932956 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24fe130-6432-4500-bf33-40203e769069 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:38.933688 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fe130-6432-4500-bf33-40203e769069 service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:38.933975 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fe130-6432-4500-bf33-40203e769069 service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:38.934281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fe130-6432-4500-bf33-40203e769069 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:38.943585 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24fe130-6432-4500-bf33-40203e769069 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:38.945319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24fe130-6432-4500-bf33-40203e769069 service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:38.956176 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1192/2395] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:39:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:39:40.645482 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ef20f-bf99-4196-9277-233d6fb32894 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:40.646040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ef20f-bf99-4196-9277-233d6fb32894 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:40.646140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ef20f-bf99-4196-9277-233d6fb32894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:40.664983 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-765ef20f-bf99-4196-9277-233d6fb32894 None None] MFA Rules not processed for user `b6264de254d24c43932f28527bea4acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:39:40.666187 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-765ef20f-bf99-4196-9277-233d6fb32894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:40.673399 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1204/2396] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:39:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:39:41.006695 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24fe130-6432-4500-bf33-40203e769069 service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:41.008246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a24fe130-6432-4500-bf33-40203e769069 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:41.023232 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24fe130-6432-4500-bf33-40203e769069 service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:41.028966 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c548a12-7d35-4620-8ec9-15bd98cc1e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:41.030118 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c548a12-7d35-4620-8ec9-15bd98cc1e2c service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:41.030647 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c548a12-7d35-4620-8ec9-15bd98cc1e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:41.031077 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c548a12-7d35-4620-8ec9-15bd98cc1e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:41.035082 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4c548a12-7d35-4620-8ec9-15bd98cc1e2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:41.049184 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c548a12-7d35-4620-8ec9-15bd98cc1e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:41.051747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c548a12-7d35-4620-8ec9-15bd98cc1e2c service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:41.062513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1193/2397] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:39:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:39:41.637880 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ef20f-bf99-4196-9277-233d6fb32894 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:41.639559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-765ef20f-bf99-4196-9277-233d6fb32894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:41.725219 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ef20f-bf99-4196-9277-233d6fb32894 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:41.734840 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ca475-f4e8-49db-9c83-845e7461a581 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1266a87d93da4f8d9a1ccafa03067169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:41.735851 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ca475-f4e8-49db-9c83-845e7461a581 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:41.736770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ca475-f4e8-49db-9c83-845e7461a581 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:41.737269 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ca475-f4e8-49db-9c83-845e7461a581 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:41.739926 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-766ca475-f4e8-49db-9c83-845e7461a581 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:41.755756 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ca475-f4e8-49db-9c83-845e7461a581 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:41.757630 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ca475-f4e8-49db-9c83-845e7461a581 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:41.769689 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1205/2398] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:39:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:39:42.607052 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dd787-cef6-46ba-bcd1-c081573bfa4b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:42.607539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dd787-cef6-46ba-bcd1-c081573bfa4b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:42.607665 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dd787-cef6-46ba-bcd1-c081573bfa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:42.626774 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2f4dd787-cef6-46ba-bcd1-c081573bfa4b None None] MFA Rules not processed for user `2ccee0bc7e2b41f4a2fe2a891a95b318`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:39:42.627988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2f4dd787-cef6-46ba-bcd1-c081573bfa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:42.667425 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:42.700107 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1194/2399] 10.222.0.41 () {58 vars in 967 bytes} [Fri May 27 16:39:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:39:42.765638 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ca475-f4e8-49db-9c83-845e7461a581 service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:42.767638 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-766ca475-f4e8-49db-9c83-845e7461a581 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:42.852108 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ca475-f4e8-49db-9c83-845e7461a581 service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:42.857889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a1cb2-e869-44ef-bab8-3235093b1597 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbfcca96ad754692b3fb7f891013dafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:42.858833 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a1cb2-e869-44ef-bab8-3235093b1597 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:42.859268 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a1cb2-e869-44ef-bab8-3235093b1597 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:42.859712 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a1cb2-e869-44ef-bab8-3235093b1597 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:42.870583 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a1cb2-e869-44ef-bab8-3235093b1597 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:42.872567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a1cb2-e869-44ef-bab8-3235093b1597 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:42.886128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1206/2400] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 16:39:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:39:50.564853 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dd787-cef6-46ba-bcd1-c081573bfa4b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:50.573208 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2f4dd787-cef6-46ba-bcd1-c081573bfa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:50.589585 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dd787-cef6-46ba-bcd1-c081573bfa4b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:50.595303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd0b51-092d-441e-bc1c-bac6159f7a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:50.596257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd0b51-092d-441e-bc1c-bac6159f7a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:50.596538 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd0b51-092d-441e-bc1c-bac6159f7a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:50.596805 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd0b51-092d-441e-bc1c-bac6159f7a83 admin admin] PATH_INFO: `/v3/users/0945ef8063854a758b0c80748b421eb1` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:50.598191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd0b51-092d-441e-bc1c-bac6159f7a83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0945ef8063854a758b0c80748b421eb1)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:50.600203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd0b51-092d-441e-bc1c-bac6159f7a83 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:50.652769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b5dd0b51-092d-441e-bc1c-bac6159f7a83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0945ef8063854a758b0c80748b421eb1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:50.663928 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b5dd0b51-092d-441e-bc1c-bac6159f7a83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0945ef8063854a758b0c80748b421eb1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:50.678544 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b5dd0b51-092d-441e-bc1c-bac6159f7a83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0945ef8063854a758b0c80748b421eb1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:50.686200 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b5dd0b51-092d-441e-bc1c-bac6159f7a83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0945ef8063854a758b0c80748b421eb1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:50.686997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-b5dd0b51-092d-441e-bc1c-bac6159f7a83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0945ef8063854a758b0c80748b421eb1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:50.694441 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1195/2401] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:39:50 2022] DELETE /identity/v3/users/0945ef8063854a758b0c80748b421eb1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:39:50.893700 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a1cb2-e869-44ef-bab8-3235093b1597 service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:50.906814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a1cb2-e869-44ef-bab8-3235093b1597 service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:50.934437 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:50.977584 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc19eb-9157-4716-80be-0edc4783f8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:50.978457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc19eb-9157-4716-80be-0edc4783f8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:50.978743 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc19eb-9157-4716-80be-0edc4783f8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:50.979043 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc19eb-9157-4716-80be-0edc4783f8c7 admin admin] PATH_INFO: `/v3/projects/4465a892445b4e809c03d7f2b9b57466` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:50.980322 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc19eb-9157-4716-80be-0edc4783f8c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4465a892445b4e809c03d7f2b9b57466)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:50.982263 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc19eb-9157-4716-80be-0edc4783f8c7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:51.031372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b9dc19eb-9157-4716-80be-0edc4783f8c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4465a892445b4e809c03d7f2b9b57466', 'request_id': 'req-b9dc19eb-9157-4716-80be-0edc4783f8c7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:51.040958 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b9dc19eb-9157-4716-80be-0edc4783f8c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4465a892445b4e809c03d7f2b9b57466', 'request_id': 'req-b9dc19eb-9157-4716-80be-0edc4783f8c7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:51.047172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b9dc19eb-9157-4716-80be-0edc4783f8c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4465a892445b4e809c03d7f2b9b57466', 'request_id': 'req-b9dc19eb-9157-4716-80be-0edc4783f8c7'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:51.061384 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b9dc19eb-9157-4716-80be-0edc4783f8c7 admin admin] The token cache is being invalidate because project 4465a892445b4e809c03d7f2b9b57466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:39:51.061384 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b9dc19eb-9157-4716-80be-0edc4783f8c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:51.062212 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b9dc19eb-9157-4716-80be-0edc4783f8c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:51.067786 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1207/2402] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:39:50 2022] DELETE /identity/v3/projects/4465a892445b4e809c03d7f2b9b57466 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:39:51.069077 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd0b51-092d-441e-bc1c-bac6159f7a83 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:51.070510 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b5dd0b51-092d-441e-bc1c-bac6159f7a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:51.085199 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd0b51-092d-441e-bc1c-bac6159f7a83 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:51.153563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8314b-16b1-4cbf-bdec-48905263547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:51.154456 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8314b-16b1-4cbf-bdec-48905263547a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:51.154739 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8314b-16b1-4cbf-bdec-48905263547a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:51.155013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8314b-16b1-4cbf-bdec-48905263547a admin admin] PATH_INFO: `/v3/users/aee2ae7200df4e17ab9d151deaf4ab9e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:51.156337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8314b-16b1-4cbf-bdec-48905263547a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee2ae7200df4e17ab9d151deaf4ab9e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:51.158338 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8314b-16b1-4cbf-bdec-48905263547a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:51.212277 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6fa8314b-16b1-4cbf-bdec-48905263547a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee2ae7200df4e17ab9d151deaf4ab9e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:51.214670 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc19eb-9157-4716-80be-0edc4783f8c7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:51.216116 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b9dc19eb-9157-4716-80be-0edc4783f8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:51.222820 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6fa8314b-16b1-4cbf-bdec-48905263547a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee2ae7200df4e17ab9d151deaf4ab9e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:51.228148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:51.237992 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6fa8314b-16b1-4cbf-bdec-48905263547a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee2ae7200df4e17ab9d151deaf4ab9e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:51.248243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6fa8314b-16b1-4cbf-bdec-48905263547a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee2ae7200df4e17ab9d151deaf4ab9e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:51.249145 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6fa8314b-16b1-4cbf-bdec-48905263547a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee2ae7200df4e17ab9d151deaf4ab9e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:51.257448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1196/2403] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:39:51 2022] DELETE /identity/v3/users/aee2ae7200df4e17ab9d151deaf4ab9e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:39:51.309859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc19eb-9157-4716-80be-0edc4783f8c7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:51.367235 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:39:51.388602 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32710d4-3cdc-4ccd-a58d-87693f4bfc00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:51.389407 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32710d4-3cdc-4ccd-a58d-87693f4bfc00 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:51.389735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32710d4-3cdc-4ccd-a58d-87693f4bfc00 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:51.390070 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32710d4-3cdc-4ccd-a58d-87693f4bfc00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:51.391935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a32710d4-3cdc-4ccd-a58d-87693f4bfc00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:51.463999 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8314b-16b1-4cbf-bdec-48905263547a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:51.464317 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32710d4-3cdc-4ccd-a58d-87693f4bfc00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:51.465625 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6fa8314b-16b1-4cbf-bdec-48905263547a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:51.466174 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32710d4-3cdc-4ccd-a58d-87693f4bfc00 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:51.477982 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1208/2404] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:39:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:39:51.561916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8314b-16b1-4cbf-bdec-48905263547a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:51.568523 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ceebd-81e1-4bdd-bcc6-1549c63e2282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:51.570147 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ceebd-81e1-4bdd-bcc6-1549c63e2282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:51.570936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ceebd-81e1-4bdd-bcc6-1549c63e2282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:51.571841 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ceebd-81e1-4bdd-bcc6-1549c63e2282 admin admin] PATH_INFO: `/v3/projects/7d92b051fef44fc8b4f14e2174c15c5e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:51.573484 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ceebd-81e1-4bdd-bcc6-1549c63e2282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d92b051fef44fc8b4f14e2174c15c5e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:51.576533 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ceebd-81e1-4bdd-bcc6-1549c63e2282 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:51.643598 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb1ceebd-81e1-4bdd-bcc6-1549c63e2282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d92b051fef44fc8b4f14e2174c15c5e', 'request_id': 'req-fb1ceebd-81e1-4bdd-bcc6-1549c63e2282'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:51.651440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb1ceebd-81e1-4bdd-bcc6-1549c63e2282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d92b051fef44fc8b4f14e2174c15c5e', 'request_id': 'req-fb1ceebd-81e1-4bdd-bcc6-1549c63e2282'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:51.663808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb1ceebd-81e1-4bdd-bcc6-1549c63e2282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d92b051fef44fc8b4f14e2174c15c5e', 'request_id': 'req-fb1ceebd-81e1-4bdd-bcc6-1549c63e2282'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:51.676833 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb1ceebd-81e1-4bdd-bcc6-1549c63e2282 admin admin] The token cache is being invalidate because project 7d92b051fef44fc8b4f14e2174c15c5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:39:51.677266 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb1ceebd-81e1-4bdd-bcc6-1549c63e2282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:51.677972 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb1ceebd-81e1-4bdd-bcc6-1549c63e2282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:39:51.680705 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1197/2405] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:39:51 2022] DELETE /identity/v3/projects/7d92b051fef44fc8b4f14e2174c15c5e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:39:52.152342 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32710d4-3cdc-4ccd-a58d-87693f4bfc00 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:39:52.153934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a32710d4-3cdc-4ccd-a58d-87693f4bfc00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:52.215358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32710d4-3cdc-4ccd-a58d-87693f4bfc00 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:39:52.269921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d5ae9-842f-45f4-b0c4-4488c9b04a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:39:52.270651 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d5ae9-842f-45f4-b0c4-4488c9b04a55 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:39:52.270934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d5ae9-842f-45f4-b0c4-4488c9b04a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:39:52.271204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d5ae9-842f-45f4-b0c4-4488c9b04a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:39:52.273289 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a05d5ae9-842f-45f4-b0c4-4488c9b04a55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:39:52.282723 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d5ae9-842f-45f4-b0c4-4488c9b04a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:39:52.284207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d5ae9-842f-45f4-b0c4-4488c9b04a55 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:39:52.292915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1209/2406] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:39:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:01.673397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=9,keystone:SELECT=60,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:02.289198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=79 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:04.932422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a012c-20f7-453a-a7d3-35948356ce66 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:04.932959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a012c-20f7-453a-a7d3-35948356ce66 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:04.932959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a012c-20f7-453a-a7d3-35948356ce66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:04.955659 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7d7a012c-20f7-453a-a7d3-35948356ce66 None None] MFA Rules not processed for user `2ccee0bc7e2b41f4a2fe2a891a95b318`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:04.956996 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7d7a012c-20f7-453a-a7d3-35948356ce66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:05.019564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1198/2407] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 16:40:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:05.036091 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d5ae9-842f-45f4-b0c4-4488c9b04a55 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:05.037699 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a05d5ae9-842f-45f4-b0c4-4488c9b04a55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:05.125240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d5ae9-842f-45f4-b0c4-4488c9b04a55 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:05.130483 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143510d1-72c9-461e-aa16-e1936ad85f1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbfcca96ad754692b3fb7f891013dafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:05.131135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143510d1-72c9-461e-aa16-e1936ad85f1f service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:05.131442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143510d1-72c9-461e-aa16-e1936ad85f1f service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:05.131755 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143510d1-72c9-461e-aa16-e1936ad85f1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:05.142778 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143510d1-72c9-461e-aa16-e1936ad85f1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:05.144826 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143510d1-72c9-461e-aa16-e1936ad85f1f service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:05.154251 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1210/2408] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 16:40:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:40:05.458070 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a012c-20f7-453a-a7d3-35948356ce66 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:05.459468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7d7a012c-20f7-453a-a7d3-35948356ce66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:05.566448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a012c-20f7-453a-a7d3-35948356ce66 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:05.576053 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87681c3-dced-4666-8032-385fad7e64cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:05.576377 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87681c3-dced-4666-8032-385fad7e64cf service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:05.576671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87681c3-dced-4666-8032-385fad7e64cf service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:05.576947 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87681c3-dced-4666-8032-385fad7e64cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:05.579131 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a87681c3-dced-4666-8032-385fad7e64cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:05.660380 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87681c3-dced-4666-8032-385fad7e64cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:05.662230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87681c3-dced-4666-8032-385fad7e64cf service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:05.685547 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1199/2409] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:15.150605 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=32 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:15.669558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=81 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:19.816465 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143510d1-72c9-461e-aa16-e1936ad85f1f service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:19.827331 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87681c3-dced-4666-8032-385fad7e64cf service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:19.829649 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a87681c3-dced-4666-8032-385fad7e64cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:19.846137 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87681c3-dced-4666-8032-385fad7e64cf service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:19.851211 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143510d1-72c9-461e-aa16-e1936ad85f1f service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:19.853165 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03925af-27ab-408d-bf74-497bd4e88761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:19.853865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03925af-27ab-408d-bf74-497bd4e88761 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:19.854822 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03925af-27ab-408d-bf74-497bd4e88761 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:19.855127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03925af-27ab-408d-bf74-497bd4e88761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:19.858106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f03925af-27ab-408d-bf74-497bd4e88761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:19.870881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f949e1c-31b9-420b-a7a3-7335a355ec06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:19.872664 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f949e1c-31b9-420b-a7a3-7335a355ec06 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:19.873509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f949e1c-31b9-420b-a7a3-7335a355ec06 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:19.874432 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f949e1c-31b9-420b-a7a3-7335a355ec06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:19.879938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7f949e1c-31b9-420b-a7a3-7335a355ec06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:19.886446 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03925af-27ab-408d-bf74-497bd4e88761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:19.889234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03925af-27ab-408d-bf74-497bd4e88761 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:19.904669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f949e1c-31b9-420b-a7a3-7335a355ec06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:19.905520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1200/2410] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:40:19.907568 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f949e1c-31b9-420b-a7a3-7335a355ec06 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:19.923172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1211/2411] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:20.061612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a753c-f2a1-461b-b676-2d2fad8dded0 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:20.061989 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a753c-f2a1-461b-b676-2d2fad8dded0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:20.062549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a753c-f2a1-461b-b676-2d2fad8dded0 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:20.064367 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1201/2412] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 16:40:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:40:20.074813 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a4006-96f5-4afe-9ba4-a1636ae493f1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:20.076056 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a4006-96f5-4afe-9ba4-a1636ae493f1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:20.076056 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a4006-96f5-4afe-9ba4-a1636ae493f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:20.117867 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-8d9a4006-96f5-4afe-9ba4-a1636ae493f1 None None] MFA Rules not processed for user `3caa3dbc7bd24ebba28296a1eba9cefe`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:20.120465 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8d9a4006-96f5-4afe-9ba4-a1636ae493f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:20.137296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1212/2413] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 16:40:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:40:20.154630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a753c-f2a1-461b-b676-2d2fad8dded0 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:20.156685 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-be1a753c-f2a1-461b-b676-2d2fad8dded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:20.254741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a753c-f2a1-461b-b676-2d2fad8dded0 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:20.259877 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76deb05-9081-45b7-9d2a-e703c02fdaa1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b72987d279bf4767bad23918fc33302b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:20.260757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76deb05-9081-45b7-9d2a-e703c02fdaa1 service glance] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:20.261050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76deb05-9081-45b7-9d2a-e703c02fdaa1 service glance] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:20.261328 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76deb05-9081-45b7-9d2a-e703c02fdaa1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:20.281193 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76deb05-9081-45b7-9d2a-e703c02fdaa1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:20.282964 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76deb05-9081-45b7-9d2a-e703c02fdaa1 service glance] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:20.298423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1202/2414] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:40:20.383093 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cd4bc-2c22-4122-973c-c815d87967bf None None] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:20.383618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cd4bc-2c22-4122-973c-c815d87967bf None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:20.383903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cd4bc-2c22-4122-973c-c815d87967bf None None] PATH_INFO: `/` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:20.385358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1213/2415] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 16:40:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 16:40:20.390684 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06b993-10d0-4d7a-9b1b-914dad1c1886 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:20.390973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06b993-10d0-4d7a-9b1b-914dad1c1886 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:20.391275 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06b993-10d0-4d7a-9b1b-914dad1c1886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:20.411256 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ce06b993-10d0-4d7a-9b1b-914dad1c1886 None None] MFA Rules not processed for user `6f3fe9e871b34a8faed94550e27fefd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:20.412590 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ce06b993-10d0-4d7a-9b1b-914dad1c1886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:20.419608 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1203/2416] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 16:40:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:20.432053 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cd4bc-2c22-4122-973c-c815d87967bf None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:20.433837 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-828cd4bc-2c22-4122-973c-c815d87967bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:20.448482 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cd4bc-2c22-4122-973c-c815d87967bf None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:20.452336 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ea834-cfd2-476d-928f-9d79f03ffb07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:20.453027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ea834-cfd2-476d-928f-9d79f03ffb07 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:20.453304 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ea834-cfd2-476d-928f-9d79f03ffb07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:20.453574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ea834-cfd2-476d-928f-9d79f03ffb07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:20.462377 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ea834-cfd2-476d-928f-9d79f03ffb07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:20.463839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ea834-cfd2-476d-928f-9d79f03ffb07 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:20.472670 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1214/2417] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:40:20.583753 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b71c2-1648-4571-be92-0176d16971a3 None None] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:20.585080 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b71c2-1648-4571-be92-0176d16971a3 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:20.585765 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b71c2-1648-4571-be92-0176d16971a3 None None] PATH_INFO: `/` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:20.588807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1204/2418] 10.222.0.41 () {54 vars in 921 bytes} [Fri May 27 16:40:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 16:40:20.597896 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e490fbf-bccc-42fd-8b5f-31f45d9c61c9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:20.598692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e490fbf-bccc-42fd-8b5f-31f45d9c61c9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:20.599658 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e490fbf-bccc-42fd-8b5f-31f45d9c61c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:20.633183 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-4e490fbf-bccc-42fd-8b5f-31f45d9c61c9 None None] MFA Rules not processed for user `3caa3dbc7bd24ebba28296a1eba9cefe`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:20.634456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4e490fbf-bccc-42fd-8b5f-31f45d9c61c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:20.644517 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1215/2419] 10.222.0.41 () {58 vars in 1018 bytes} [Fri May 27 16:40:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:20.656376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b71c2-1648-4571-be92-0176d16971a3 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:20.673067 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b71c2-1648-4571-be92-0176d16971a3 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:20.678008 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57be369-9b88-4718-b4df-5fc1fce376d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:20.678691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57be369-9b88-4718-b4df-5fc1fce376d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:20.679106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57be369-9b88-4718-b4df-5fc1fce376d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:20.679270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57be369-9b88-4718-b4df-5fc1fce376d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:20.691812 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57be369-9b88-4718-b4df-5fc1fce376d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:20.693350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57be369-9b88-4718-b4df-5fc1fce376d0 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:20.706439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1205/2420] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:23.196851 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e490fbf-bccc-42fd-8b5f-31f45d9c61c9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:23.198757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4e490fbf-bccc-42fd-8b5f-31f45d9c61c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:23.220708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e490fbf-bccc-42fd-8b5f-31f45d9c61c9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:23.234615 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccc9d5-3eb1-48ff-a5cf-b0a933043fc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:23.242199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccc9d5-3eb1-48ff-a5cf-b0a933043fc9 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:23.243294 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccc9d5-3eb1-48ff-a5cf-b0a933043fc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:23.243748 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccc9d5-3eb1-48ff-a5cf-b0a933043fc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:23.247137 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2cccc9d5-3eb1-48ff-a5cf-b0a933043fc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:23.274984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccc9d5-3eb1-48ff-a5cf-b0a933043fc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:23.278329 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccc9d5-3eb1-48ff-a5cf-b0a933043fc9 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:23.329187 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1216/2421] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:23.924894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fb17f-403b-4794-96bf-ac95adde4785 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:23.925525 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fb17f-403b-4794-96bf-ac95adde4785 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:23.925862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fb17f-403b-4794-96bf-ac95adde4785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:23.952470 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6e4fb17f-403b-4794-96bf-ac95adde4785 None None] MFA Rules not processed for user `2ccee0bc7e2b41f4a2fe2a891a95b318`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:23.953878 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6e4fb17f-403b-4794-96bf-ac95adde4785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:23.962325 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1206/2422] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 16:40:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:23.979993 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccc9d5-3eb1-48ff-a5cf-b0a933043fc9 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:23.993682 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccc9d5-3eb1-48ff-a5cf-b0a933043fc9 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:24.001327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babb2ad-8139-4a1d-a519-2c8e1650d58a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbfcca96ad754692b3fb7f891013dafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:24.002374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babb2ad-8139-4a1d-a519-2c8e1650d58a service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:24.002887 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babb2ad-8139-4a1d-a519-2c8e1650d58a service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:24.003360 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babb2ad-8139-4a1d-a519-2c8e1650d58a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:24.014270 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babb2ad-8139-4a1d-a519-2c8e1650d58a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:24.016325 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babb2ad-8139-4a1d-a519-2c8e1650d58a service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:24.028984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1217/2423] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 16:40:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 16:40:29.324034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fb17f-403b-4794-96bf-ac95adde4785 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:29.335025 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fb17f-403b-4794-96bf-ac95adde4785 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:29.340920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c98eb-32ed-44e6-a21f-1b8e6f46ef27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:29.341515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c98eb-32ed-44e6-a21f-1b8e6f46ef27 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:29.341800 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c98eb-32ed-44e6-a21f-1b8e6f46ef27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:29.342077 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c98eb-32ed-44e6-a21f-1b8e6f46ef27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:29.343893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-db7c98eb-32ed-44e6-a21f-1b8e6f46ef27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:29.424096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c98eb-32ed-44e6-a21f-1b8e6f46ef27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:29.425612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c98eb-32ed-44e6-a21f-1b8e6f46ef27 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:29.436667 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1207/2424] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:33.714977 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babb2ad-8139-4a1d-a519-2c8e1650d58a service swift] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:33.718508 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6babb2ad-8139-4a1d-a519-2c8e1650d58a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:33.807730 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c98eb-32ed-44e6-a21f-1b8e6f46ef27 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:33.807730 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-db7c98eb-32ed-44e6-a21f-1b8e6f46ef27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:33.825544 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c98eb-32ed-44e6-a21f-1b8e6f46ef27 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:33.830992 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b13d4-b0fb-4fc1-98ff-992a5f56f4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:33.832171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b13d4-b0fb-4fc1-98ff-992a5f56f4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:33.832821 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b13d4-b0fb-4fc1-98ff-992a5f56f4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:33.833470 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b13d4-b0fb-4fc1-98ff-992a5f56f4b4 admin admin] PATH_INFO: `/v3/users/2ecad16f09f54327b78aab5b06f9872a` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:33.835287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b13d4-b0fb-4fc1-98ff-992a5f56f4b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ecad16f09f54327b78aab5b06f9872a)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:33.837996 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1b13d4-b0fb-4fc1-98ff-992a5f56f4b4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:33.838321 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babb2ad-8139-4a1d-a519-2c8e1650d58a service swift] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:33.846008 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31203539-e14a-4032-870f-f06e5b93744e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1266a87d93da4f8d9a1ccafa03067169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:33.846956 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31203539-e14a-4032-870f-f06e5b93744e service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:33.847233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31203539-e14a-4032-870f-f06e5b93744e service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:33.847716 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31203539-e14a-4032-870f-f06e5b93744e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:33.851385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-31203539-e14a-4032-870f-f06e5b93744e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:33.867979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31203539-e14a-4032-870f-f06e5b93744e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:33.870770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31203539-e14a-4032-870f-f06e5b93744e service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:33.898499 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1218/2425] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:33.902432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-db1b13d4-b0fb-4fc1-98ff-992a5f56f4b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ecad16f09f54327b78aab5b06f9872a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:33.907148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:33.912048 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-db1b13d4-b0fb-4fc1-98ff-992a5f56f4b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ecad16f09f54327b78aab5b06f9872a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:33.930209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-db1b13d4-b0fb-4fc1-98ff-992a5f56f4b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ecad16f09f54327b78aab5b06f9872a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:33.940655 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-db1b13d4-b0fb-4fc1-98ff-992a5f56f4b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ecad16f09f54327b78aab5b06f9872a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:33.942225 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-db1b13d4-b0fb-4fc1-98ff-992a5f56f4b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ecad16f09f54327b78aab5b06f9872a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:33.950296 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1208/2426] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:40:33 2022] DELETE /identity/v3/users/2ecad16f09f54327b78aab5b06f9872a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:34.255993 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31203539-e14a-4032-870f-f06e5b93744e service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:34.277364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31203539-e14a-4032-870f-f06e5b93744e service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:34.379506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0312d0e-53c6-4b36-911e-1b5cce8617fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:34.381453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0312d0e-53c6-4b36-911e-1b5cce8617fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:34.381856 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0312d0e-53c6-4b36-911e-1b5cce8617fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:34.382374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0312d0e-53c6-4b36-911e-1b5cce8617fa admin admin] PATH_INFO: `/v3/projects/3af70ff049aa454d8e11380e0084e949` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:34.384640 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0312d0e-53c6-4b36-911e-1b5cce8617fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3af70ff049aa454d8e11380e0084e949)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:34.388367 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0312d0e-53c6-4b36-911e-1b5cce8617fa admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:34.443019 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:34.464459 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a0312d0e-53c6-4b36-911e-1b5cce8617fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3af70ff049aa454d8e11380e0084e949', 'request_id': 'req-a0312d0e-53c6-4b36-911e-1b5cce8617fa'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:34.474511 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a0312d0e-53c6-4b36-911e-1b5cce8617fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3af70ff049aa454d8e11380e0084e949', 'request_id': 'req-a0312d0e-53c6-4b36-911e-1b5cce8617fa'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:34.482887 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a0312d0e-53c6-4b36-911e-1b5cce8617fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3af70ff049aa454d8e11380e0084e949', 'request_id': 'req-a0312d0e-53c6-4b36-911e-1b5cce8617fa'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:34.495146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a0312d0e-53c6-4b36-911e-1b5cce8617fa admin admin] The token cache is being invalidate because project 3af70ff049aa454d8e11380e0084e949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:40:34.495767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a0312d0e-53c6-4b36-911e-1b5cce8617fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:34.496469 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a0312d0e-53c6-4b36-911e-1b5cce8617fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:34.498043 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1219/2427] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:40:34 2022] DELETE /identity/v3/projects/3af70ff049aa454d8e11380e0084e949 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:34.504881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8d484-836f-4fb7-96e9-d78d2bceeb68 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:34.505185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8d484-836f-4fb7-96e9-d78d2bceeb68 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:34.505753 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a8d484-836f-4fb7-96e9-d78d2bceeb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:34.525212 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c6a8d484-836f-4fb7-96e9-d78d2bceeb68 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:34.526345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c6a8d484-836f-4fb7-96e9-d78d2bceeb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:34.603906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1209/2428] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:40:34.605571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27642d-e8b1-4050-99be-34527e0a8cf4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:34.605962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27642d-e8b1-4050-99be-34527e0a8cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:34.606303 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27642d-e8b1-4050-99be-34527e0a8cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:34.626234 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0f27642d-e8b1-4050-99be-34527e0a8cf4 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:34.627482 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0f27642d-e8b1-4050-99be-34527e0a8cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:34.637388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1220/2429] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:34.641288 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8d484-836f-4fb7-96e9-d78d2bceeb68 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:34.652183 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a8d484-836f-4fb7-96e9-d78d2bceeb68 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:34.657952 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475cae1-28d6-4dae-a374-806325b2f31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:34.658698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475cae1-28d6-4dae-a374-806325b2f31d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:34.658994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475cae1-28d6-4dae-a374-806325b2f31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:34.659269 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475cae1-28d6-4dae-a374-806325b2f31d admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:34.660038 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475cae1-28d6-4dae-a374-806325b2f31d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:40:34.660362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475cae1-28d6-4dae-a374-806325b2f31d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:34.662104 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475cae1-28d6-4dae-a374-806325b2f31d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:34.674872 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1210/2430] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:40:34.681037 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27642d-e8b1-4050-99be-34527e0a8cf4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:34.690755 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27642d-e8b1-4050-99be-34527e0a8cf4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:34.696113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44b0cf-ecec-4e79-9387-78c3ba5e9d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:34.696831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44b0cf-ecec-4e79-9387-78c3ba5e9d36 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:34.697148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44b0cf-ecec-4e79-9387-78c3ba5e9d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:34.697421 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44b0cf-ecec-4e79-9387-78c3ba5e9d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:34.698134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44b0cf-ecec-4e79-9387-78c3ba5e9d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:34.700131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44b0cf-ecec-4e79-9387-78c3ba5e9d36 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:34.740610 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1221/2431] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:40:34 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:40:34.744858 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475cae1-28d6-4dae-a374-806325b2f31d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:34.755197 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475cae1-28d6-4dae-a374-806325b2f31d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:34.816127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ec62f-58ef-4429-837a-267b863b95ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:34.816936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ec62f-58ef-4429-837a-267b863b95ce admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:34.817332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ec62f-58ef-4429-837a-267b863b95ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:34.817615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ec62f-58ef-4429-837a-267b863b95ce admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:34.818432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ec62f-58ef-4429-837a-267b863b95ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:34.820484 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ec62f-58ef-4429-837a-267b863b95ce admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:34.849007 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1211/2432] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:40:34 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:40:34.850630 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44b0cf-ecec-4e79-9387-78c3ba5e9d36 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:34.864960 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44b0cf-ecec-4e79-9387-78c3ba5e9d36 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:34.871153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5a984-3677-4917-a4b2-b03fb9803bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:34.871839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5a984-3677-4917-a4b2-b03fb9803bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:34.872140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5a984-3677-4917-a4b2-b03fb9803bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:34.872424 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5a984-3677-4917-a4b2-b03fb9803bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:34.873144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5a984-3677-4917-a4b2-b03fb9803bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:34.874808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5a984-3677-4917-a4b2-b03fb9803bc5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:34.885758 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1222/2433] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:40:34.890139 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ec62f-58ef-4429-837a-267b863b95ce admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:34.900767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ec62f-58ef-4429-837a-267b863b95ce admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:34.906205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3717e2-bd64-41ae-a78a-6fb551131e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:34.907001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3717e2-bd64-41ae-a78a-6fb551131e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:34.907347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3717e2-bd64-41ae-a78a-6fb551131e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:34.908261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3717e2-bd64-41ae-a78a-6fb551131e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:34.909102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3717e2-bd64-41ae-a78a-6fb551131e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:34.911052 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3717e2-bd64-41ae-a78a-6fb551131e78 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:34.924281 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1212/2434] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:40:34.929433 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5a984-3677-4917-a4b2-b03fb9803bc5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:34.940424 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5a984-3677-4917-a4b2-b03fb9803bc5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:34.947446 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274a1e7-e0d8-4619-9146-64243ccc415d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:34.948411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274a1e7-e0d8-4619-9146-64243ccc415d admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:34.948695 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274a1e7-e0d8-4619-9146-64243ccc415d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:34.948971 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274a1e7-e0d8-4619-9146-64243ccc415d admin admin] PATH_INFO: `/v3/projects/19f0b64e9fdc4d858a09aa2c14731fd7/users/ba44749c28e94c399d586854460c8ada/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:34.969364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274a1e7-e0d8-4619-9146-64243ccc415d admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f0b64e9fdc4d858a09aa2c14731fd7, user_id=ba44749c28e94c399d586854460c8ada, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:34.972101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274a1e7-e0d8-4619-9146-64243ccc415d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:34.996307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1223/2435] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:40:34 2022] PUT /identity/v3/projects/19f0b64e9fdc4d858a09aa2c14731fd7/users/ba44749c28e94c399d586854460c8ada/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:35.006883 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bfe50-728a-47b7-9c71-a583223c0281 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:35.007260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bfe50-728a-47b7-9c71-a583223c0281 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:35.007626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bfe50-728a-47b7-9c71-a583223c0281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:35.041789 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-594bfe50-728a-47b7-9c71-a583223c0281 None None] MFA Rules not processed for user `ba44749c28e94c399d586854460c8ada`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:35.043439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-594bfe50-728a-47b7-9c71-a583223c0281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:35.070406 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:35.125662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1213/2436] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:35.130779 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274a1e7-e0d8-4619-9146-64243ccc415d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:35.205570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274a1e7-e0d8-4619-9146-64243ccc415d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:35.214250 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd79d1a-b95c-4ed1-8c49-bd590eb27776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:35.215418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd79d1a-b95c-4ed1-8c49-bd590eb27776 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:35.215926 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd79d1a-b95c-4ed1-8c49-bd590eb27776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:35.216478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd79d1a-b95c-4ed1-8c49-bd590eb27776 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:35.217787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd79d1a-b95c-4ed1-8c49-bd590eb27776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:35.221691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd79d1a-b95c-4ed1-8c49-bd590eb27776 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:35.266000 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1224/2437] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:40:35 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:40:35.270421 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bfe50-728a-47b7-9c71-a583223c0281 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:35.283441 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bfe50-728a-47b7-9c71-a583223c0281 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:35.357768 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fac932-2234-4382-a6a3-e8e6cc0bb2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:35.358463 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fac932-2234-4382-a6a3-e8e6cc0bb2ed admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:35.358751 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fac932-2234-4382-a6a3-e8e6cc0bb2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:35.359025 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fac932-2234-4382-a6a3-e8e6cc0bb2ed admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:35.359863 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fac932-2234-4382-a6a3-e8e6cc0bb2ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:35.361928 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fac932-2234-4382-a6a3-e8e6cc0bb2ed admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:35.385078 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1214/2438] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:40:35 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:40:35.390145 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd79d1a-b95c-4ed1-8c49-bd590eb27776 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:35.401655 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd79d1a-b95c-4ed1-8c49-bd590eb27776 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:35.406521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938425a-567b-46c0-8fa3-87762f4b9c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:35.407217 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938425a-567b-46c0-8fa3-87762f4b9c83 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:35.407503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938425a-567b-46c0-8fa3-87762f4b9c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:35.407784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938425a-567b-46c0-8fa3-87762f4b9c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:35.408548 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938425a-567b-46c0-8fa3-87762f4b9c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:35.410218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938425a-567b-46c0-8fa3-87762f4b9c83 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:35.423104 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1225/2439] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:40:35.427601 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fac932-2234-4382-a6a3-e8e6cc0bb2ed admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:35.438607 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fac932-2234-4382-a6a3-e8e6cc0bb2ed admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:35.443517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836ac7c-60c7-4b69-89c9-cd5cee92c3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:35.444500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836ac7c-60c7-4b69-89c9-cd5cee92c3e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:35.444828 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836ac7c-60c7-4b69-89c9-cd5cee92c3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:35.445092 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836ac7c-60c7-4b69-89c9-cd5cee92c3e3 admin admin] PATH_INFO: `/v3/projects/f73aafe482274b09b7380e2a2ea2502a/users/98eb0bbae32143259f43050784113da9/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:35.464043 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836ac7c-60c7-4b69-89c9-cd5cee92c3e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f73aafe482274b09b7380e2a2ea2502a, user_id=98eb0bbae32143259f43050784113da9, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:35.466675 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836ac7c-60c7-4b69-89c9-cd5cee92c3e3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:35.483603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1215/2440] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:40:35 2022] PUT /identity/v3/projects/f73aafe482274b09b7380e2a2ea2502a/users/98eb0bbae32143259f43050784113da9/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:35.488605 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938425a-567b-46c0-8fa3-87762f4b9c83 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:35.498713 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938425a-567b-46c0-8fa3-87762f4b9c83 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:35.513095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:35.571253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d2d3b-a8e1-431d-a8ea-88fa0904b0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:35.572060 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d2d3b-a8e1-431d-a8ea-88fa0904b0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:35.572353 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d2d3b-a8e1-431d-a8ea-88fa0904b0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:35.572628 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d2d3b-a8e1-431d-a8ea-88fa0904b0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:35.573357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d2d3b-a8e1-431d-a8ea-88fa0904b0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:35.575064 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d2d3b-a8e1-431d-a8ea-88fa0904b0b1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:35.590804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1226/2441] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:40:35.591888 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836ac7c-60c7-4b69-89c9-cd5cee92c3e3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:35.603864 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836ac7c-60c7-4b69-89c9-cd5cee92c3e3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:35.608880 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b2ee4-0cb1-4ac7-99f6-6582667146a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:35.609799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b2ee4-0cb1-4ac7-99f6-6582667146a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:35.610081 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b2ee4-0cb1-4ac7-99f6-6582667146a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:35.610352 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b2ee4-0cb1-4ac7-99f6-6582667146a5 admin admin] PATH_INFO: `/v3/projects/f73aafe482274b09b7380e2a2ea2502a/users/98eb0bbae32143259f43050784113da9/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:35.612395 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b2ee4-0cb1-4ac7-99f6-6582667146a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f73aafe482274b09b7380e2a2ea2502a, user_id=98eb0bbae32143259f43050784113da9, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:35.615282 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b2ee4-0cb1-4ac7-99f6-6582667146a5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:35.627329 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1216/2442] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:40:35 2022] PUT /identity/v3/projects/f73aafe482274b09b7380e2a2ea2502a/users/98eb0bbae32143259f43050784113da9/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:35.640254 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e0899-deac-4b50-8cbe-866715998122 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:35.640763 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e0899-deac-4b50-8cbe-866715998122 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:35.641238 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e0899-deac-4b50-8cbe-866715998122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:35.680665 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0c9e0899-deac-4b50-8cbe-866715998122 None None] MFA Rules not processed for user `98eb0bbae32143259f43050784113da9`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:35.681883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0c9e0899-deac-4b50-8cbe-866715998122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:35.780883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1227/2443] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:35.794536 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b2ee4-0cb1-4ac7-99f6-6582667146a5 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:35.796625 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-da1b2ee4-0cb1-4ac7-99f6-6582667146a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:35.868594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b2ee4-0cb1-4ac7-99f6-6582667146a5 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:35.872581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753c493-c2fb-476c-b94d-b84483163eb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:35.873254 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753c493-c2fb-476c-b94d-b84483163eb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:35.873543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753c493-c2fb-476c-b94d-b84483163eb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:35.873838 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753c493-c2fb-476c-b94d-b84483163eb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:35.913183 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:35.953554 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753c493-c2fb-476c-b94d-b84483163eb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:35.955029 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753c493-c2fb-476c-b94d-b84483163eb7 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:35.966844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1217/2444] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:40:37.424401 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d8772-908b-4c2a-9650-afe55acf8cc3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:37.424989 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d8772-908b-4c2a-9650-afe55acf8cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:37.424989 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d8772-908b-4c2a-9650-afe55acf8cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:37.444043 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-852d8772-908b-4c2a-9650-afe55acf8cc3 None None] MFA Rules not processed for user `b6264de254d24c43932f28527bea4acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:37.445376 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-852d8772-908b-4c2a-9650-afe55acf8cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:37.466100 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753c493-c2fb-476c-b94d-b84483163eb7 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:37.467577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0753c493-c2fb-476c-b94d-b84483163eb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:37.479498 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753c493-c2fb-476c-b94d-b84483163eb7 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:37.483924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556a207-ebb9-4a4c-8631-457f40cb80a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:37.484638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556a207-ebb9-4a4c-8631-457f40cb80a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:37.484909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556a207-ebb9-4a4c-8631-457f40cb80a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:37.485182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556a207-ebb9-4a4c-8631-457f40cb80a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:37.495867 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556a207-ebb9-4a4c-8631-457f40cb80a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:37.497371 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556a207-ebb9-4a4c-8631-457f40cb80a4 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:37.508181 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1218/2445] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:37.522512 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1228/2446] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:39.490175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bac46c-6498-4cfc-b402-5d6e7bf8bc28 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:39.491341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bac46c-6498-4cfc-b402-5d6e7bf8bc28 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:39.491341 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bac46c-6498-4cfc-b402-5d6e7bf8bc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:39.509508 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-18bac46c-6498-4cfc-b402-5d6e7bf8bc28 None None] MFA Rules not processed for user `2ccee0bc7e2b41f4a2fe2a891a95b318`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:39.510711 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-18bac46c-6498-4cfc-b402-5d6e7bf8bc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:39.569096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1219/2447] 10.222.0.41 () {58 vars in 967 bytes} [Fri May 27 16:40:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:39.581722 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d8772-908b-4c2a-9650-afe55acf8cc3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:39.583108 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-852d8772-908b-4c2a-9650-afe55acf8cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:39.632379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:39.658346 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d8772-908b-4c2a-9650-afe55acf8cc3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:39.664464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96727f1-af25-4610-baf7-222a95f7e628 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbfcca96ad754692b3fb7f891013dafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:39.665121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96727f1-af25-4610-baf7-222a95f7e628 service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:39.665398 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96727f1-af25-4610-baf7-222a95f7e628 service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:39.665687 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96727f1-af25-4610-baf7-222a95f7e628 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:39.674288 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96727f1-af25-4610-baf7-222a95f7e628 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:39.675897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96727f1-af25-4610-baf7-222a95f7e628 service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:39.684841 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1229/2448] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 16:40:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:40:41.367649 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bac46c-6498-4cfc-b402-5d6e7bf8bc28 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:41.443059 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bac46c-6498-4cfc-b402-5d6e7bf8bc28 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:41.448475 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830bffb-af09-4eb5-acad-279c39e97e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:41.449376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830bffb-af09-4eb5-acad-279c39e97e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:41.449662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830bffb-af09-4eb5-acad-279c39e97e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:41.449937 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830bffb-af09-4eb5-acad-279c39e97e8e admin admin] PATH_INFO: `/v3/users/ba44749c28e94c399d586854460c8ada` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:41.451141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830bffb-af09-4eb5-acad-279c39e97e8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba44749c28e94c399d586854460c8ada)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:41.453134 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830bffb-af09-4eb5-acad-279c39e97e8e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:41.509818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1830bffb-af09-4eb5-acad-279c39e97e8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba44749c28e94c399d586854460c8ada'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:41.518489 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1830bffb-af09-4eb5-acad-279c39e97e8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba44749c28e94c399d586854460c8ada'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:41.527618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:41.532647 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1830bffb-af09-4eb5-acad-279c39e97e8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba44749c28e94c399d586854460c8ada'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:41.540474 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1830bffb-af09-4eb5-acad-279c39e97e8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba44749c28e94c399d586854460c8ada'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:41.541209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1830bffb-af09-4eb5-acad-279c39e97e8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba44749c28e94c399d586854460c8ada'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:41.547202 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1220/2449] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:40:41 2022] DELETE /identity/v3/users/ba44749c28e94c399d586854460c8ada => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:41.551908 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f3eab-b6f3-41a7-86b3-4607ff961209 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:41.552430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f3eab-b6f3-41a7-86b3-4607ff961209 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:41.552639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f3eab-b6f3-41a7-86b3-4607ff961209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:41.571678 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a83f3eab-b6f3-41a7-86b3-4607ff961209 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:41.573215 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a83f3eab-b6f3-41a7-86b3-4607ff961209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:41.632443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1230/2450] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:41.643246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830bffb-af09-4eb5-acad-279c39e97e8e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:41.645385 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1830bffb-af09-4eb5-acad-279c39e97e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:41.712272 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830bffb-af09-4eb5-acad-279c39e97e8e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:41.716672 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f363b-3811-4eea-bea2-67945cca74df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:41.717375 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f363b-3811-4eea-bea2-67945cca74df service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:41.717661 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f363b-3811-4eea-bea2-67945cca74df service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:41.717945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f363b-3811-4eea-bea2-67945cca74df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:41.731525 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f363b-3811-4eea-bea2-67945cca74df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:41.733072 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f363b-3811-4eea-bea2-67945cca74df service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:41.746426 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1221/2451] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:40:42.091199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f3eab-b6f3-41a7-86b3-4607ff961209 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:42.093565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a83f3eab-b6f3-41a7-86b3-4607ff961209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:42.215822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f3eab-b6f3-41a7-86b3-4607ff961209 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:42.221997 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136f8b6-b462-4470-a525-66f1c069943a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:42.222863 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136f8b6-b462-4470-a525-66f1c069943a service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:42.223155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136f8b6-b462-4470-a525-66f1c069943a service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:42.223437 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136f8b6-b462-4470-a525-66f1c069943a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:42.225614 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7136f8b6-b462-4470-a525-66f1c069943a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:42.243445 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136f8b6-b462-4470-a525-66f1c069943a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:42.245121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136f8b6-b462-4470-a525-66f1c069943a service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:42.256957 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1231/2452] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:42.388678 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f363b-3811-4eea-bea2-67945cca74df service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:42.390177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0c8f363b-3811-4eea-bea2-67945cca74df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:42.403744 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f363b-3811-4eea-bea2-67945cca74df service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:42.410081 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c26b92-594d-4eb9-b7ca-6e86fa47288b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:42.410913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c26b92-594d-4eb9-b7ca-6e86fa47288b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:42.411373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c26b92-594d-4eb9-b7ca-6e86fa47288b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:42.411640 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c26b92-594d-4eb9-b7ca-6e86fa47288b admin admin] PATH_INFO: `/v3/projects/19f0b64e9fdc4d858a09aa2c14731fd7` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:42.413037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c26b92-594d-4eb9-b7ca-6e86fa47288b admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f0b64e9fdc4d858a09aa2c14731fd7)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:42.415288 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c26b92-594d-4eb9-b7ca-6e86fa47288b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:42.475704 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c2c26b92-594d-4eb9-b7ca-6e86fa47288b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f0b64e9fdc4d858a09aa2c14731fd7', 'request_id': 'req-c2c26b92-594d-4eb9-b7ca-6e86fa47288b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:42.481728 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c2c26b92-594d-4eb9-b7ca-6e86fa47288b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f0b64e9fdc4d858a09aa2c14731fd7', 'request_id': 'req-c2c26b92-594d-4eb9-b7ca-6e86fa47288b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:42.491436 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c2c26b92-594d-4eb9-b7ca-6e86fa47288b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f0b64e9fdc4d858a09aa2c14731fd7', 'request_id': 'req-c2c26b92-594d-4eb9-b7ca-6e86fa47288b'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:42.504409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c2c26b92-594d-4eb9-b7ca-6e86fa47288b admin admin] The token cache is being invalidate because project 19f0b64e9fdc4d858a09aa2c14731fd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:40:42.504737 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c2c26b92-594d-4eb9-b7ca-6e86fa47288b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:42.505332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c2c26b92-594d-4eb9-b7ca-6e86fa47288b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:42.506896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1222/2453] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:40:42 2022] DELETE /identity/v3/projects/19f0b64e9fdc4d858a09aa2c14731fd7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:40:42.511149 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136f8b6-b462-4470-a525-66f1c069943a service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:42.522040 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136f8b6-b462-4470-a525-66f1c069943a service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:42.577469 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:42.584498 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04d9335-b7be-4eae-9782-208d01181d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:42.585563 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d9335-b7be-4eae-9782-208d01181d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:42.586618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d9335-b7be-4eae-9782-208d01181d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:42.586901 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04d9335-b7be-4eae-9782-208d01181d94 admin admin] PATH_INFO: `/v3/users/98eb0bbae32143259f43050784113da9` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:42.588240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d9335-b7be-4eae-9782-208d01181d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98eb0bbae32143259f43050784113da9)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:42.590386 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04d9335-b7be-4eae-9782-208d01181d94 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:42.641885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e04d9335-b7be-4eae-9782-208d01181d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98eb0bbae32143259f43050784113da9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:42.642618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e04d9335-b7be-4eae-9782-208d01181d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98eb0bbae32143259f43050784113da9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:42.643300 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e04d9335-b7be-4eae-9782-208d01181d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98eb0bbae32143259f43050784113da9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:42.658451 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e04d9335-b7be-4eae-9782-208d01181d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98eb0bbae32143259f43050784113da9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:42.666481 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e04d9335-b7be-4eae-9782-208d01181d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98eb0bbae32143259f43050784113da9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:42.681738 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1232/2454] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:40:42 2022] DELETE /identity/v3/users/98eb0bbae32143259f43050784113da9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:42.962915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c26b92-594d-4eb9-b7ca-6e86fa47288b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:42.964924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c2c26b92-594d-4eb9-b7ca-6e86fa47288b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:42.979148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c26b92-594d-4eb9-b7ca-6e86fa47288b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:43.043944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeed7c6-1320-4a87-9080-40f0dc2e3b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:43.044866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeed7c6-1320-4a87-9080-40f0dc2e3b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:43.045147 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeed7c6-1320-4a87-9080-40f0dc2e3b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:43.045422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeed7c6-1320-4a87-9080-40f0dc2e3b23 admin admin] PATH_INFO: `/v3/projects/f73aafe482274b09b7380e2a2ea2502a` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:43.046715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeed7c6-1320-4a87-9080-40f0dc2e3b23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f73aafe482274b09b7380e2a2ea2502a)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:43.048721 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeed7c6-1320-4a87-9080-40f0dc2e3b23 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:43.060211 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:43.111754 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0eeed7c6-1320-4a87-9080-40f0dc2e3b23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f73aafe482274b09b7380e2a2ea2502a', 'request_id': 'req-0eeed7c6-1320-4a87-9080-40f0dc2e3b23'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:43.123313 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0eeed7c6-1320-4a87-9080-40f0dc2e3b23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f73aafe482274b09b7380e2a2ea2502a', 'request_id': 'req-0eeed7c6-1320-4a87-9080-40f0dc2e3b23'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:43.134488 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0eeed7c6-1320-4a87-9080-40f0dc2e3b23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f73aafe482274b09b7380e2a2ea2502a', 'request_id': 'req-0eeed7c6-1320-4a87-9080-40f0dc2e3b23'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:43.146762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0eeed7c6-1320-4a87-9080-40f0dc2e3b23 admin admin] The token cache is being invalidate because project f73aafe482274b09b7380e2a2ea2502a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:40:43.147050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0eeed7c6-1320-4a87-9080-40f0dc2e3b23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:43.147718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-0eeed7c6-1320-4a87-9080-40f0dc2e3b23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:43.150015 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1223/2455] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:40:42 2022] DELETE /identity/v3/projects/f73aafe482274b09b7380e2a2ea2502a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:43.157143 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d2bb7-a2a7-4d8f-83c2-ea4c363183dd None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:43.157628 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d2bb7-a2a7-4d8f-83c2-ea4c363183dd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:43.158203 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d2bb7-a2a7-4d8f-83c2-ea4c363183dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:43.184381 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0b7d2bb7-a2a7-4d8f-83c2-ea4c363183dd None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:43.186088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0b7d2bb7-a2a7-4d8f-83c2-ea4c363183dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:43.255574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1233/2456] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:43.263577 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426e23d-9b29-46fa-8f7a-cb33e8fe2536 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:43.263872 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426e23d-9b29-46fa-8f7a-cb33e8fe2536 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:43.264211 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426e23d-9b29-46fa-8f7a-cb33e8fe2536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:43.285991 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-e426e23d-9b29-46fa-8f7a-cb33e8fe2536 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:43.287284 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e426e23d-9b29-46fa-8f7a-cb33e8fe2536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:43.297553 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1224/2457] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:43.302058 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d2bb7-a2a7-4d8f-83c2-ea4c363183dd None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:43.313163 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d2bb7-a2a7-4d8f-83c2-ea4c363183dd None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:43.317876 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64407f-d5f1-42a5-aed8-1e6ac0d2ce81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:43.318547 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64407f-d5f1-42a5-aed8-1e6ac0d2ce81 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:43.318826 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64407f-d5f1-42a5-aed8-1e6ac0d2ce81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:43.319099 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64407f-d5f1-42a5-aed8-1e6ac0d2ce81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:43.319928 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64407f-d5f1-42a5-aed8-1e6ac0d2ce81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:40:43.320934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64407f-d5f1-42a5-aed8-1e6ac0d2ce81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:43.322303 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae64407f-d5f1-42a5-aed8-1e6ac0d2ce81 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:43.334296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1234/2458] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:40:43.339117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426e23d-9b29-46fa-8f7a-cb33e8fe2536 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:43.348941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426e23d-9b29-46fa-8f7a-cb33e8fe2536 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:43.354872 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc714a-8ef9-4f2d-9987-7f972104b22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:43.355504 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc714a-8ef9-4f2d-9987-7f972104b22e admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:43.355814 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc714a-8ef9-4f2d-9987-7f972104b22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:43.356082 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc714a-8ef9-4f2d-9987-7f972104b22e admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:43.356897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc714a-8ef9-4f2d-9987-7f972104b22e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:43.359071 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc714a-8ef9-4f2d-9987-7f972104b22e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:43.392064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1225/2459] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:40:43 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:40:43.393237 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64407f-d5f1-42a5-aed8-1e6ac0d2ce81 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:43.403321 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64407f-d5f1-42a5-aed8-1e6ac0d2ce81 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:43.467187 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734779e5-97a0-433f-ad73-cc7d944a89dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:43.467955 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734779e5-97a0-433f-ad73-cc7d944a89dd admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:43.468258 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734779e5-97a0-433f-ad73-cc7d944a89dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:43.468649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734779e5-97a0-433f-ad73-cc7d944a89dd admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:43.469262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734779e5-97a0-433f-ad73-cc7d944a89dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:43.471438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734779e5-97a0-433f-ad73-cc7d944a89dd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:43.482197 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:43.495227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1235/2460] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:40:43 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:40:43.499350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc714a-8ef9-4f2d-9987-7f972104b22e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:43.514810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc714a-8ef9-4f2d-9987-7f972104b22e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:43.519970 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c2862-a6e5-49ac-9450-3d647d1d1b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:43.520704 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c2862-a6e5-49ac-9450-3d647d1d1b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:43.520992 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c2862-a6e5-49ac-9450-3d647d1d1b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:43.521271 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c2862-a6e5-49ac-9450-3d647d1d1b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:43.522019 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c2862-a6e5-49ac-9450-3d647d1d1b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:43.524182 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c2862-a6e5-49ac-9450-3d647d1d1b4d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:43.536188 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1226/2461] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:40:43.540578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734779e5-97a0-433f-ad73-cc7d944a89dd admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:43.551077 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734779e5-97a0-433f-ad73-cc7d944a89dd admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:43.555980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a2b98-adf4-46aa-8715-687d2fb46c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:43.556690 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a2b98-adf4-46aa-8715-687d2fb46c26 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:43.556974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a2b98-adf4-46aa-8715-687d2fb46c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:43.557249 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a2b98-adf4-46aa-8715-687d2fb46c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:43.558007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a2b98-adf4-46aa-8715-687d2fb46c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:43.559621 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a2b98-adf4-46aa-8715-687d2fb46c26 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:43.572181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1236/2462] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:40:43.575318 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c2862-a6e5-49ac-9450-3d647d1d1b4d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:43.586711 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c2862-a6e5-49ac-9450-3d647d1d1b4d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:43.591532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a604a6-4375-4fe2-bcdc-1d4e8d4b415b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:43.592492 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a604a6-4375-4fe2-bcdc-1d4e8d4b415b admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:43.592772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a604a6-4375-4fe2-bcdc-1d4e8d4b415b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:43.593042 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a604a6-4375-4fe2-bcdc-1d4e8d4b415b admin admin] PATH_INFO: `/v3/projects/94a611620f2f43fab30c80700a3cd662/users/de3ea9796b6e4d57b86013955c98ab00/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:43.608413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a604a6-4375-4fe2-bcdc-1d4e8d4b415b admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a611620f2f43fab30c80700a3cd662, user_id=de3ea9796b6e4d57b86013955c98ab00, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:43.611088 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a604a6-4375-4fe2-bcdc-1d4e8d4b415b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:43.626732 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1227/2463] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:40:43 2022] PUT /identity/v3/projects/94a611620f2f43fab30c80700a3cd662/users/de3ea9796b6e4d57b86013955c98ab00/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:43.638481 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0be785-2d8d-4d38-b6b1-694f0617a3b7 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:43.639012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0be785-2d8d-4d38-b6b1-694f0617a3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:43.639110 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0be785-2d8d-4d38-b6b1-694f0617a3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:43.666663 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ad0be785-2d8d-4d38-b6b1-694f0617a3b7 None None] MFA Rules not processed for user `de3ea9796b6e4d57b86013955c98ab00`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:43.667884 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ad0be785-2d8d-4d38-b6b1-694f0617a3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:43.733856 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1237/2464] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:43.738348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a604a6-4375-4fe2-bcdc-1d4e8d4b415b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:43.801809 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a604a6-4375-4fe2-bcdc-1d4e8d4b415b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:43.808043 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8db41-2b3c-4510-a875-6535016d053f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:43.808723 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8db41-2b3c-4510-a875-6535016d053f admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:43.809007 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8db41-2b3c-4510-a875-6535016d053f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:43.809280 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8db41-2b3c-4510-a875-6535016d053f admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:43.809973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8db41-2b3c-4510-a875-6535016d053f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:43.811933 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8db41-2b3c-4510-a875-6535016d053f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:43.841018 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1228/2465] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:40:43 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:40:43.845238 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0be785-2d8d-4d38-b6b1-694f0617a3b7 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:43.857444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0be785-2d8d-4d38-b6b1-694f0617a3b7 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:43.916581 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a0aab-9727-43b8-9014-ab7dcc60f29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:43.917259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a0aab-9727-43b8-9014-ab7dcc60f29e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:43.917541 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a0aab-9727-43b8-9014-ab7dcc60f29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:43.917815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a0aab-9727-43b8-9014-ab7dcc60f29e admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:43.918518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a0aab-9727-43b8-9014-ab7dcc60f29e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:43.920512 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a0aab-9727-43b8-9014-ab7dcc60f29e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:43.945988 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1238/2466] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:40:43 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:40:43.952815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8db41-2b3c-4510-a875-6535016d053f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:43.968389 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8db41-2b3c-4510-a875-6535016d053f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:43.976711 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfb26c-cc2a-4d04-a1f7-69f48fda5613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:43.977482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfb26c-cc2a-4d04-a1f7-69f48fda5613 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:43.977767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfb26c-cc2a-4d04-a1f7-69f48fda5613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:43.978043 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfb26c-cc2a-4d04-a1f7-69f48fda5613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:43.978802 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfb26c-cc2a-4d04-a1f7-69f48fda5613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:43.980472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfb26c-cc2a-4d04-a1f7-69f48fda5613 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:43.991910 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1229/2467] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:40:43.996796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a0aab-9727-43b8-9014-ab7dcc60f29e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:44.008564 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a0aab-9727-43b8-9014-ab7dcc60f29e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:44.013817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b46c1-44b0-4c88-a45c-3d5e08a72c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:44.014494 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b46c1-44b0-4c88-a45c-3d5e08a72c65 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:44.014772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b46c1-44b0-4c88-a45c-3d5e08a72c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:44.015045 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b46c1-44b0-4c88-a45c-3d5e08a72c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:44.015763 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b46c1-44b0-4c88-a45c-3d5e08a72c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:44.017440 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b46c1-44b0-4c88-a45c-3d5e08a72c65 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:44.028890 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1239/2468] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:40:44.034046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfb26c-cc2a-4d04-a1f7-69f48fda5613 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:44.047176 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfb26c-cc2a-4d04-a1f7-69f48fda5613 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:44.053145 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f110f9-9d89-43d0-81ed-90356de38d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:44.054066 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f110f9-9d89-43d0-81ed-90356de38d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:44.054319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f110f9-9d89-43d0-81ed-90356de38d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:44.054713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f110f9-9d89-43d0-81ed-90356de38d19 admin admin] PATH_INFO: `/v3/projects/6da543e8b02d41deb1bac44e043cdee6/users/140810225145406492d7a900ef4959ac/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:44.058401 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:44.073214 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f110f9-9d89-43d0-81ed-90356de38d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da543e8b02d41deb1bac44e043cdee6, user_id=140810225145406492d7a900ef4959ac, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:44.076883 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f110f9-9d89-43d0-81ed-90356de38d19 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:44.102024 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1230/2469] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:40:44 2022] PUT /identity/v3/projects/6da543e8b02d41deb1bac44e043cdee6/users/140810225145406492d7a900ef4959ac/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:44.116329 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20967f35-1c29-41c5-8a0d-8c5819d22ec2 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:44.116649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20967f35-1c29-41c5-8a0d-8c5819d22ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:44.116955 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20967f35-1c29-41c5-8a0d-8c5819d22ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:44.143882 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-20967f35-1c29-41c5-8a0d-8c5819d22ec2 None None] MFA Rules not processed for user `140810225145406492d7a900ef4959ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:44.145100 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-20967f35-1c29-41c5-8a0d-8c5819d22ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:44.196698 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:44.227619 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1240/2470] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:44.233494 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f110f9-9d89-43d0-81ed-90356de38d19 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:44.306123 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f110f9-9d89-43d0-81ed-90356de38d19 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:44.311822 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905ad1f-f1f0-4c2e-bb95-45e2caa7906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:44.312540 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905ad1f-f1f0-4c2e-bb95-45e2caa7906f admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:44.312827 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905ad1f-f1f0-4c2e-bb95-45e2caa7906f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:44.313106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905ad1f-f1f0-4c2e-bb95-45e2caa7906f admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:44.313809 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905ad1f-f1f0-4c2e-bb95-45e2caa7906f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:44.315761 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905ad1f-f1f0-4c2e-bb95-45e2caa7906f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:44.344747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1231/2471] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:40:44 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:40:44.348900 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20967f35-1c29-41c5-8a0d-8c5819d22ec2 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:44.360457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20967f35-1c29-41c5-8a0d-8c5819d22ec2 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:44.423977 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f956d5-d32c-455c-939e-cd44aebcc9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:44.424676 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f956d5-d32c-455c-939e-cd44aebcc9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:44.424958 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f956d5-d32c-455c-939e-cd44aebcc9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:44.425232 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f956d5-d32c-455c-939e-cd44aebcc9e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:44.425976 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f956d5-d32c-455c-939e-cd44aebcc9e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:44.427905 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f956d5-d32c-455c-939e-cd44aebcc9e8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:44.452570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1241/2472] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:40:44 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:40:44.456690 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905ad1f-f1f0-4c2e-bb95-45e2caa7906f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:44.469576 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905ad1f-f1f0-4c2e-bb95-45e2caa7906f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:44.475268 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a1b0f-5fc0-4e14-aa23-d526dc5e6e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:44.475955 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a1b0f-5fc0-4e14-aa23-d526dc5e6e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:44.476364 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a1b0f-5fc0-4e14-aa23-d526dc5e6e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:44.476641 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a1b0f-5fc0-4e14-aa23-d526dc5e6e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:44.477369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a1b0f-5fc0-4e14-aa23-d526dc5e6e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:44.478982 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a1b0f-5fc0-4e14-aa23-d526dc5e6e81 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:44.490373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1232/2473] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:40:44.495375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f956d5-d32c-455c-939e-cd44aebcc9e8 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:44.505634 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f956d5-d32c-455c-939e-cd44aebcc9e8 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:44.510959 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183731ce-0a6f-4203-9179-062ca9f12dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:44.511893 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183731ce-0a6f-4203-9179-062ca9f12dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:44.512218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183731ce-0a6f-4203-9179-062ca9f12dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:44.512511 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183731ce-0a6f-4203-9179-062ca9f12dbe admin admin] PATH_INFO: `/v3/projects/7ff18169fbde4f4cad8bebff42345597/users/8b5b7a79eff944ac868cce5c6318fe92/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:44.528440 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183731ce-0a6f-4203-9179-062ca9f12dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff18169fbde4f4cad8bebff42345597, user_id=8b5b7a79eff944ac868cce5c6318fe92, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:44.531127 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183731ce-0a6f-4203-9179-062ca9f12dbe admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:44.548955 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1242/2474] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:40:44 2022] PUT /identity/v3/projects/7ff18169fbde4f4cad8bebff42345597/users/8b5b7a79eff944ac868cce5c6318fe92/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:44.553127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a1b0f-5fc0-4e14-aa23-d526dc5e6e81 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:44.564151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a1b0f-5fc0-4e14-aa23-d526dc5e6e81 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:44.623141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08354357-4eb5-4a6f-98ac-d637c1d79de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:44.623822 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08354357-4eb5-4a6f-98ac-d637c1d79de0 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:44.624143 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08354357-4eb5-4a6f-98ac-d637c1d79de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:44.624418 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08354357-4eb5-4a6f-98ac-d637c1d79de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:44.625146 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08354357-4eb5-4a6f-98ac-d637c1d79de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:44.626765 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08354357-4eb5-4a6f-98ac-d637c1d79de0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:44.637681 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1233/2475] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:40:44.643169 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183731ce-0a6f-4203-9179-062ca9f12dbe admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:44.659482 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183731ce-0a6f-4203-9179-062ca9f12dbe admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:44.666730 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c03c87-57b7-4dfe-88ad-c33c9b7f1905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:44.667633 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c03c87-57b7-4dfe-88ad-c33c9b7f1905 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:44.667909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c03c87-57b7-4dfe-88ad-c33c9b7f1905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:44.668213 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c03c87-57b7-4dfe-88ad-c33c9b7f1905 admin admin] PATH_INFO: `/v3/projects/7ff18169fbde4f4cad8bebff42345597/users/8b5b7a79eff944ac868cce5c6318fe92/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:44.670411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c03c87-57b7-4dfe-88ad-c33c9b7f1905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff18169fbde4f4cad8bebff42345597, user_id=8b5b7a79eff944ac868cce5c6318fe92, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:44.673146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c03c87-57b7-4dfe-88ad-c33c9b7f1905 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:44.687045 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1243/2476] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:40:44 2022] PUT /identity/v3/projects/7ff18169fbde4f4cad8bebff42345597/users/8b5b7a79eff944ac868cce5c6318fe92/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:44.698940 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdcd05-4004-41f0-a881-1d069b5a083e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:44.699234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdcd05-4004-41f0-a881-1d069b5a083e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:44.699541 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdcd05-4004-41f0-a881-1d069b5a083e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:44.736716 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-34bdcd05-4004-41f0-a881-1d069b5a083e None None] MFA Rules not processed for user `8b5b7a79eff944ac868cce5c6318fe92`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:44.737954 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-34bdcd05-4004-41f0-a881-1d069b5a083e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:44.785531 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:44.811450 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1234/2477] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:44.825770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c03c87-57b7-4dfe-88ad-c33c9b7f1905 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:44.827660 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-11c03c87-57b7-4dfe-88ad-c33c9b7f1905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:44.886878 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c03c87-57b7-4dfe-88ad-c33c9b7f1905 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:44.891325 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7f2c4-66f8-48eb-8d55-a095b0da5fd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:44.891974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7f2c4-66f8-48eb-8d55-a095b0da5fd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:44.892276 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7f2c4-66f8-48eb-8d55-a095b0da5fd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:44.892556 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7f2c4-66f8-48eb-8d55-a095b0da5fd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:44.902152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7f2c4-66f8-48eb-8d55-a095b0da5fd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:44.903611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7f2c4-66f8-48eb-8d55-a095b0da5fd4 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:44.913089 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1244/2478] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:45.484488 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdcd05-4004-41f0-a881-1d069b5a083e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:45.486250 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-34bdcd05-4004-41f0-a881-1d069b5a083e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:45.499722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdcd05-4004-41f0-a881-1d069b5a083e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:45.515345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d71c90-6622-4e53-b383-d9c2fc45ed0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:45.516045 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d71c90-6622-4e53-b383-d9c2fc45ed0f service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:45.516321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d71c90-6622-4e53-b383-d9c2fc45ed0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:45.516597 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d71c90-6622-4e53-b383-d9c2fc45ed0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:45.588946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d71c90-6622-4e53-b383-d9c2fc45ed0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:45.590404 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d71c90-6622-4e53-b383-d9c2fc45ed0f service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:45.599772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1235/2479] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:49.713631 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7f2c4-66f8-48eb-8d55-a095b0da5fd4 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:49.724271 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7f2c4-66f8-48eb-8d55-a095b0da5fd4 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:49.729037 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34541b6-1ca3-45b8-921c-752dabaca63d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:49.729698 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34541b6-1ca3-45b8-921c-752dabaca63d service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:49.730034 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34541b6-1ca3-45b8-921c-752dabaca63d service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:49.730404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34541b6-1ca3-45b8-921c-752dabaca63d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:49.772962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:49.800640 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34541b6-1ca3-45b8-921c-752dabaca63d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:49.801926 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34541b6-1ca3-45b8-921c-752dabaca63d service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:49.811413 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1245/2480] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:52.109463 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d71c90-6622-4e53-b383-d9c2fc45ed0f service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:52.177365 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d71c90-6622-4e53-b383-d9c2fc45ed0f service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:52.186428 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf71d43-0c26-48a8-ae5f-ad9523228698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:52.187345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf71d43-0c26-48a8-ae5f-ad9523228698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:52.187623 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf71d43-0c26-48a8-ae5f-ad9523228698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:52.187892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf71d43-0c26-48a8-ae5f-ad9523228698 admin admin] PATH_INFO: `/v3/users/de3ea9796b6e4d57b86013955c98ab00` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:52.189187 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf71d43-0c26-48a8-ae5f-ad9523228698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de3ea9796b6e4d57b86013955c98ab00)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:52.191144 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf71d43-0c26-48a8-ae5f-ad9523228698 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:52.254410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4bf71d43-0c26-48a8-ae5f-ad9523228698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de3ea9796b6e4d57b86013955c98ab00'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:52.265867 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4bf71d43-0c26-48a8-ae5f-ad9523228698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de3ea9796b6e4d57b86013955c98ab00'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:52.280247 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4bf71d43-0c26-48a8-ae5f-ad9523228698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de3ea9796b6e4d57b86013955c98ab00'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:52.288128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4bf71d43-0c26-48a8-ae5f-ad9523228698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de3ea9796b6e4d57b86013955c98ab00'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:52.293733 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4bf71d43-0c26-48a8-ae5f-ad9523228698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de3ea9796b6e4d57b86013955c98ab00'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:52.298626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:52.302726 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1236/2481] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:40:52 2022] DELETE /identity/v3/users/de3ea9796b6e4d57b86013955c98ab00 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:52.307491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b489738-31bb-437a-ad3b-3f741eb084fe None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:52.308390 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b489738-31bb-437a-ad3b-3f741eb084fe None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:52.308821 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b489738-31bb-437a-ad3b-3f741eb084fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:52.327898 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-3b489738-31bb-437a-ad3b-3f741eb084fe None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:52.329155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3b489738-31bb-437a-ad3b-3f741eb084fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:52.391472 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1246/2482] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:52.402250 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf71d43-0c26-48a8-ae5f-ad9523228698 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:52.403999 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4bf71d43-0c26-48a8-ae5f-ad9523228698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:52.466002 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf71d43-0c26-48a8-ae5f-ad9523228698 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:52.470048 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2016a-bd8c-46cd-b11e-e2eac9a5e5bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:52.470726 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2016a-bd8c-46cd-b11e-e2eac9a5e5bf service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:52.471007 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2016a-bd8c-46cd-b11e-e2eac9a5e5bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:52.471284 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2016a-bd8c-46cd-b11e-e2eac9a5e5bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:52.481588 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2016a-bd8c-46cd-b11e-e2eac9a5e5bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:52.483058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2016a-bd8c-46cd-b11e-e2eac9a5e5bf service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:52.493399 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1237/2483] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:52.794965 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b489738-31bb-437a-ad3b-3f741eb084fe None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:52.796807 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-3b489738-31bb-437a-ad3b-3f741eb084fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:52.810087 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b489738-31bb-437a-ad3b-3f741eb084fe None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:52.816679 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7f268-6638-4a46-b257-fc36a5d79332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:52.819109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7f268-6638-4a46-b257-fc36a5d79332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:52.819900 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7f268-6638-4a46-b257-fc36a5d79332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:52.820724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7f268-6638-4a46-b257-fc36a5d79332 admin admin] PATH_INFO: `/v3/projects/94a611620f2f43fab30c80700a3cd662` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:52.824037 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7f268-6638-4a46-b257-fc36a5d79332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94a611620f2f43fab30c80700a3cd662)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:52.826173 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7f268-6638-4a46-b257-fc36a5d79332 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:52.877749 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-30b7f268-6638-4a46-b257-fc36a5d79332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94a611620f2f43fab30c80700a3cd662', 'request_id': 'req-30b7f268-6638-4a46-b257-fc36a5d79332'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:52.886665 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-30b7f268-6638-4a46-b257-fc36a5d79332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94a611620f2f43fab30c80700a3cd662', 'request_id': 'req-30b7f268-6638-4a46-b257-fc36a5d79332'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:52.893483 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-30b7f268-6638-4a46-b257-fc36a5d79332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94a611620f2f43fab30c80700a3cd662', 'request_id': 'req-30b7f268-6638-4a46-b257-fc36a5d79332'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:52.904576 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-30b7f268-6638-4a46-b257-fc36a5d79332 admin admin] The token cache is being invalidate because project 94a611620f2f43fab30c80700a3cd662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:40:52.904890 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-30b7f268-6638-4a46-b257-fc36a5d79332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:52.905633 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-30b7f268-6638-4a46-b257-fc36a5d79332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:52.907298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1247/2484] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:40:52 2022] DELETE /identity/v3/projects/94a611620f2f43fab30c80700a3cd662 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:52.911611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2016a-bd8c-46cd-b11e-e2eac9a5e5bf service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:52.925278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2016a-bd8c-46cd-b11e-e2eac9a5e5bf service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:52.997022 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec70d34-e6bc-40df-a96b-4586d32f0f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:52.998256 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec70d34-e6bc-40df-a96b-4586d32f0f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:52.998646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec70d34-e6bc-40df-a96b-4586d32f0f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:52.999001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec70d34-e6bc-40df-a96b-4586d32f0f22 admin admin] PATH_INFO: `/v3/users/140810225145406492d7a900ef4959ac` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:53.001153 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec70d34-e6bc-40df-a96b-4586d32f0f22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=140810225145406492d7a900ef4959ac)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:53.004184 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec70d34-e6bc-40df-a96b-4586d32f0f22 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:53.054911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-eec70d34-e6bc-40df-a96b-4586d32f0f22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140810225145406492d7a900ef4959ac'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:53.064628 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-eec70d34-e6bc-40df-a96b-4586d32f0f22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140810225145406492d7a900ef4959ac'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:53.079117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-eec70d34-e6bc-40df-a96b-4586d32f0f22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140810225145406492d7a900ef4959ac'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:53.086807 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-eec70d34-e6bc-40df-a96b-4586d32f0f22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140810225145406492d7a900ef4959ac'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:53.087844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-eec70d34-e6bc-40df-a96b-4586d32f0f22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140810225145406492d7a900ef4959ac'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:53.095037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1238/2485] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:40:52 2022] DELETE /identity/v3/users/140810225145406492d7a900ef4959ac => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:53.399242 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7f268-6638-4a46-b257-fc36a5d79332 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:53.400835 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-30b7f268-6638-4a46-b257-fc36a5d79332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:53.414132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7f268-6638-4a46-b257-fc36a5d79332 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:53.475903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:53.482941 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7811f-3353-4e0a-ac3f-60f4647aa3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:53.483823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7811f-3353-4e0a-ac3f-60f4647aa3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:53.484147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7811f-3353-4e0a-ac3f-60f4647aa3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:53.484861 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7811f-3353-4e0a-ac3f-60f4647aa3aa admin admin] PATH_INFO: `/v3/projects/6da543e8b02d41deb1bac44e043cdee6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:53.486207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7811f-3353-4e0a-ac3f-60f4647aa3aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da543e8b02d41deb1bac44e043cdee6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:53.488497 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7811f-3353-4e0a-ac3f-60f4647aa3aa admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:53.540680 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-43c7811f-3353-4e0a-ac3f-60f4647aa3aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da543e8b02d41deb1bac44e043cdee6', 'request_id': 'req-43c7811f-3353-4e0a-ac3f-60f4647aa3aa'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:53.551654 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-43c7811f-3353-4e0a-ac3f-60f4647aa3aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da543e8b02d41deb1bac44e043cdee6', 'request_id': 'req-43c7811f-3353-4e0a-ac3f-60f4647aa3aa'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:53.558241 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-43c7811f-3353-4e0a-ac3f-60f4647aa3aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da543e8b02d41deb1bac44e043cdee6', 'request_id': 'req-43c7811f-3353-4e0a-ac3f-60f4647aa3aa'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:53.568708 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-43c7811f-3353-4e0a-ac3f-60f4647aa3aa admin admin] The token cache is being invalidate because project 6da543e8b02d41deb1bac44e043cdee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:40:53.568926 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-43c7811f-3353-4e0a-ac3f-60f4647aa3aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:53.569579 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-43c7811f-3353-4e0a-ac3f-60f4647aa3aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:53.571504 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1248/2486] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:40:53 2022] DELETE /identity/v3/projects/6da543e8b02d41deb1bac44e043cdee6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:53.576234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec70d34-e6bc-40df-a96b-4586d32f0f22 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:53.578305 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-eec70d34-e6bc-40df-a96b-4586d32f0f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:53.599004 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec70d34-e6bc-40df-a96b-4586d32f0f22 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:53.619054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:53.665981 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc563902-88b0-41b4-bd4c-cf77440f2e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:53.666884 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc563902-88b0-41b4-bd4c-cf77440f2e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:53.667164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc563902-88b0-41b4-bd4c-cf77440f2e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:53.667438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc563902-88b0-41b4-bd4c-cf77440f2e61 admin admin] PATH_INFO: `/v3/users/8b5b7a79eff944ac868cce5c6318fe92` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:53.668782 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc563902-88b0-41b4-bd4c-cf77440f2e61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b5b7a79eff944ac868cce5c6318fe92)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:53.670867 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc563902-88b0-41b4-bd4c-cf77440f2e61 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:53.731858 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cc563902-88b0-41b4-bd4c-cf77440f2e61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b5b7a79eff944ac868cce5c6318fe92'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:53.740977 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cc563902-88b0-41b4-bd4c-cf77440f2e61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b5b7a79eff944ac868cce5c6318fe92'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:53.753162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cc563902-88b0-41b4-bd4c-cf77440f2e61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b5b7a79eff944ac868cce5c6318fe92'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:53.760490 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cc563902-88b0-41b4-bd4c-cf77440f2e61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b5b7a79eff944ac868cce5c6318fe92'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:53.761268 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cc563902-88b0-41b4-bd4c-cf77440f2e61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b5b7a79eff944ac868cce5c6318fe92'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:53.767159 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1239/2487] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:40:53 2022] DELETE /identity/v3/users/8b5b7a79eff944ac868cce5c6318fe92 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:54.062889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7811f-3353-4e0a-ac3f-60f4647aa3aa admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:54.064459 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-43c7811f-3353-4e0a-ac3f-60f4647aa3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:54.081440 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7811f-3353-4e0a-ac3f-60f4647aa3aa admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:54.151063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566d802-6211-4ec6-b278-6fabba645240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:54.151854 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566d802-6211-4ec6-b278-6fabba645240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:54.152182 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566d802-6211-4ec6-b278-6fabba645240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:54.152453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566d802-6211-4ec6-b278-6fabba645240 admin admin] PATH_INFO: `/v3/projects/7ff18169fbde4f4cad8bebff42345597` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:54.153872 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566d802-6211-4ec6-b278-6fabba645240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff18169fbde4f4cad8bebff42345597)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:54.155846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566d802-6211-4ec6-b278-6fabba645240 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:54.211767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9566d802-6211-4ec6-b278-6fabba645240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff18169fbde4f4cad8bebff42345597', 'request_id': 'req-9566d802-6211-4ec6-b278-6fabba645240'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:54.221602 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9566d802-6211-4ec6-b278-6fabba645240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff18169fbde4f4cad8bebff42345597', 'request_id': 'req-9566d802-6211-4ec6-b278-6fabba645240'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:54.228283 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9566d802-6211-4ec6-b278-6fabba645240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff18169fbde4f4cad8bebff42345597', 'request_id': 'req-9566d802-6211-4ec6-b278-6fabba645240'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:54.239282 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9566d802-6211-4ec6-b278-6fabba645240 admin admin] The token cache is being invalidate because project 7ff18169fbde4f4cad8bebff42345597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:40:54.239614 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9566d802-6211-4ec6-b278-6fabba645240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:54.240338 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-9566d802-6211-4ec6-b278-6fabba645240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:54.242069 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1249/2488] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:40:54 2022] DELETE /identity/v3/projects/7ff18169fbde4f4cad8bebff42345597 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:54.249425 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67e856-6671-471f-a5cf-ef33b2a2608c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:54.249894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67e856-6671-471f-a5cf-ef33b2a2608c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:54.250323 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67e856-6671-471f-a5cf-ef33b2a2608c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:54.272876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-3a67e856-6671-471f-a5cf-ef33b2a2608c None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:54.274097 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-3a67e856-6671-471f-a5cf-ef33b2a2608c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:54.341438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1240/2489] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:54.355639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1a04b-956c-49d1-9d59-35502c627da6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:54.355924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1a04b-956c-49d1-9d59-35502c627da6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:54.356229 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1a04b-956c-49d1-9d59-35502c627da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:54.376175 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f9b1a04b-956c-49d1-9d59-35502c627da6 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:54.377518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f9b1a04b-956c-49d1-9d59-35502c627da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:54.389147 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1250/2490] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:54.393580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67e856-6671-471f-a5cf-ef33b2a2608c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:54.404042 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67e856-6671-471f-a5cf-ef33b2a2608c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:54.409444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fe9d6-d541-4ebb-87c6-4ab24391b810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:54.410108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fe9d6-d541-4ebb-87c6-4ab24391b810 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:54.410386 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fe9d6-d541-4ebb-87c6-4ab24391b810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:54.410666 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666fe9d6-d541-4ebb-87c6-4ab24391b810 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:54.411397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fe9d6-d541-4ebb-87c6-4ab24391b810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:40:54.411720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fe9d6-d541-4ebb-87c6-4ab24391b810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:54.413436 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666fe9d6-d541-4ebb-87c6-4ab24391b810 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:54.427047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1241/2491] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:40:54.433410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1a04b-956c-49d1-9d59-35502c627da6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:54.447677 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1a04b-956c-49d1-9d59-35502c627da6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:54.453655 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ac8f4-7d1a-402b-9b73-3c105085d418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:54.454346 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ac8f4-7d1a-402b-9b73-3c105085d418 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:54.454626 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ac8f4-7d1a-402b-9b73-3c105085d418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:54.454894 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ac8f4-7d1a-402b-9b73-3c105085d418 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:54.455591 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ac8f4-7d1a-402b-9b73-3c105085d418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:54.457643 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ac8f4-7d1a-402b-9b73-3c105085d418 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:54.467523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:54.489760 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1251/2492] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:40:54 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:40:54.494178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fe9d6-d541-4ebb-87c6-4ab24391b810 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:54.505261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666fe9d6-d541-4ebb-87c6-4ab24391b810 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:54.534233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:54.581033 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d014d0-75e8-4e92-9745-07ef6c3c6ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:54.581784 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d014d0-75e8-4e92-9745-07ef6c3c6ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:54.581991 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d014d0-75e8-4e92-9745-07ef6c3c6ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:54.582329 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d014d0-75e8-4e92-9745-07ef6c3c6ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:54.583048 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d014d0-75e8-4e92-9745-07ef6c3c6ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:54.585091 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d014d0-75e8-4e92-9745-07ef6c3c6ee0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:54.608652 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1242/2493] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:40:54 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:40:54.613002 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ac8f4-7d1a-402b-9b73-3c105085d418 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:54.624218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ac8f4-7d1a-402b-9b73-3c105085d418 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:54.629759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd2046-e13d-4e78-98a1-e62360a03af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:54.630439 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd2046-e13d-4e78-98a1-e62360a03af2 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:54.630722 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd2046-e13d-4e78-98a1-e62360a03af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:54.631005 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd2046-e13d-4e78-98a1-e62360a03af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:54.631713 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd2046-e13d-4e78-98a1-e62360a03af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:54.633392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd2046-e13d-4e78-98a1-e62360a03af2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:54.644974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1252/2494] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:40:54.649357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d014d0-75e8-4e92-9745-07ef6c3c6ee0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:54.660852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d014d0-75e8-4e92-9745-07ef6c3c6ee0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:54.666044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191e17e-d893-4851-86c6-0089d9e9528d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:54.666723 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e17e-d893-4851-86c6-0089d9e9528d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:54.667010 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e17e-d893-4851-86c6-0089d9e9528d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:54.667287 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e17e-d893-4851-86c6-0089d9e9528d admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:54.668043 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191e17e-d893-4851-86c6-0089d9e9528d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:54.669707 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191e17e-d893-4851-86c6-0089d9e9528d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:54.681464 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1243/2495] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:40:54.686175 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd2046-e13d-4e78-98a1-e62360a03af2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:54.697709 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd2046-e13d-4e78-98a1-e62360a03af2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:54.702877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547e88a-3c05-4c39-8c2f-87113c23f66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:54.703791 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547e88a-3c05-4c39-8c2f-87113c23f66a admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:54.704162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547e88a-3c05-4c39-8c2f-87113c23f66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:54.704592 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547e88a-3c05-4c39-8c2f-87113c23f66a admin admin] PATH_INFO: `/v3/projects/76e34a22ae0d41cf9fcb78a862835f37/users/e640418e6c6842d89eacd5d4c1a98686/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:54.726063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547e88a-3c05-4c39-8c2f-87113c23f66a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e34a22ae0d41cf9fcb78a862835f37, user_id=e640418e6c6842d89eacd5d4c1a98686, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:54.731205 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547e88a-3c05-4c39-8c2f-87113c23f66a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:54.747221 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1253/2496] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:40:54 2022] PUT /identity/v3/projects/76e34a22ae0d41cf9fcb78a862835f37/users/e640418e6c6842d89eacd5d4c1a98686/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:54.759229 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25723f3-4a4c-49dc-baaa-a8660f2520db None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:54.759571 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25723f3-4a4c-49dc-baaa-a8660f2520db None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:54.759849 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25723f3-4a4c-49dc-baaa-a8660f2520db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:54.788999 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b25723f3-4a4c-49dc-baaa-a8660f2520db None None] MFA Rules not processed for user `e640418e6c6842d89eacd5d4c1a98686`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:54.790226 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b25723f3-4a4c-49dc-baaa-a8660f2520db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:54.862348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1244/2497] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:40:54.868970 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547e88a-3c05-4c39-8c2f-87113c23f66a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:54.936165 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547e88a-3c05-4c39-8c2f-87113c23f66a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:54.941673 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161bc5f-bba2-4141-8c1f-8573df830392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:54.942341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161bc5f-bba2-4141-8c1f-8573df830392 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:54.942618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161bc5f-bba2-4141-8c1f-8573df830392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:54.942895 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161bc5f-bba2-4141-8c1f-8573df830392 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:54.943576 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161bc5f-bba2-4141-8c1f-8573df830392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:54.945896 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161bc5f-bba2-4141-8c1f-8573df830392 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:54.975424 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1254/2498] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:40:54 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:40:54.980141 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25723f3-4a4c-49dc-baaa-a8660f2520db None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:54.991579 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25723f3-4a4c-49dc-baaa-a8660f2520db None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:55.054415 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e9cdd-44f6-4c47-aa9c-12680f85922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:55.055090 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9cdd-44f6-4c47-aa9c-12680f85922d admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:55.055372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9cdd-44f6-4c47-aa9c-12680f85922d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:55.055615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e9cdd-44f6-4c47-aa9c-12680f85922d admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:55.056449 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e9cdd-44f6-4c47-aa9c-12680f85922d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:55.058483 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e9cdd-44f6-4c47-aa9c-12680f85922d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:55.085060 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1245/2499] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:40:54 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:40:55.089429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161bc5f-bba2-4141-8c1f-8573df830392 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:55.100941 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161bc5f-bba2-4141-8c1f-8573df830392 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:55.106904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e9204-f3d9-42c6-983b-04b473d58075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:55.107596 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e9204-f3d9-42c6-983b-04b473d58075 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:55.107878 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e9204-f3d9-42c6-983b-04b473d58075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:55.108212 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e9204-f3d9-42c6-983b-04b473d58075 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:55.108946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e9204-f3d9-42c6-983b-04b473d58075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:55.110588 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e9204-f3d9-42c6-983b-04b473d58075 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:55.123065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1255/2500] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:40:55.127386 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e9cdd-44f6-4c47-aa9c-12680f85922d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:55.138540 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e9cdd-44f6-4c47-aa9c-12680f85922d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:55.144665 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f64e6-9f9e-463d-ae1b-29a30ffeb5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:55.145566 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f64e6-9f9e-463d-ae1b-29a30ffeb5c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:55.145851 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f64e6-9f9e-463d-ae1b-29a30ffeb5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:55.146132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f64e6-9f9e-463d-ae1b-29a30ffeb5c1 admin admin] PATH_INFO: `/v3/projects/319c8133d8fa4f598c83f2cf897cd50f/users/75f59daa301e4c499d86c4b43f7cc7e9/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:55.162304 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f64e6-9f9e-463d-ae1b-29a30ffeb5c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=319c8133d8fa4f598c83f2cf897cd50f, user_id=75f59daa301e4c499d86c4b43f7cc7e9, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:55.165104 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f64e6-9f9e-463d-ae1b-29a30ffeb5c1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:55.176932 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:55.182708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1246/2501] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:40:55 2022] PUT /identity/v3/projects/319c8133d8fa4f598c83f2cf897cd50f/users/75f59daa301e4c499d86c4b43f7cc7e9/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:55.187618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e9204-f3d9-42c6-983b-04b473d58075 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:55.200117 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e9204-f3d9-42c6-983b-04b473d58075 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:55.257811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce673e9-fe8f-4706-96ac-75c5fa6a43dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:55.258501 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce673e9-fe8f-4706-96ac-75c5fa6a43dc admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:55.258765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce673e9-fe8f-4706-96ac-75c5fa6a43dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:55.259039 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce673e9-fe8f-4706-96ac-75c5fa6a43dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:55.259865 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce673e9-fe8f-4706-96ac-75c5fa6a43dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:55.261554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce673e9-fe8f-4706-96ac-75c5fa6a43dc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:55.273516 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1256/2502] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:40:55.278195 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f64e6-9f9e-463d-ae1b-29a30ffeb5c1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:55.289415 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f64e6-9f9e-463d-ae1b-29a30ffeb5c1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:55.295104 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46075be8-9ab2-4b7d-a193-14d2f4aca4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:55.296048 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46075be8-9ab2-4b7d-a193-14d2f4aca4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:55.296440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46075be8-9ab2-4b7d-a193-14d2f4aca4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:55.296592 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46075be8-9ab2-4b7d-a193-14d2f4aca4f0 admin admin] PATH_INFO: `/v3/projects/319c8133d8fa4f598c83f2cf897cd50f/users/75f59daa301e4c499d86c4b43f7cc7e9/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:55.298878 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46075be8-9ab2-4b7d-a193-14d2f4aca4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=319c8133d8fa4f598c83f2cf897cd50f, user_id=75f59daa301e4c499d86c4b43f7cc7e9, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:55.301627 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46075be8-9ab2-4b7d-a193-14d2f4aca4f0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:55.314039 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1247/2503] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:40:55 2022] PUT /identity/v3/projects/319c8133d8fa4f598c83f2cf897cd50f/users/75f59daa301e4c499d86c4b43f7cc7e9/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:55.326158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402805c1-6269-4079-b634-069b3f2b4226 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:55.326447 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402805c1-6269-4079-b634-069b3f2b4226 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:55.326725 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402805c1-6269-4079-b634-069b3f2b4226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:55.357521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-402805c1-6269-4079-b634-069b3f2b4226 None None] MFA Rules not processed for user `75f59daa301e4c499d86c4b43f7cc7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:55.358747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-402805c1-6269-4079-b634-069b3f2b4226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:55.372144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:55.447439 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1257/2504] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:55.463260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46075be8-9ab2-4b7d-a193-14d2f4aca4f0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:55.465646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-46075be8-9ab2-4b7d-a193-14d2f4aca4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:55.543061 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46075be8-9ab2-4b7d-a193-14d2f4aca4f0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:55.549955 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78678369-f158-4ae8-b92d-3a3a0f257a6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:55.550854 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78678369-f158-4ae8-b92d-3a3a0f257a6e service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:55.551243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78678369-f158-4ae8-b92d-3a3a0f257a6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:55.551608 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78678369-f158-4ae8-b92d-3a3a0f257a6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:55.563654 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78678369-f158-4ae8-b92d-3a3a0f257a6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:55.565166 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78678369-f158-4ae8-b92d-3a3a0f257a6e service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:55.577920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1248/2505] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:55.986647 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402805c1-6269-4079-b634-069b3f2b4226 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:56.053231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402805c1-6269-4079-b634-069b3f2b4226 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:56.058317 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c3dff-5d74-4107-8508-7e2d33a426e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:56.059172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c3dff-5d74-4107-8508-7e2d33a426e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:56.059477 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c3dff-5d74-4107-8508-7e2d33a426e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:56.059746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c3dff-5d74-4107-8508-7e2d33a426e9 admin admin] PATH_INFO: `/v3/users/e640418e6c6842d89eacd5d4c1a98686` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:56.060962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c3dff-5d74-4107-8508-7e2d33a426e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e640418e6c6842d89eacd5d4c1a98686)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:56.062902 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c3dff-5d74-4107-8508-7e2d33a426e9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:56.116149 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-567c3dff-5d74-4107-8508-7e2d33a426e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e640418e6c6842d89eacd5d4c1a98686'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:56.116845 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-567c3dff-5d74-4107-8508-7e2d33a426e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e640418e6c6842d89eacd5d4c1a98686'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:56.117468 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-567c3dff-5d74-4107-8508-7e2d33a426e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e640418e6c6842d89eacd5d4c1a98686'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:56.129953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-567c3dff-5d74-4107-8508-7e2d33a426e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e640418e6c6842d89eacd5d4c1a98686'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:56.137237 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-567c3dff-5d74-4107-8508-7e2d33a426e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e640418e6c6842d89eacd5d4c1a98686'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:56.152422 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1258/2506] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:40:55 2022] DELETE /identity/v3/users/e640418e6c6842d89eacd5d4c1a98686 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:56.157023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7190c9-0cd8-4c70-b06c-d7052565287f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:56.157513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7190c9-0cd8-4c70-b06c-d7052565287f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:56.157624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7190c9-0cd8-4c70-b06c-d7052565287f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:56.175191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ac7190c9-0cd8-4c70-b06c-d7052565287f None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:56.176434 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ac7190c9-0cd8-4c70-b06c-d7052565287f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:56.247278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1249/2507] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:56.258507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c3dff-5d74-4107-8508-7e2d33a426e9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:56.260916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-567c3dff-5d74-4107-8508-7e2d33a426e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:56.298274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:56.326647 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c3dff-5d74-4107-8508-7e2d33a426e9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:56.330859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74954c5f-6aa9-42d9-9143-b5ab29cea68b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:56.331535 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74954c5f-6aa9-42d9-9143-b5ab29cea68b service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:56.331817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74954c5f-6aa9-42d9-9143-b5ab29cea68b service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:56.332132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74954c5f-6aa9-42d9-9143-b5ab29cea68b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:56.342307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74954c5f-6aa9-42d9-9143-b5ab29cea68b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:56.343774 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74954c5f-6aa9-42d9-9143-b5ab29cea68b service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:56.353382 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1259/2508] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:56.658484 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7190c9-0cd8-4c70-b06c-d7052565287f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:56.660375 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ac7190c9-0cd8-4c70-b06c-d7052565287f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:56.673364 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7190c9-0cd8-4c70-b06c-d7052565287f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:56.679517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291b35b-c52b-4840-bf27-fc7b15662d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:56.680513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291b35b-c52b-4840-bf27-fc7b15662d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:56.680787 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291b35b-c52b-4840-bf27-fc7b15662d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:56.681086 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291b35b-c52b-4840-bf27-fc7b15662d1e admin admin] PATH_INFO: `/v3/projects/76e34a22ae0d41cf9fcb78a862835f37` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:56.682687 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291b35b-c52b-4840-bf27-fc7b15662d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e34a22ae0d41cf9fcb78a862835f37)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:56.684686 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291b35b-c52b-4840-bf27-fc7b15662d1e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:56.738663 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f291b35b-c52b-4840-bf27-fc7b15662d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e34a22ae0d41cf9fcb78a862835f37', 'request_id': 'req-f291b35b-c52b-4840-bf27-fc7b15662d1e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:56.744839 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f291b35b-c52b-4840-bf27-fc7b15662d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e34a22ae0d41cf9fcb78a862835f37', 'request_id': 'req-f291b35b-c52b-4840-bf27-fc7b15662d1e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:56.755378 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f291b35b-c52b-4840-bf27-fc7b15662d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e34a22ae0d41cf9fcb78a862835f37', 'request_id': 'req-f291b35b-c52b-4840-bf27-fc7b15662d1e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:56.770846 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f291b35b-c52b-4840-bf27-fc7b15662d1e admin admin] The token cache is being invalidate because project 76e34a22ae0d41cf9fcb78a862835f37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:40:56.771036 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f291b35b-c52b-4840-bf27-fc7b15662d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:56.771767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f291b35b-c52b-4840-bf27-fc7b15662d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:56.773463 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1250/2509] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:40:56 2022] DELETE /identity/v3/projects/76e34a22ae0d41cf9fcb78a862835f37 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:56.778493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74954c5f-6aa9-42d9-9143-b5ab29cea68b service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:56.789121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74954c5f-6aa9-42d9-9143-b5ab29cea68b service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:56.852044 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a88617-f76c-43fc-84db-1194652cbda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:56.852962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a88617-f76c-43fc-84db-1194652cbda0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:56.853262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a88617-f76c-43fc-84db-1194652cbda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:56.853537 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a88617-f76c-43fc-84db-1194652cbda0 admin admin] PATH_INFO: `/v3/users/75f59daa301e4c499d86c4b43f7cc7e9` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:56.854757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a88617-f76c-43fc-84db-1194652cbda0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f59daa301e4c499d86c4b43f7cc7e9)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:56.856733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a88617-f76c-43fc-84db-1194652cbda0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:56.908051 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-61a88617-f76c-43fc-84db-1194652cbda0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f59daa301e4c499d86c4b43f7cc7e9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:56.908691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-61a88617-f76c-43fc-84db-1194652cbda0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f59daa301e4c499d86c4b43f7cc7e9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:56.909283 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-61a88617-f76c-43fc-84db-1194652cbda0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f59daa301e4c499d86c4b43f7cc7e9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:56.921482 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-61a88617-f76c-43fc-84db-1194652cbda0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f59daa301e4c499d86c4b43f7cc7e9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:56.928252 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-61a88617-f76c-43fc-84db-1194652cbda0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f59daa301e4c499d86c4b43f7cc7e9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:56.945718 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1260/2510] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:40:56 2022] DELETE /identity/v3/users/75f59daa301e4c499d86c4b43f7cc7e9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:57.245549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291b35b-c52b-4840-bf27-fc7b15662d1e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:57.247127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f291b35b-c52b-4840-bf27-fc7b15662d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:57.263254 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291b35b-c52b-4840-bf27-fc7b15662d1e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:57.274410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:57.331820 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0f1e8-051e-4178-8de6-882bf30aeac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:57.332761 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0f1e8-051e-4178-8de6-882bf30aeac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:57.333046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0f1e8-051e-4178-8de6-882bf30aeac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:57.333307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0f1e8-051e-4178-8de6-882bf30aeac0 admin admin] PATH_INFO: `/v3/projects/319c8133d8fa4f598c83f2cf897cd50f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:57.334523 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0f1e8-051e-4178-8de6-882bf30aeac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=319c8133d8fa4f598c83f2cf897cd50f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:57.336511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0f1e8-051e-4178-8de6-882bf30aeac0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:57.396914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a4d0f1e8-051e-4178-8de6-882bf30aeac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '319c8133d8fa4f598c83f2cf897cd50f', 'request_id': 'req-a4d0f1e8-051e-4178-8de6-882bf30aeac0'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:57.404684 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a4d0f1e8-051e-4178-8de6-882bf30aeac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '319c8133d8fa4f598c83f2cf897cd50f', 'request_id': 'req-a4d0f1e8-051e-4178-8de6-882bf30aeac0'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:57.416250 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a4d0f1e8-051e-4178-8de6-882bf30aeac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '319c8133d8fa4f598c83f2cf897cd50f', 'request_id': 'req-a4d0f1e8-051e-4178-8de6-882bf30aeac0'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:57.427821 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a4d0f1e8-051e-4178-8de6-882bf30aeac0 admin admin] The token cache is being invalidate because project 319c8133d8fa4f598c83f2cf897cd50f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:40:57.428129 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a4d0f1e8-051e-4178-8de6-882bf30aeac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:57.428771 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-a4d0f1e8-051e-4178-8de6-882bf30aeac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:57.430337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1251/2511] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:40:57 2022] DELETE /identity/v3/projects/319c8133d8fa4f598c83f2cf897cd50f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:57.435501 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa9356-0314-45cf-87ed-eabf93025877 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:57.435795 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa9356-0314-45cf-87ed-eabf93025877 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:57.436155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa9356-0314-45cf-87ed-eabf93025877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:57.455819 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b3fa9356-0314-45cf-87ed-eabf93025877 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:57.457070 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b3fa9356-0314-45cf-87ed-eabf93025877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:57.505839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:57.524150 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1261/2512] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:57.532333 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc390e1f-40f9-4e18-a71b-7d4e5c1d2a93 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:57.532631 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc390e1f-40f9-4e18-a71b-7d4e5c1d2a93 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:57.532919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc390e1f-40f9-4e18-a71b-7d4e5c1d2a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:57.552804 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-bc390e1f-40f9-4e18-a71b-7d4e5c1d2a93 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:57.553930 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bc390e1f-40f9-4e18-a71b-7d4e5c1d2a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:57.562949 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1252/2513] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:57.567373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa9356-0314-45cf-87ed-eabf93025877 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:57.578745 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa9356-0314-45cf-87ed-eabf93025877 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:57.583896 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eea343-d300-4922-84e2-db3c63895528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:57.584733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eea343-d300-4922-84e2-db3c63895528 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:57.585010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eea343-d300-4922-84e2-db3c63895528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:57.585279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eea343-d300-4922-84e2-db3c63895528 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:57.586002 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eea343-d300-4922-84e2-db3c63895528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:40:57.586327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eea343-d300-4922-84e2-db3c63895528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:57.588143 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eea343-d300-4922-84e2-db3c63895528 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:57.601429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1262/2514] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:40:57.606756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc390e1f-40f9-4e18-a71b-7d4e5c1d2a93 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:57.620294 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc390e1f-40f9-4e18-a71b-7d4e5c1d2a93 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:57.626009 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3021bfc-537d-41f4-8e17-9711260a3adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:57.626656 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3021bfc-537d-41f4-8e17-9711260a3adf admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:57.626928 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3021bfc-537d-41f4-8e17-9711260a3adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:57.627204 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3021bfc-537d-41f4-8e17-9711260a3adf admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:57.627897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3021bfc-537d-41f4-8e17-9711260a3adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:57.629870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3021bfc-537d-41f4-8e17-9711260a3adf admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:57.660730 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1253/2515] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:40:57 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:40:57.665056 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eea343-d300-4922-84e2-db3c63895528 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:57.677209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eea343-d300-4922-84e2-db3c63895528 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:57.740060 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0dae8b-5191-4d2c-84ad-b0e497e93823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:57.740990 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0dae8b-5191-4d2c-84ad-b0e497e93823 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:57.741387 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0dae8b-5191-4d2c-84ad-b0e497e93823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:57.741775 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0dae8b-5191-4d2c-84ad-b0e497e93823 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:57.742884 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0dae8b-5191-4d2c-84ad-b0e497e93823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:57.745158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0dae8b-5191-4d2c-84ad-b0e497e93823 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:57.767343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1263/2516] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:40:57 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:40:57.772660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3021bfc-537d-41f4-8e17-9711260a3adf admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:57.784183 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3021bfc-537d-41f4-8e17-9711260a3adf admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:57.789774 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ce281-5d1a-4fc2-a866-cab63ce7816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:57.790530 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ce281-5d1a-4fc2-a866-cab63ce7816a admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:57.791216 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ce281-5d1a-4fc2-a866-cab63ce7816a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:57.791676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ce281-5d1a-4fc2-a866-cab63ce7816a admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:57.792442 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ce281-5d1a-4fc2-a866-cab63ce7816a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:57.794085 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85ce281-5d1a-4fc2-a866-cab63ce7816a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:57.807169 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1254/2517] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:40:57.811434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0dae8b-5191-4d2c-84ad-b0e497e93823 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:57.822823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0dae8b-5191-4d2c-84ad-b0e497e93823 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:57.827553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec3533-4a57-4bbe-ba19-89a02febbc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:57.828249 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec3533-4a57-4bbe-ba19-89a02febbc8f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:57.828528 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec3533-4a57-4bbe-ba19-89a02febbc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:57.828828 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec3533-4a57-4bbe-ba19-89a02febbc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:57.829509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec3533-4a57-4bbe-ba19-89a02febbc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:57.831148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec3533-4a57-4bbe-ba19-89a02febbc8f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:57.843056 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1264/2518] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:40:57.848197 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ce281-5d1a-4fc2-a866-cab63ce7816a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:57.863609 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ce281-5d1a-4fc2-a866-cab63ce7816a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:57.870690 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fad55-973f-4e37-b39e-3139a9d3c38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:57.871506 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fad55-973f-4e37-b39e-3139a9d3c38d admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:57.871808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fad55-973f-4e37-b39e-3139a9d3c38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:57.872119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36fad55-973f-4e37-b39e-3139a9d3c38d admin admin] PATH_INFO: `/v3/projects/5e9599d871b54f3c9b7da12b6fdde1c8/users/b93cf436fd64418ca0953a7fc6b3b45b/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:57.887172 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36fad55-973f-4e37-b39e-3139a9d3c38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9599d871b54f3c9b7da12b6fdde1c8, user_id=b93cf436fd64418ca0953a7fc6b3b45b, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:57.889892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36fad55-973f-4e37-b39e-3139a9d3c38d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:57.905117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1255/2519] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:40:57 2022] PUT /identity/v3/projects/5e9599d871b54f3c9b7da12b6fdde1c8/users/b93cf436fd64418ca0953a7fc6b3b45b/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:57.915811 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed78fe-21b9-4cc2-b822-680f8f8c7a89 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:57.916227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed78fe-21b9-4cc2-b822-680f8f8c7a89 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:57.916503 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed78fe-21b9-4cc2-b822-680f8f8c7a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:57.942850 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-49ed78fe-21b9-4cc2-b822-680f8f8c7a89 None None] MFA Rules not processed for user `b93cf436fd64418ca0953a7fc6b3b45b`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:57.944122 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-49ed78fe-21b9-4cc2-b822-680f8f8c7a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:58.012621 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1265/2520] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:58.017327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fad55-973f-4e37-b39e-3139a9d3c38d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:58.059785 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:58.081894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36fad55-973f-4e37-b39e-3139a9d3c38d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:58.086843 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cd090-d79d-4e77-a623-ed9ec0d2a08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:58.087518 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cd090-d79d-4e77-a623-ed9ec0d2a08e admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:58.087803 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cd090-d79d-4e77-a623-ed9ec0d2a08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:58.088108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cd090-d79d-4e77-a623-ed9ec0d2a08e admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:58.088826 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cd090-d79d-4e77-a623-ed9ec0d2a08e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:58.090832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cd090-d79d-4e77-a623-ed9ec0d2a08e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:58.121500 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1256/2521] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:40:58 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:40:58.125725 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed78fe-21b9-4cc2-b822-680f8f8c7a89 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:58.136886 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed78fe-21b9-4cc2-b822-680f8f8c7a89 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:58.181795 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:58.198199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67c4ce-29fb-4aeb-b5e7-0a4cb1bfed31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:58.198932 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67c4ce-29fb-4aeb-b5e7-0a4cb1bfed31 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:58.199203 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67c4ce-29fb-4aeb-b5e7-0a4cb1bfed31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:58.199468 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67c4ce-29fb-4aeb-b5e7-0a4cb1bfed31 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:58.200203 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67c4ce-29fb-4aeb-b5e7-0a4cb1bfed31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:58.202143 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67c4ce-29fb-4aeb-b5e7-0a4cb1bfed31 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:58.224735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1266/2522] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:40:58 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:40:58.228912 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cd090-d79d-4e77-a623-ed9ec0d2a08e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:58.240319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cd090-d79d-4e77-a623-ed9ec0d2a08e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:58.246307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf069db-3db2-4cda-bd35-b84e4c6346f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:58.246993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf069db-3db2-4cda-bd35-b84e4c6346f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:58.247293 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf069db-3db2-4cda-bd35-b84e4c6346f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:58.247566 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf069db-3db2-4cda-bd35-b84e4c6346f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:58.248345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf069db-3db2-4cda-bd35-b84e4c6346f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:58.249980 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf069db-3db2-4cda-bd35-b84e4c6346f0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:58.261548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1257/2523] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:40:58.266139 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67c4ce-29fb-4aeb-b5e7-0a4cb1bfed31 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:58.276957 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67c4ce-29fb-4aeb-b5e7-0a4cb1bfed31 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:58.283706 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0779bd-b6d1-4984-805c-7da99297c0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:58.284639 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0779bd-b6d1-4984-805c-7da99297c0e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:58.284915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0779bd-b6d1-4984-805c-7da99297c0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:58.285188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0779bd-b6d1-4984-805c-7da99297c0e3 admin admin] PATH_INFO: `/v3/projects/96c9c928f9b94d35be1f8409840140f9/users/b1d35a8d30ca43ba9f69d8fa8ff1d473/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:58.301767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0779bd-b6d1-4984-805c-7da99297c0e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c9c928f9b94d35be1f8409840140f9, user_id=b1d35a8d30ca43ba9f69d8fa8ff1d473, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:58.304532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0779bd-b6d1-4984-805c-7da99297c0e3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:58.321448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1267/2524] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:40:58 2022] PUT /identity/v3/projects/96c9c928f9b94d35be1f8409840140f9/users/b1d35a8d30ca43ba9f69d8fa8ff1d473/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:58.326461 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf069db-3db2-4cda-bd35-b84e4c6346f0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:58.340167 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf069db-3db2-4cda-bd35-b84e4c6346f0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:58.406276 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731418b-12d2-458c-8d3e-5513a4ae2c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:58.406953 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731418b-12d2-458c-8d3e-5513a4ae2c58 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:58.407265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731418b-12d2-458c-8d3e-5513a4ae2c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:58.407546 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731418b-12d2-458c-8d3e-5513a4ae2c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:58.408377 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731418b-12d2-458c-8d3e-5513a4ae2c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:58.410020 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731418b-12d2-458c-8d3e-5513a4ae2c58 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:58.420408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1258/2525] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:40:58.424877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0779bd-b6d1-4984-805c-7da99297c0e3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:58.436218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0779bd-b6d1-4984-805c-7da99297c0e3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:58.441144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a605f2-e60a-46a5-8ed2-65e3ab525393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:58.442029 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a605f2-e60a-46a5-8ed2-65e3ab525393 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:58.442308 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a605f2-e60a-46a5-8ed2-65e3ab525393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:58.442582 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a605f2-e60a-46a5-8ed2-65e3ab525393 admin admin] PATH_INFO: `/v3/projects/96c9c928f9b94d35be1f8409840140f9/users/b1d35a8d30ca43ba9f69d8fa8ff1d473/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:58.444601 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a605f2-e60a-46a5-8ed2-65e3ab525393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c9c928f9b94d35be1f8409840140f9, user_id=b1d35a8d30ca43ba9f69d8fa8ff1d473, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:58.447632 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a605f2-e60a-46a5-8ed2-65e3ab525393 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:58.459120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1268/2526] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:40:58 2022] PUT /identity/v3/projects/96c9c928f9b94d35be1f8409840140f9/users/b1d35a8d30ca43ba9f69d8fa8ff1d473/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:58.475671 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa876e12-21d7-40ef-8800-0cd8b16f4bdb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:58.475969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa876e12-21d7-40ef-8800-0cd8b16f4bdb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:58.476276 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa876e12-21d7-40ef-8800-0cd8b16f4bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:58.510825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-fa876e12-21d7-40ef-8800-0cd8b16f4bdb None None] MFA Rules not processed for user `b1d35a8d30ca43ba9f69d8fa8ff1d473`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:58.512319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-fa876e12-21d7-40ef-8800-0cd8b16f4bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:58.589723 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1259/2527] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:58.601976 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a605f2-e60a-46a5-8ed2-65e3ab525393 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:58.603973 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-31a605f2-e60a-46a5-8ed2-65e3ab525393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:58.664456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a605f2-e60a-46a5-8ed2-65e3ab525393 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:58.669065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24be29-16fb-4d62-862d-faa4b8837a20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:58.669726 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24be29-16fb-4d62-862d-faa4b8837a20 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:58.670005 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24be29-16fb-4d62-862d-faa4b8837a20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:58.670280 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24be29-16fb-4d62-862d-faa4b8837a20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:58.680088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24be29-16fb-4d62-862d-faa4b8837a20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:58.681542 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24be29-16fb-4d62-862d-faa4b8837a20 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:58.691815 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1269/2528] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:58.776026 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa876e12-21d7-40ef-8800-0cd8b16f4bdb None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:58.786660 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa876e12-21d7-40ef-8800-0cd8b16f4bdb None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:58.790786 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301dce4-d235-4fa6-98ed-ecfb1d4a34ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:58.791439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301dce4-d235-4fa6-98ed-ecfb1d4a34ac service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:58.791719 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301dce4-d235-4fa6-98ed-ecfb1d4a34ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:58.791990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301dce4-d235-4fa6-98ed-ecfb1d4a34ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:58.835916 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:58.871158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301dce4-d235-4fa6-98ed-ecfb1d4a34ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:58.872581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301dce4-d235-4fa6-98ed-ecfb1d4a34ac service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:58.881844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1260/2529] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:59.173010 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24be29-16fb-4d62-862d-faa4b8837a20 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:59.236299 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24be29-16fb-4d62-862d-faa4b8837a20 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:59.241306 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40025f-f48e-46b2-ae2f-75fc443aa399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:59.242198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40025f-f48e-46b2-ae2f-75fc443aa399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:59.242485 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40025f-f48e-46b2-ae2f-75fc443aa399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:59.242759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40025f-f48e-46b2-ae2f-75fc443aa399 admin admin] PATH_INFO: `/v3/users/b93cf436fd64418ca0953a7fc6b3b45b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:59.244019 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40025f-f48e-46b2-ae2f-75fc443aa399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93cf436fd64418ca0953a7fc6b3b45b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:59.245996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40025f-f48e-46b2-ae2f-75fc443aa399 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:59.298418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:40:59.301414 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7c40025f-f48e-46b2-ae2f-75fc443aa399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93cf436fd64418ca0953a7fc6b3b45b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:59.302531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7c40025f-f48e-46b2-ae2f-75fc443aa399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93cf436fd64418ca0953a7fc6b3b45b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:59.303756 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7c40025f-f48e-46b2-ae2f-75fc443aa399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93cf436fd64418ca0953a7fc6b3b45b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:59.318735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7c40025f-f48e-46b2-ae2f-75fc443aa399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93cf436fd64418ca0953a7fc6b3b45b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:59.326751 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7c40025f-f48e-46b2-ae2f-75fc443aa399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93cf436fd64418ca0953a7fc6b3b45b'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:59.342665 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1270/2530] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:40:59 2022] DELETE /identity/v3/users/b93cf436fd64418ca0953a7fc6b3b45b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:59.347404 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa78298-c117-4385-90f7-43d7d63f9b3c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:59.347869 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa78298-c117-4385-90f7-43d7d63f9b3c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:59.348000 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa78298-c117-4385-90f7-43d7d63f9b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:59.366246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2fa78298-c117-4385-90f7-43d7d63f9b3c None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:40:59.367476 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2fa78298-c117-4385-90f7-43d7d63f9b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:59.437408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1261/2531] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:40:59.449999 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40025f-f48e-46b2-ae2f-75fc443aa399 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:59.452310 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-7c40025f-f48e-46b2-ae2f-75fc443aa399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:59.514467 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40025f-f48e-46b2-ae2f-75fc443aa399 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:59.518937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ead2d2-e9e2-45da-a5d1-1f98cf124a72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:59.519633 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ead2d2-e9e2-45da-a5d1-1f98cf124a72 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:59.519915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ead2d2-e9e2-45da-a5d1-1f98cf124a72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:59.520213 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ead2d2-e9e2-45da-a5d1-1f98cf124a72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:59.531403 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ead2d2-e9e2-45da-a5d1-1f98cf124a72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:59.532970 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ead2d2-e9e2-45da-a5d1-1f98cf124a72 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:59.545377 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1271/2532] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:40:59.850282 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa78298-c117-4385-90f7-43d7d63f9b3c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:59.851812 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2fa78298-c117-4385-90f7-43d7d63f9b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:40:59.870311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa78298-c117-4385-90f7-43d7d63f9b3c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:40:59.877668 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27515482-0304-4e26-9aa2-0bfc635a22a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:40:59.878632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27515482-0304-4e26-9aa2-0bfc635a22a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:40:59.879050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27515482-0304-4e26-9aa2-0bfc635a22a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:40:59.879556 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27515482-0304-4e26-9aa2-0bfc635a22a2 admin admin] PATH_INFO: `/v3/projects/5e9599d871b54f3c9b7da12b6fdde1c8` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:40:59.881371 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27515482-0304-4e26-9aa2-0bfc635a22a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e9599d871b54f3c9b7da12b6fdde1c8)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:40:59.884450 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27515482-0304-4e26-9aa2-0bfc635a22a2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:40:59.938878 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-27515482-0304-4e26-9aa2-0bfc635a22a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e9599d871b54f3c9b7da12b6fdde1c8', 'request_id': 'req-27515482-0304-4e26-9aa2-0bfc635a22a2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:59.944757 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-27515482-0304-4e26-9aa2-0bfc635a22a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e9599d871b54f3c9b7da12b6fdde1c8', 'request_id': 'req-27515482-0304-4e26-9aa2-0bfc635a22a2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:59.954843 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-27515482-0304-4e26-9aa2-0bfc635a22a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e9599d871b54f3c9b7da12b6fdde1c8', 'request_id': 'req-27515482-0304-4e26-9aa2-0bfc635a22a2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:59.967510 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-27515482-0304-4e26-9aa2-0bfc635a22a2 admin admin] The token cache is being invalidate because project 5e9599d871b54f3c9b7da12b6fdde1c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:40:59.967686 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-27515482-0304-4e26-9aa2-0bfc635a22a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:59.968337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-27515482-0304-4e26-9aa2-0bfc635a22a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:40:59.970030 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1262/2533] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:40:59 2022] DELETE /identity/v3/projects/5e9599d871b54f3c9b7da12b6fdde1c8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:40:59.974263 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ead2d2-e9e2-45da-a5d1-1f98cf124a72 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:40:59.985149 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ead2d2-e9e2-45da-a5d1-1f98cf124a72 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:00.050288 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687bd12-7c83-4022-87b1-bdce598b05d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:00.051171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687bd12-7c83-4022-87b1-bdce598b05d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:00.051454 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687bd12-7c83-4022-87b1-bdce598b05d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:00.051729 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687bd12-7c83-4022-87b1-bdce598b05d0 admin admin] PATH_INFO: `/v3/users/b1d35a8d30ca43ba9f69d8fa8ff1d473` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:00.052972 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687bd12-7c83-4022-87b1-bdce598b05d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d35a8d30ca43ba9f69d8fa8ff1d473)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:00.054970 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687bd12-7c83-4022-87b1-bdce598b05d0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:00.109595 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b687bd12-7c83-4022-87b1-bdce598b05d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d35a8d30ca43ba9f69d8fa8ff1d473'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:00.110342 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b687bd12-7c83-4022-87b1-bdce598b05d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d35a8d30ca43ba9f69d8fa8ff1d473'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:00.111037 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b687bd12-7c83-4022-87b1-bdce598b05d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d35a8d30ca43ba9f69d8fa8ff1d473'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:00.125063 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b687bd12-7c83-4022-87b1-bdce598b05d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d35a8d30ca43ba9f69d8fa8ff1d473'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:00.126236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:00.132857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-b687bd12-7c83-4022-87b1-bdce598b05d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d35a8d30ca43ba9f69d8fa8ff1d473'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:00.150882 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1272/2534] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:40:59 2022] DELETE /identity/v3/users/b1d35a8d30ca43ba9f69d8fa8ff1d473 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:00.453270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27515482-0304-4e26-9aa2-0bfc635a22a2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:00.454768 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-27515482-0304-4e26-9aa2-0bfc635a22a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:00.468196 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27515482-0304-4e26-9aa2-0bfc635a22a2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:00.525082 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:00.531909 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3066171-9f93-48bb-ad25-1707440d31c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:00.533034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3066171-9f93-48bb-ad25-1707440d31c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:00.533326 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3066171-9f93-48bb-ad25-1707440d31c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:00.533626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3066171-9f93-48bb-ad25-1707440d31c2 admin admin] PATH_INFO: `/v3/projects/96c9c928f9b94d35be1f8409840140f9` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:00.535157 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3066171-9f93-48bb-ad25-1707440d31c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c9c928f9b94d35be1f8409840140f9)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:00.537812 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3066171-9f93-48bb-ad25-1707440d31c2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:00.587529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f3066171-9f93-48bb-ad25-1707440d31c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c9c928f9b94d35be1f8409840140f9', 'request_id': 'req-f3066171-9f93-48bb-ad25-1707440d31c2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:00.593110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f3066171-9f93-48bb-ad25-1707440d31c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c9c928f9b94d35be1f8409840140f9', 'request_id': 'req-f3066171-9f93-48bb-ad25-1707440d31c2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:00.603303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f3066171-9f93-48bb-ad25-1707440d31c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c9c928f9b94d35be1f8409840140f9', 'request_id': 'req-f3066171-9f93-48bb-ad25-1707440d31c2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:00.614914 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f3066171-9f93-48bb-ad25-1707440d31c2 admin admin] The token cache is being invalidate because project 96c9c928f9b94d35be1f8409840140f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:41:00.615198 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f3066171-9f93-48bb-ad25-1707440d31c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:00.615858 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f3066171-9f93-48bb-ad25-1707440d31c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:00.617526 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1263/2535] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:41:00 2022] DELETE /identity/v3/projects/96c9c928f9b94d35be1f8409840140f9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:00.622654 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988024c0-87f9-43f5-b02c-038cf3026694 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:00.623126 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988024c0-87f9-43f5-b02c-038cf3026694 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:00.623239 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988024c0-87f9-43f5-b02c-038cf3026694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:00.642625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-988024c0-87f9-43f5-b02c-038cf3026694 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:00.643830 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-988024c0-87f9-43f5-b02c-038cf3026694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:00.707564 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1273/2536] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:00.715675 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7343a-0733-40c6-8072-86f7bf55ef8c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:00.715968 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7343a-0733-40c6-8072-86f7bf55ef8c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:00.716270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7343a-0733-40c6-8072-86f7bf55ef8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:00.735582 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-cbe7343a-0733-40c6-8072-86f7bf55ef8c None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:00.736718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cbe7343a-0733-40c6-8072-86f7bf55ef8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:00.746105 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1264/2537] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:00.750823 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988024c0-87f9-43f5-b02c-038cf3026694 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:00.761983 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988024c0-87f9-43f5-b02c-038cf3026694 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:00.768541 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae503e41-b586-4cf7-a16b-adce064518d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:00.769221 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae503e41-b586-4cf7-a16b-adce064518d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:00.769509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae503e41-b586-4cf7-a16b-adce064518d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:00.769791 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae503e41-b586-4cf7-a16b-adce064518d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:00.770530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae503e41-b586-4cf7-a16b-adce064518d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:41:00.770844 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae503e41-b586-4cf7-a16b-adce064518d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:00.772532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae503e41-b586-4cf7-a16b-adce064518d9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:00.785111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1274/2538] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:41:00.789722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7343a-0733-40c6-8072-86f7bf55ef8c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:00.799716 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7343a-0733-40c6-8072-86f7bf55ef8c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:00.805754 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a297613-4b2f-46e2-9edf-b921a365fa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:00.806421 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a297613-4b2f-46e2-9edf-b921a365fa00 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:00.806675 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a297613-4b2f-46e2-9edf-b921a365fa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:00.806944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a297613-4b2f-46e2-9edf-b921a365fa00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:00.807631 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a297613-4b2f-46e2-9edf-b921a365fa00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:00.809587 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a297613-4b2f-46e2-9edf-b921a365fa00 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:00.841727 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1265/2539] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:41:00 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:41:00.847918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae503e41-b586-4cf7-a16b-adce064518d9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:00.859064 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae503e41-b586-4cf7-a16b-adce064518d9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:00.915864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b8da1-f772-453f-bb12-266c202a71a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:00.916569 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b8da1-f772-453f-bb12-266c202a71a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:00.916855 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b8da1-f772-453f-bb12-266c202a71a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:00.917107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b8da1-f772-453f-bb12-266c202a71a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:00.917800 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b8da1-f772-453f-bb12-266c202a71a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:00.919772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b8da1-f772-453f-bb12-266c202a71a9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:00.944605 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1275/2540] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:41:00 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:00.949247 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a297613-4b2f-46e2-9edf-b921a365fa00 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:00.959901 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a297613-4b2f-46e2-9edf-b921a365fa00 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:00.964822 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208a935-a529-43bc-9731-68bb0b5a61ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:00.965487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208a935-a529-43bc-9731-68bb0b5a61ea admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:00.965771 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208a935-a529-43bc-9731-68bb0b5a61ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:00.966046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208a935-a529-43bc-9731-68bb0b5a61ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:00.966770 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208a935-a529-43bc-9731-68bb0b5a61ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:00.968522 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208a935-a529-43bc-9731-68bb0b5a61ea admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:00.979243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1266/2541] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:00.983406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b8da1-f772-453f-bb12-266c202a71a9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:00.994310 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b8da1-f772-453f-bb12-266c202a71a9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:00.998914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49696321-16c0-4838-b4c2-0ec0c740e467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:00.999693 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49696321-16c0-4838-b4c2-0ec0c740e467 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:00.999994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49696321-16c0-4838-b4c2-0ec0c740e467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:01.000311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49696321-16c0-4838-b4c2-0ec0c740e467 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:01.001058 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49696321-16c0-4838-b4c2-0ec0c740e467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:01.002673 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49696321-16c0-4838-b4c2-0ec0c740e467 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:01.014546 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1276/2542] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:41:01.019198 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208a935-a529-43bc-9731-68bb0b5a61ea admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:01.029645 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208a935-a529-43bc-9731-68bb0b5a61ea admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:01.035183 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592918b7-27f3-4352-96bd-f7289794e749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:01.036123 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592918b7-27f3-4352-96bd-f7289794e749 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:01.036408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592918b7-27f3-4352-96bd-f7289794e749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:01.036687 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592918b7-27f3-4352-96bd-f7289794e749 admin admin] PATH_INFO: `/v3/projects/02defa7b108a4d77927d497177041024/users/d1162013d8c1478cb54aa285b8859ae3/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:01.052317 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592918b7-27f3-4352-96bd-f7289794e749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02defa7b108a4d77927d497177041024, user_id=d1162013d8c1478cb54aa285b8859ae3, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:01.055026 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592918b7-27f3-4352-96bd-f7289794e749 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:01.071508 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1267/2543] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:01 2022] PUT /identity/v3/projects/02defa7b108a4d77927d497177041024/users/d1162013d8c1478cb54aa285b8859ae3/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:01.083858 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aefef5-f8ca-406a-a6ba-e200579ec735 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:01.084180 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aefef5-f8ca-406a-a6ba-e200579ec735 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:01.084455 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aefef5-f8ca-406a-a6ba-e200579ec735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:01.113266 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c4aefef5-f8ca-406a-a6ba-e200579ec735 None None] MFA Rules not processed for user `d1162013d8c1478cb54aa285b8859ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:01.114501 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c4aefef5-f8ca-406a-a6ba-e200579ec735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:01.157621 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:01.193224 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1277/2544] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:01.207555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592918b7-27f3-4352-96bd-f7289794e749 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:01.210594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-592918b7-27f3-4352-96bd-f7289794e749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:01.276504 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592918b7-27f3-4352-96bd-f7289794e749 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:01.280563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564675d8-6b82-430d-84fd-082f6555caca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:01.281238 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564675d8-6b82-430d-84fd-082f6555caca service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:01.281668 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564675d8-6b82-430d-84fd-082f6555caca service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:01.281943 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564675d8-6b82-430d-84fd-082f6555caca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:01.290949 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564675d8-6b82-430d-84fd-082f6555caca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:01.292423 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564675d8-6b82-430d-84fd-082f6555caca service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:01.302524 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1268/2545] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:06.760997 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aefef5-f8ca-406a-a6ba-e200579ec735 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:06.830510 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aefef5-f8ca-406a-a6ba-e200579ec735 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:06.836445 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6300ddf-53b3-4b96-8b0d-bdd8946d8412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:06.837331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6300ddf-53b3-4b96-8b0d-bdd8946d8412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:06.837614 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6300ddf-53b3-4b96-8b0d-bdd8946d8412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:06.837886 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6300ddf-53b3-4b96-8b0d-bdd8946d8412 admin admin] PATH_INFO: `/v3/users/d1162013d8c1478cb54aa285b8859ae3` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:06.839166 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6300ddf-53b3-4b96-8b0d-bdd8946d8412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1162013d8c1478cb54aa285b8859ae3)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:06.841199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6300ddf-53b3-4b96-8b0d-bdd8946d8412 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:06.892937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c6300ddf-53b3-4b96-8b0d-bdd8946d8412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1162013d8c1478cb54aa285b8859ae3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:06.893617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c6300ddf-53b3-4b96-8b0d-bdd8946d8412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1162013d8c1478cb54aa285b8859ae3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:06.894384 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c6300ddf-53b3-4b96-8b0d-bdd8946d8412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1162013d8c1478cb54aa285b8859ae3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:06.906450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c6300ddf-53b3-4b96-8b0d-bdd8946d8412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1162013d8c1478cb54aa285b8859ae3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:06.913488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c6300ddf-53b3-4b96-8b0d-bdd8946d8412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1162013d8c1478cb54aa285b8859ae3'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:06.928727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1278/2546] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:41:06 2022] DELETE /identity/v3/users/d1162013d8c1478cb54aa285b8859ae3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:06.933544 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199b77d-ad38-439b-9526-23adce64d9b7 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:06.934040 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199b77d-ad38-439b-9526-23adce64d9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:06.934147 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199b77d-ad38-439b-9526-23adce64d9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:06.952414 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-0199b77d-ad38-439b-9526-23adce64d9b7 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:06.953635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0199b77d-ad38-439b-9526-23adce64d9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:06.975891 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:07.018240 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1269/2547] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:07.028066 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6300ddf-53b3-4b96-8b0d-bdd8946d8412 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:07.029727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c6300ddf-53b3-4b96-8b0d-bdd8946d8412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:07.101932 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6300ddf-53b3-4b96-8b0d-bdd8946d8412 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:07.105808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657b681-f9d4-4088-9666-f039d93d3bf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:07.106442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657b681-f9d4-4088-9666-f039d93d3bf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:07.106725 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657b681-f9d4-4088-9666-f039d93d3bf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:07.107001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657b681-f9d4-4088-9666-f039d93d3bf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:07.116711 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657b681-f9d4-4088-9666-f039d93d3bf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:07.118173 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657b681-f9d4-4088-9666-f039d93d3bf7 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:07.123069 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:07.128697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1279/2548] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:07.415414 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199b77d-ad38-439b-9526-23adce64d9b7 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:07.416953 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0199b77d-ad38-439b-9526-23adce64d9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:07.429674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199b77d-ad38-439b-9526-23adce64d9b7 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:07.434821 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebebd5-5f00-4dd8-8130-b9637b779f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:07.435692 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebebd5-5f00-4dd8-8130-b9637b779f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:07.435980 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebebd5-5f00-4dd8-8130-b9637b779f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:07.436398 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebebd5-5f00-4dd8-8130-b9637b779f1e admin admin] PATH_INFO: `/v3/projects/02defa7b108a4d77927d497177041024` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:07.437844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebebd5-5f00-4dd8-8130-b9637b779f1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=02defa7b108a4d77927d497177041024)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:07.439531 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebebd5-5f00-4dd8-8130-b9637b779f1e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:07.492409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cdebebd5-5f00-4dd8-8130-b9637b779f1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02defa7b108a4d77927d497177041024', 'request_id': 'req-cdebebd5-5f00-4dd8-8130-b9637b779f1e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:07.498868 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cdebebd5-5f00-4dd8-8130-b9637b779f1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02defa7b108a4d77927d497177041024', 'request_id': 'req-cdebebd5-5f00-4dd8-8130-b9637b779f1e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:07.508606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cdebebd5-5f00-4dd8-8130-b9637b779f1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02defa7b108a4d77927d497177041024', 'request_id': 'req-cdebebd5-5f00-4dd8-8130-b9637b779f1e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:07.526391 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cdebebd5-5f00-4dd8-8130-b9637b779f1e admin admin] The token cache is being invalidate because project 02defa7b108a4d77927d497177041024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:41:07.526631 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cdebebd5-5f00-4dd8-8130-b9637b779f1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:07.527626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cdebebd5-5f00-4dd8-8130-b9637b779f1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:07.529980 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1270/2549] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:41:07 2022] DELETE /identity/v3/projects/02defa7b108a4d77927d497177041024 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:07.536585 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17562d-8385-4207-b8eb-a18593cd9aad None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:07.536953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17562d-8385-4207-b8eb-a18593cd9aad None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:07.537325 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17562d-8385-4207-b8eb-a18593cd9aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:07.556450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ab17562d-8385-4207-b8eb-a18593cd9aad None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:07.557670 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ab17562d-8385-4207-b8eb-a18593cd9aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:07.630097 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1280/2550] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:07.638399 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86172897-e391-4ab8-83bd-d98be416f98c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:07.638911 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86172897-e391-4ab8-83bd-d98be416f98c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:07.639186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86172897-e391-4ab8-83bd-d98be416f98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:07.658831 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-86172897-e391-4ab8-83bd-d98be416f98c None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:07.660289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-86172897-e391-4ab8-83bd-d98be416f98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:07.668968 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1271/2551] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:07.673672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17562d-8385-4207-b8eb-a18593cd9aad None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:07.684494 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17562d-8385-4207-b8eb-a18593cd9aad None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:07.690157 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81843992-2e29-42e9-acae-b3a0eae28a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:07.690835 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81843992-2e29-42e9-acae-b3a0eae28a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:07.691126 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81843992-2e29-42e9-acae-b3a0eae28a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:07.691636 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81843992-2e29-42e9-acae-b3a0eae28a8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:07.692429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81843992-2e29-42e9-acae-b3a0eae28a8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:41:07.692762 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81843992-2e29-42e9-acae-b3a0eae28a8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:07.694435 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81843992-2e29-42e9-acae-b3a0eae28a8a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:07.707235 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1281/2552] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 16:41:07.711948 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86172897-e391-4ab8-83bd-d98be416f98c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:07.721400 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86172897-e391-4ab8-83bd-d98be416f98c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:07.726498 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad922735-ce0f-44f3-bfe3-4d9e305f6399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:07.727156 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad922735-ce0f-44f3-bfe3-4d9e305f6399 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:07.727440 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad922735-ce0f-44f3-bfe3-4d9e305f6399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:07.727714 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad922735-ce0f-44f3-bfe3-4d9e305f6399 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:07.728439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad922735-ce0f-44f3-bfe3-4d9e305f6399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:07.730385 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad922735-ce0f-44f3-bfe3-4d9e305f6399 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:07.757518 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1272/2553] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:41:07 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:07.761877 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81843992-2e29-42e9-acae-b3a0eae28a8a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:07.772787 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81843992-2e29-42e9-acae-b3a0eae28a8a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:07.836840 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7f46e-df74-4a34-90ff-a53b01fd6402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:07.837544 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7f46e-df74-4a34-90ff-a53b01fd6402 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:07.837817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7f46e-df74-4a34-90ff-a53b01fd6402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:07.838083 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7f46e-df74-4a34-90ff-a53b01fd6402 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:07.838799 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7f46e-df74-4a34-90ff-a53b01fd6402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:07.840763 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7f46e-df74-4a34-90ff-a53b01fd6402 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:07.863269 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1282/2554] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:41:07 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:41:07.868992 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad922735-ce0f-44f3-bfe3-4d9e305f6399 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:07.880554 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad922735-ce0f-44f3-bfe3-4d9e305f6399 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:07.886402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1d613-c1a0-4319-a63e-cb704f06fe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:07.887060 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1d613-c1a0-4319-a63e-cb704f06fe83 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:07.887338 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1d613-c1a0-4319-a63e-cb704f06fe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:07.887610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1d613-c1a0-4319-a63e-cb704f06fe83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:07.888368 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1d613-c1a0-4319-a63e-cb704f06fe83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:07.889981 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1d613-c1a0-4319-a63e-cb704f06fe83 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:07.900789 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1273/2555] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:07.905633 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7f46e-df74-4a34-90ff-a53b01fd6402 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:07.916190 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7f46e-df74-4a34-90ff-a53b01fd6402 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:07.920865 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9782dcb-be5e-471e-84af-0c09d05afe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:07.921522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9782dcb-be5e-471e-84af-0c09d05afe3a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:07.921796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9782dcb-be5e-471e-84af-0c09d05afe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:07.922066 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9782dcb-be5e-471e-84af-0c09d05afe3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:07.922784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9782dcb-be5e-471e-84af-0c09d05afe3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:07.924439 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9782dcb-be5e-471e-84af-0c09d05afe3a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:07.934444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1283/2556] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:41:07.940866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1d613-c1a0-4319-a63e-cb704f06fe83 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:07.954244 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1d613-c1a0-4319-a63e-cb704f06fe83 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:07.961356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a55306-30ae-4bad-ac94-fc6a15d73368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:07.962252 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a55306-30ae-4bad-ac94-fc6a15d73368 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:07.962535 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a55306-30ae-4bad-ac94-fc6a15d73368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:07.962808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a55306-30ae-4bad-ac94-fc6a15d73368 admin admin] PATH_INFO: `/v3/projects/71da0d9d258b454f98976f6274a9414b/users/43fe66e21804428ab65aa7b8deeca09c/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:07.979694 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a55306-30ae-4bad-ac94-fc6a15d73368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71da0d9d258b454f98976f6274a9414b, user_id=43fe66e21804428ab65aa7b8deeca09c, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:07.982445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a55306-30ae-4bad-ac94-fc6a15d73368 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:07.998197 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1274/2557] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:07 2022] PUT /identity/v3/projects/71da0d9d258b454f98976f6274a9414b/users/43fe66e21804428ab65aa7b8deeca09c/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:08.008846 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6e8f2-9501-4c10-9fa4-b6b52f4bd402 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:08.009140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6e8f2-9501-4c10-9fa4-b6b52f4bd402 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:08.009416 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6e8f2-9501-4c10-9fa4-b6b52f4bd402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:08.036587 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-20c6e8f2-9501-4c10-9fa4-b6b52f4bd402 None None] MFA Rules not processed for user `43fe66e21804428ab65aa7b8deeca09c`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:08.037838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-20c6e8f2-9501-4c10-9fa4-b6b52f4bd402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:08.104860 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:08.114711 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1284/2558] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:08.119184 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a55306-30ae-4bad-ac94-fc6a15d73368 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:08.175961 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:08.194234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a55306-30ae-4bad-ac94-fc6a15d73368 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:08.199616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1436c2-0e2a-4e43-91d4-75549ae5cc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:08.200318 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1436c2-0e2a-4e43-91d4-75549ae5cc11 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:08.200605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1436c2-0e2a-4e43-91d4-75549ae5cc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:08.200884 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1436c2-0e2a-4e43-91d4-75549ae5cc11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:08.201591 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1436c2-0e2a-4e43-91d4-75549ae5cc11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:08.203523 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1436c2-0e2a-4e43-91d4-75549ae5cc11 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:08.234971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1275/2559] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:41:08 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:41:08.239307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6e8f2-9501-4c10-9fa4-b6b52f4bd402 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:08.250339 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6e8f2-9501-4c10-9fa4-b6b52f4bd402 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:08.318262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c89db-fa2a-4584-a631-9cb94e02b8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:08.318971 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c89db-fa2a-4584-a631-9cb94e02b8aa admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:08.319257 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c89db-fa2a-4584-a631-9cb94e02b8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:08.319554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c89db-fa2a-4584-a631-9cb94e02b8aa admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:08.320625 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c89db-fa2a-4584-a631-9cb94e02b8aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:08.322595 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c89db-fa2a-4584-a631-9cb94e02b8aa admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:08.346707 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1285/2560] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:41:08 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:08.351165 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1436c2-0e2a-4e43-91d4-75549ae5cc11 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:08.362106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1436c2-0e2a-4e43-91d4-75549ae5cc11 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:08.368095 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5356d59-98a0-490b-90e9-bad04535c853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:08.368866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5356d59-98a0-490b-90e9-bad04535c853 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:08.369207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5356d59-98a0-490b-90e9-bad04535c853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:08.369513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5356d59-98a0-490b-90e9-bad04535c853 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:08.370322 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5356d59-98a0-490b-90e9-bad04535c853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:08.371955 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5356d59-98a0-490b-90e9-bad04535c853 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:08.383366 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1276/2561] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:08.387804 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c89db-fa2a-4584-a631-9cb94e02b8aa admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:08.398953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c89db-fa2a-4584-a631-9cb94e02b8aa admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:08.405153 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0d9a7-740f-4a4c-82e3-a8b7ba022cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:08.406041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0d9a7-740f-4a4c-82e3-a8b7ba022cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:08.406313 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0d9a7-740f-4a4c-82e3-a8b7ba022cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:08.406583 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0d9a7-740f-4a4c-82e3-a8b7ba022cd4 admin admin] PATH_INFO: `/v3/projects/00ae7ace5b4345739d88f55e2b6f487a/users/4eb9c82a1d354b44a93687188501b1a2/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:08.430262 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0d9a7-740f-4a4c-82e3-a8b7ba022cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ae7ace5b4345739d88f55e2b6f487a, user_id=4eb9c82a1d354b44a93687188501b1a2, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:08.434215 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0d9a7-740f-4a4c-82e3-a8b7ba022cd4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:08.452480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1286/2562] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:08 2022] PUT /identity/v3/projects/00ae7ace5b4345739d88f55e2b6f487a/users/4eb9c82a1d354b44a93687188501b1a2/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:08.457158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5356d59-98a0-490b-90e9-bad04535c853 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:08.471720 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5356d59-98a0-490b-90e9-bad04535c853 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:08.533105 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56265c3f-b2f3-41c4-a24c-cbec61e47ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:08.533787 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56265c3f-b2f3-41c4-a24c-cbec61e47ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:08.534099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56265c3f-b2f3-41c4-a24c-cbec61e47ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:08.534372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56265c3f-b2f3-41c4-a24c-cbec61e47ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:08.535210 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56265c3f-b2f3-41c4-a24c-cbec61e47ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:08.536884 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56265c3f-b2f3-41c4-a24c-cbec61e47ac4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:08.547006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1277/2563] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:08.551428 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0d9a7-740f-4a4c-82e3-a8b7ba022cd4 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:08.562025 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0d9a7-740f-4a4c-82e3-a8b7ba022cd4 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:08.567126 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53667c6d-9c36-4850-9c52-55f5868f4f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:08.568003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53667c6d-9c36-4850-9c52-55f5868f4f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:08.568310 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53667c6d-9c36-4850-9c52-55f5868f4f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:08.568578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53667c6d-9c36-4850-9c52-55f5868f4f0f admin admin] PATH_INFO: `/v3/projects/00ae7ace5b4345739d88f55e2b6f487a/users/4eb9c82a1d354b44a93687188501b1a2/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:08.570929 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53667c6d-9c36-4850-9c52-55f5868f4f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ae7ace5b4345739d88f55e2b6f487a, user_id=4eb9c82a1d354b44a93687188501b1a2, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:08.573611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53667c6d-9c36-4850-9c52-55f5868f4f0f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:08.585006 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1287/2564] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:08 2022] PUT /identity/v3/projects/00ae7ace5b4345739d88f55e2b6f487a/users/4eb9c82a1d354b44a93687188501b1a2/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:08.596408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d67f2-57a9-4f9a-a224-6fd8619384a8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:08.596701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d67f2-57a9-4f9a-a224-6fd8619384a8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:08.596951 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d67f2-57a9-4f9a-a224-6fd8619384a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:08.624951 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-366d67f2-57a9-4f9a-a224-6fd8619384a8 None None] MFA Rules not processed for user `4eb9c82a1d354b44a93687188501b1a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:08.626076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-366d67f2-57a9-4f9a-a224-6fd8619384a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:08.697206 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1278/2565] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:08.709152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53667c6d-9c36-4850-9c52-55f5868f4f0f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:08.711154 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-53667c6d-9c36-4850-9c52-55f5868f4f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:08.769944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53667c6d-9c36-4850-9c52-55f5868f4f0f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:08.773956 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90553974-6e42-48d6-a4ea-f31ddd36b33c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:08.774608 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90553974-6e42-48d6-a4ea-f31ddd36b33c service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:08.774886 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90553974-6e42-48d6-a4ea-f31ddd36b33c service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:08.775162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90553974-6e42-48d6-a4ea-f31ddd36b33c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:08.840929 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90553974-6e42-48d6-a4ea-f31ddd36b33c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:08.842413 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90553974-6e42-48d6-a4ea-f31ddd36b33c service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:08.852619 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1288/2566] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:11.432790 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d67f2-57a9-4f9a-a224-6fd8619384a8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:11.484097 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:11.503051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d67f2-57a9-4f9a-a224-6fd8619384a8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:11.508101 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890dbed6-34f6-4638-8014-a696960af6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:11.508986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dbed6-34f6-4638-8014-a696960af6ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:11.509266 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dbed6-34f6-4638-8014-a696960af6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:11.509545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dbed6-34f6-4638-8014-a696960af6ae admin admin] PATH_INFO: `/v3/users/43fe66e21804428ab65aa7b8deeca09c` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:11.510750 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890dbed6-34f6-4638-8014-a696960af6ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=43fe66e21804428ab65aa7b8deeca09c)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:11.512714 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890dbed6-34f6-4638-8014-a696960af6ae admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:11.562020 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-890dbed6-34f6-4638-8014-a696960af6ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43fe66e21804428ab65aa7b8deeca09c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:11.572478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-890dbed6-34f6-4638-8014-a696960af6ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43fe66e21804428ab65aa7b8deeca09c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:11.585027 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-890dbed6-34f6-4638-8014-a696960af6ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43fe66e21804428ab65aa7b8deeca09c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:11.591904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-890dbed6-34f6-4638-8014-a696960af6ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43fe66e21804428ab65aa7b8deeca09c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:11.592613 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-890dbed6-34f6-4638-8014-a696960af6ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43fe66e21804428ab65aa7b8deeca09c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:11.598568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1279/2567] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:41:11 2022] DELETE /identity/v3/users/43fe66e21804428ab65aa7b8deeca09c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:11.604958 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425cca5-e634-477b-b76e-bd1d97b151ba None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:11.605458 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425cca5-e634-477b-b76e-bd1d97b151ba None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:11.605557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425cca5-e634-477b-b76e-bd1d97b151ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:11.614535 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:11.628948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-5425cca5-e634-477b-b76e-bd1d97b151ba None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:11.630179 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5425cca5-e634-477b-b76e-bd1d97b151ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:11.707345 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1289/2568] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:11.717769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890dbed6-34f6-4638-8014-a696960af6ae admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:11.719343 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-890dbed6-34f6-4638-8014-a696960af6ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:11.780857 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890dbed6-34f6-4638-8014-a696960af6ae admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:11.784512 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1aaa8f-520f-432f-b89c-490ac35ac7a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:11.785169 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1aaa8f-520f-432f-b89c-490ac35ac7a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:11.785452 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1aaa8f-520f-432f-b89c-490ac35ac7a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:11.785725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1aaa8f-520f-432f-b89c-490ac35ac7a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:11.795824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1aaa8f-520f-432f-b89c-490ac35ac7a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:11.797320 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1aaa8f-520f-432f-b89c-490ac35ac7a6 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:11.807517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1280/2569] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:12.087110 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425cca5-e634-477b-b76e-bd1d97b151ba None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:12.088866 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5425cca5-e634-477b-b76e-bd1d97b151ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:12.103807 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425cca5-e634-477b-b76e-bd1d97b151ba None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:12.109492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec31e2-4913-4820-9692-d305e34a26db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:12.110384 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec31e2-4913-4820-9692-d305e34a26db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:12.110668 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec31e2-4913-4820-9692-d305e34a26db admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:12.110944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec31e2-4913-4820-9692-d305e34a26db admin admin] PATH_INFO: `/v3/projects/71da0d9d258b454f98976f6274a9414b` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:12.112320 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec31e2-4913-4820-9692-d305e34a26db admin admin] RBAC: Authorizing `identity:delete_project(project_id=71da0d9d258b454f98976f6274a9414b)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:12.115061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec31e2-4913-4820-9692-d305e34a26db admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:12.163299 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8eec31e2-4913-4820-9692-d305e34a26db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71da0d9d258b454f98976f6274a9414b', 'request_id': 'req-8eec31e2-4913-4820-9692-d305e34a26db'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:12.172458 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8eec31e2-4913-4820-9692-d305e34a26db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71da0d9d258b454f98976f6274a9414b', 'request_id': 'req-8eec31e2-4913-4820-9692-d305e34a26db'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:12.179932 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8eec31e2-4913-4820-9692-d305e34a26db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71da0d9d258b454f98976f6274a9414b', 'request_id': 'req-8eec31e2-4913-4820-9692-d305e34a26db'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:12.190042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8eec31e2-4913-4820-9692-d305e34a26db admin admin] The token cache is being invalidate because project 71da0d9d258b454f98976f6274a9414b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:41:12.190334 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8eec31e2-4913-4820-9692-d305e34a26db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:12.190967 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8eec31e2-4913-4820-9692-d305e34a26db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:12.193836 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1290/2570] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:41:12 2022] DELETE /identity/v3/projects/71da0d9d258b454f98976f6274a9414b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:12.198058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1aaa8f-520f-432f-b89c-490ac35ac7a6 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:12.208101 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1aaa8f-520f-432f-b89c-490ac35ac7a6 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:12.271289 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29416a98-9987-4754-8c19-f3cfee82b534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:12.272345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29416a98-9987-4754-8c19-f3cfee82b534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:12.272632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29416a98-9987-4754-8c19-f3cfee82b534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:12.272908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29416a98-9987-4754-8c19-f3cfee82b534 admin admin] PATH_INFO: `/v3/users/4eb9c82a1d354b44a93687188501b1a2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:12.274177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29416a98-9987-4754-8c19-f3cfee82b534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eb9c82a1d354b44a93687188501b1a2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:12.276169 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29416a98-9987-4754-8c19-f3cfee82b534 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:12.281213 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:12.333093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-29416a98-9987-4754-8c19-f3cfee82b534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eb9c82a1d354b44a93687188501b1a2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:12.342882 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-29416a98-9987-4754-8c19-f3cfee82b534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eb9c82a1d354b44a93687188501b1a2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:12.360821 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-29416a98-9987-4754-8c19-f3cfee82b534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eb9c82a1d354b44a93687188501b1a2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:12.369844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-29416a98-9987-4754-8c19-f3cfee82b534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eb9c82a1d354b44a93687188501b1a2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:12.370669 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-29416a98-9987-4754-8c19-f3cfee82b534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eb9c82a1d354b44a93687188501b1a2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:12.377323 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1281/2571] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:41:12 2022] DELETE /identity/v3/users/4eb9c82a1d354b44a93687188501b1a2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:12.679675 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec31e2-4913-4820-9692-d305e34a26db admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:12.681746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-8eec31e2-4913-4820-9692-d305e34a26db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:12.696808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec31e2-4913-4820-9692-d305e34a26db admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:12.763678 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6188dfe-2746-4619-9222-db920eee6e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:12.764644 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6188dfe-2746-4619-9222-db920eee6e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:12.764923 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6188dfe-2746-4619-9222-db920eee6e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:12.765194 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6188dfe-2746-4619-9222-db920eee6e82 admin admin] PATH_INFO: `/v3/projects/00ae7ace5b4345739d88f55e2b6f487a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:12.766481 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6188dfe-2746-4619-9222-db920eee6e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00ae7ace5b4345739d88f55e2b6f487a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:12.768498 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6188dfe-2746-4619-9222-db920eee6e82 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:12.806974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:12.829159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6188dfe-2746-4619-9222-db920eee6e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00ae7ace5b4345739d88f55e2b6f487a', 'request_id': 'req-e6188dfe-2746-4619-9222-db920eee6e82'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:12.839430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6188dfe-2746-4619-9222-db920eee6e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00ae7ace5b4345739d88f55e2b6f487a', 'request_id': 'req-e6188dfe-2746-4619-9222-db920eee6e82'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:12.847149 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6188dfe-2746-4619-9222-db920eee6e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00ae7ace5b4345739d88f55e2b6f487a', 'request_id': 'req-e6188dfe-2746-4619-9222-db920eee6e82'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:12.859303 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6188dfe-2746-4619-9222-db920eee6e82 admin admin] The token cache is being invalidate because project 00ae7ace5b4345739d88f55e2b6f487a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:41:12.859576 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6188dfe-2746-4619-9222-db920eee6e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:12.860276 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e6188dfe-2746-4619-9222-db920eee6e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:12.861860 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1291/2572] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:41:12 2022] DELETE /identity/v3/projects/00ae7ace5b4345739d88f55e2b6f487a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:12.867398 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384c19c-7887-44d5-855f-f7ac88564c9b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:12.867957 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384c19c-7887-44d5-855f-f7ac88564c9b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:12.868109 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384c19c-7887-44d5-855f-f7ac88564c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:12.888403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-7384c19c-7887-44d5-855f-f7ac88564c9b None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:12.889639 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7384c19c-7887-44d5-855f-f7ac88564c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:12.953712 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1282/2573] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:12.966223 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7f84a-2ac7-4c72-afce-0b4e7ede6197 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:12.966614 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7f84a-2ac7-4c72-afce-0b4e7ede6197 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:12.966917 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7f84a-2ac7-4c72-afce-0b4e7ede6197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:12.988822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6fb7f84a-2ac7-4c72-afce-0b4e7ede6197 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:12.990552 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6fb7f84a-2ac7-4c72-afce-0b4e7ede6197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:13.000261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1292/2574] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:13.006893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384c19c-7887-44d5-855f-f7ac88564c9b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:13.017656 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384c19c-7887-44d5-855f-f7ac88564c9b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:13.023410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153262a-e074-4c42-8a60-63f0d4295f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:13.024106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153262a-e074-4c42-8a60-63f0d4295f75 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:13.024385 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153262a-e074-4c42-8a60-63f0d4295f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:13.024630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153262a-e074-4c42-8a60-63f0d4295f75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:13.025372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153262a-e074-4c42-8a60-63f0d4295f75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:41:13.025681 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153262a-e074-4c42-8a60-63f0d4295f75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:13.027405 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153262a-e074-4c42-8a60-63f0d4295f75 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:13.040743 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1283/2575] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:41:13.045311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7f84a-2ac7-4c72-afce-0b4e7ede6197 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:13.055553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7f84a-2ac7-4c72-afce-0b4e7ede6197 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:13.061313 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f606f-fc98-4473-8b65-20b65c333212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:13.061979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f606f-fc98-4473-8b65-20b65c333212 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:13.062260 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f606f-fc98-4473-8b65-20b65c333212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:13.062533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f606f-fc98-4473-8b65-20b65c333212 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:13.063240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f606f-fc98-4473-8b65-20b65c333212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:13.065242 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f606f-fc98-4473-8b65-20b65c333212 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:13.098162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1293/2576] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:41:13 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:41:13.099351 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153262a-e074-4c42-8a60-63f0d4295f75 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:13.110971 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153262a-e074-4c42-8a60-63f0d4295f75 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:13.175349 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec73f12-9e5d-49c3-97a6-3b94fff1a813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:13.176066 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec73f12-9e5d-49c3-97a6-3b94fff1a813 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:13.176381 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec73f12-9e5d-49c3-97a6-3b94fff1a813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:13.176662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec73f12-9e5d-49c3-97a6-3b94fff1a813 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:13.177365 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec73f12-9e5d-49c3-97a6-3b94fff1a813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:13.179389 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec73f12-9e5d-49c3-97a6-3b94fff1a813 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:13.199689 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:13.207744 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1284/2577] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:41:13 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:41:13.211928 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f606f-fc98-4473-8b65-20b65c333212 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:13.222611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f606f-fc98-4473-8b65-20b65c333212 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:13.227746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d5073-0f35-4b32-8288-66ac2cd3da2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:13.228448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d5073-0f35-4b32-8288-66ac2cd3da2a admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:13.228734 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d5073-0f35-4b32-8288-66ac2cd3da2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:13.229012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d5073-0f35-4b32-8288-66ac2cd3da2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:13.229742 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d5073-0f35-4b32-8288-66ac2cd3da2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:13.231966 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d5073-0f35-4b32-8288-66ac2cd3da2a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:13.243131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1294/2578] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:13.247484 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec73f12-9e5d-49c3-97a6-3b94fff1a813 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:13.260130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec73f12-9e5d-49c3-97a6-3b94fff1a813 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:13.266691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d737d-8559-4d63-aa45-1eedd103bc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:13.267458 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d737d-8559-4d63-aa45-1eedd103bc63 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:13.267744 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d737d-8559-4d63-aa45-1eedd103bc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:13.268048 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d737d-8559-4d63-aa45-1eedd103bc63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:13.268786 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d737d-8559-4d63-aa45-1eedd103bc63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:13.271005 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d737d-8559-4d63-aa45-1eedd103bc63 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:13.283686 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1285/2579] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:13.288677 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d5073-0f35-4b32-8288-66ac2cd3da2a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:13.299487 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d5073-0f35-4b32-8288-66ac2cd3da2a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:13.305067 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2591f-e938-4359-8015-9ad09f733cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:13.305979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2591f-e938-4359-8015-9ad09f733cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:13.306268 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2591f-e938-4359-8015-9ad09f733cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:13.306547 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2591f-e938-4359-8015-9ad09f733cb5 admin admin] PATH_INFO: `/v3/projects/98890bea79c646549391024f42ae09ae/users/01f6036d6e1646c2b4cbf634d5c2330d/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:13.322954 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2591f-e938-4359-8015-9ad09f733cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98890bea79c646549391024f42ae09ae, user_id=01f6036d6e1646c2b4cbf634d5c2330d, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:13.325691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2591f-e938-4359-8015-9ad09f733cb5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:13.341654 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1295/2580] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:13 2022] PUT /identity/v3/projects/98890bea79c646549391024f42ae09ae/users/01f6036d6e1646c2b4cbf634d5c2330d/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:13.353586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c9d1d-6f01-441a-b401-4d34c995d798 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:13.353838 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c9d1d-6f01-441a-b401-4d34c995d798 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:13.354260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c9d1d-6f01-441a-b401-4d34c995d798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:13.389379 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-dc3c9d1d-6f01-441a-b401-4d34c995d798 None None] MFA Rules not processed for user `01f6036d6e1646c2b4cbf634d5c2330d`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:13.390955 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-dc3c9d1d-6f01-441a-b401-4d34c995d798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:13.480290 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1286/2581] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:13.493745 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2591f-e938-4359-8015-9ad09f733cb5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:13.496566 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-2ef2591f-e938-4359-8015-9ad09f733cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:13.570734 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2591f-e938-4359-8015-9ad09f733cb5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:13.575321 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459071c6-484c-4321-a443-d22bb9a0c306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:13.575978 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459071c6-484c-4321-a443-d22bb9a0c306 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:13.576313 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459071c6-484c-4321-a443-d22bb9a0c306 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:13.576585 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459071c6-484c-4321-a443-d22bb9a0c306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:13.586527 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459071c6-484c-4321-a443-d22bb9a0c306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:13.587991 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459071c6-484c-4321-a443-d22bb9a0c306 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:13.597280 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1296/2582] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:16.697384 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c9d1d-6f01-441a-b401-4d34c995d798 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:16.766809 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c9d1d-6f01-441a-b401-4d34c995d798 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:16.771845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92329921-b1f3-4a3c-b583-73a5ac6e020f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:16.772816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92329921-b1f3-4a3c-b583-73a5ac6e020f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:16.773171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92329921-b1f3-4a3c-b583-73a5ac6e020f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:16.773369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92329921-b1f3-4a3c-b583-73a5ac6e020f admin admin] PATH_INFO: `/v3/users/01f6036d6e1646c2b4cbf634d5c2330d` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:16.774704 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92329921-b1f3-4a3c-b583-73a5ac6e020f admin admin] RBAC: Authorizing `identity:delete_user(user_id=01f6036d6e1646c2b4cbf634d5c2330d)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:16.776718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92329921-b1f3-4a3c-b583-73a5ac6e020f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:16.842011 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-92329921-b1f3-4a3c-b583-73a5ac6e020f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01f6036d6e1646c2b4cbf634d5c2330d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:16.852751 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-92329921-b1f3-4a3c-b583-73a5ac6e020f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01f6036d6e1646c2b4cbf634d5c2330d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:16.868939 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-92329921-b1f3-4a3c-b583-73a5ac6e020f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01f6036d6e1646c2b4cbf634d5c2330d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:16.876886 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-92329921-b1f3-4a3c-b583-73a5ac6e020f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01f6036d6e1646c2b4cbf634d5c2330d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:16.877696 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-92329921-b1f3-4a3c-b583-73a5ac6e020f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01f6036d6e1646c2b4cbf634d5c2330d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:16.879170 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:16.884910 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1287/2583] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:41:16 2022] DELETE /identity/v3/users/01f6036d6e1646c2b4cbf634d5c2330d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:16.889355 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36813de-42cd-4014-9a51-d87f815edad8 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:16.889836 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36813de-42cd-4014-9a51-d87f815edad8 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:16.890069 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36813de-42cd-4014-9a51-d87f815edad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:16.912810 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a36813de-42cd-4014-9a51-d87f815edad8 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:16.914207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a36813de-42cd-4014-9a51-d87f815edad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:16.967660 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:16.981171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1297/2584] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:16.990705 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92329921-b1f3-4a3c-b583-73a5ac6e020f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:16.992340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-92329921-b1f3-4a3c-b583-73a5ac6e020f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:17.055666 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92329921-b1f3-4a3c-b583-73a5ac6e020f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:17.059680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e77e59-1bb9-4334-b612-0604658ffaa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:17.060388 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e77e59-1bb9-4334-b612-0604658ffaa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:17.060674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e77e59-1bb9-4334-b612-0604658ffaa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:17.060948 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e77e59-1bb9-4334-b612-0604658ffaa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:17.071833 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e77e59-1bb9-4334-b612-0604658ffaa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:17.073730 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e77e59-1bb9-4334-b612-0604658ffaa5 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:17.084047 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1288/2585] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:17.448729 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36813de-42cd-4014-9a51-d87f815edad8 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:17.450224 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a36813de-42cd-4014-9a51-d87f815edad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:17.464477 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36813de-42cd-4014-9a51-d87f815edad8 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:17.476044 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f59f90-3f11-432c-b84b-2fa74fe57595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:17.477135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f59f90-3f11-432c-b84b-2fa74fe57595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:17.477425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f59f90-3f11-432c-b84b-2fa74fe57595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:17.477703 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f59f90-3f11-432c-b84b-2fa74fe57595 admin admin] PATH_INFO: `/v3/projects/98890bea79c646549391024f42ae09ae` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:17.478978 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f59f90-3f11-432c-b84b-2fa74fe57595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98890bea79c646549391024f42ae09ae)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:17.481012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f59f90-3f11-432c-b84b-2fa74fe57595 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:17.542525 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-91f59f90-3f11-432c-b84b-2fa74fe57595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98890bea79c646549391024f42ae09ae', 'request_id': 'req-91f59f90-3f11-432c-b84b-2fa74fe57595'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:17.553123 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-91f59f90-3f11-432c-b84b-2fa74fe57595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98890bea79c646549391024f42ae09ae', 'request_id': 'req-91f59f90-3f11-432c-b84b-2fa74fe57595'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:17.561199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-91f59f90-3f11-432c-b84b-2fa74fe57595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98890bea79c646549391024f42ae09ae', 'request_id': 'req-91f59f90-3f11-432c-b84b-2fa74fe57595'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:17.574335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-91f59f90-3f11-432c-b84b-2fa74fe57595 admin admin] The token cache is being invalidate because project 98890bea79c646549391024f42ae09ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:41:17.574620 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-91f59f90-3f11-432c-b84b-2fa74fe57595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:17.575373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-91f59f90-3f11-432c-b84b-2fa74fe57595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:17.577075 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1298/2586] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:41:17 2022] DELETE /identity/v3/projects/98890bea79c646549391024f42ae09ae => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:17.582638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197560e-620d-48dc-a64a-1310aa70611c None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:17.583016 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197560e-620d-48dc-a64a-1310aa70611c None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:17.583201 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197560e-620d-48dc-a64a-1310aa70611c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:17.602390 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-6197560e-620d-48dc-a64a-1310aa70611c None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:17.603600 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-6197560e-620d-48dc-a64a-1310aa70611c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:17.666615 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1289/2587] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:41:17.735856 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b4bf8-e1f4-4e16-9457-69d2a91eda3d None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:17.736159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b4bf8-e1f4-4e16-9457-69d2a91eda3d None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:17.736442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b4bf8-e1f4-4e16-9457-69d2a91eda3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:17.755192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c88b4bf8-e1f4-4e16-9457-69d2a91eda3d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:17.756476 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c88b4bf8-e1f4-4e16-9457-69d2a91eda3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:17.765227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1299/2588] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:17.769819 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197560e-620d-48dc-a64a-1310aa70611c None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:17.780057 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197560e-620d-48dc-a64a-1310aa70611c None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:17.785090 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a17e6b-8104-4f8f-bb0a-d8ab7bc13027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:17.785758 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a17e6b-8104-4f8f-bb0a-d8ab7bc13027 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:17.786040 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a17e6b-8104-4f8f-bb0a-d8ab7bc13027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:17.786320 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a17e6b-8104-4f8f-bb0a-d8ab7bc13027 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:17.787051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a17e6b-8104-4f8f-bb0a-d8ab7bc13027 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:41:17.787360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a17e6b-8104-4f8f-bb0a-d8ab7bc13027 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:17.789022 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a17e6b-8104-4f8f-bb0a-d8ab7bc13027 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:17.805466 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1290/2589] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:41:17.806623 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b4bf8-e1f4-4e16-9457-69d2a91eda3d None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:17.816077 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b4bf8-e1f4-4e16-9457-69d2a91eda3d None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:17.821712 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b235c08-d43f-4569-b197-9e36e7c42dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:17.822392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b235c08-d43f-4569-b197-9e36e7c42dbc admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:17.822669 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b235c08-d43f-4569-b197-9e36e7c42dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:17.822947 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b235c08-d43f-4569-b197-9e36e7c42dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:17.823629 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b235c08-d43f-4569-b197-9e36e7c42dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:17.825604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b235c08-d43f-4569-b197-9e36e7c42dbc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:17.857338 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1300/2590] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:41:17 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:17.858583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a17e6b-8104-4f8f-bb0a-d8ab7bc13027 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:17.870075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a17e6b-8104-4f8f-bb0a-d8ab7bc13027 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:17.928346 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326a33b-e92d-4a5c-8afd-ceec80b0d3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:17.929041 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326a33b-e92d-4a5c-8afd-ceec80b0d3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:17.929310 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326a33b-e92d-4a5c-8afd-ceec80b0d3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:17.929585 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326a33b-e92d-4a5c-8afd-ceec80b0d3f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:17.930296 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326a33b-e92d-4a5c-8afd-ceec80b0d3f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:17.933306 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326a33b-e92d-4a5c-8afd-ceec80b0d3f0 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:17.963548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1291/2591] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:41:17 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:17.968580 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b235c08-d43f-4569-b197-9e36e7c42dbc admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:17.981000 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b235c08-d43f-4569-b197-9e36e7c42dbc admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:17.986773 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f8ae6-e0e3-48b2-ad26-5f619e53bf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:17.987405 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f8ae6-e0e3-48b2-ad26-5f619e53bf93 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:17.987670 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f8ae6-e0e3-48b2-ad26-5f619e53bf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:17.988041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f8ae6-e0e3-48b2-ad26-5f619e53bf93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:17.988713 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f8ae6-e0e3-48b2-ad26-5f619e53bf93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:17.990299 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f8ae6-e0e3-48b2-ad26-5f619e53bf93 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:18.002985 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1301/2592] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:18.007312 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326a33b-e92d-4a5c-8afd-ceec80b0d3f0 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:18.018156 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326a33b-e92d-4a5c-8afd-ceec80b0d3f0 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:18.023810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a4963-b015-403f-a48e-495d36ced06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:18.024623 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a4963-b015-403f-a48e-495d36ced06d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:18.024969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a4963-b015-403f-a48e-495d36ced06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:18.025308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a4963-b015-403f-a48e-495d36ced06d admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:18.026118 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a4963-b015-403f-a48e-495d36ced06d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:18.027814 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a4963-b015-403f-a48e-495d36ced06d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:18.045344 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1292/2593] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:18.046735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f8ae6-e0e3-48b2-ad26-5f619e53bf93 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:18.056966 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f8ae6-e0e3-48b2-ad26-5f619e53bf93 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:18.062001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861e02d-f05b-43c5-aef0-de941526508a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:18.062897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861e02d-f05b-43c5-aef0-de941526508a admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:18.063178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861e02d-f05b-43c5-aef0-de941526508a admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:18.063451 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861e02d-f05b-43c5-aef0-de941526508a admin admin] PATH_INFO: `/v3/projects/1098aff20f1b4f94b4075a710b4d44b8/users/9203cb6fac9443328bb3cc98fa05a894/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:18.080677 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861e02d-f05b-43c5-aef0-de941526508a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1098aff20f1b4f94b4075a710b4d44b8, user_id=9203cb6fac9443328bb3cc98fa05a894, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:18.083659 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861e02d-f05b-43c5-aef0-de941526508a admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:18.102592 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1302/2594] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:18 2022] PUT /identity/v3/projects/1098aff20f1b4f94b4075a710b4d44b8/users/9203cb6fac9443328bb3cc98fa05a894/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:18.107938 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc1cc1-46c1-4b06-87a5-ca19c8cb093d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:18.108274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc1cc1-46c1-4b06-87a5-ca19c8cb093d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:18.108632 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc1cc1-46c1-4b06-87a5-ca19c8cb093d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:18.122688 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:18.128393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-92dc1cc1-46c1-4b06-87a5-ca19c8cb093d None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:18.130043 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-92dc1cc1-46c1-4b06-87a5-ca19c8cb093d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:18.199211 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1293/2595] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:18.209721 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861e02d-f05b-43c5-aef0-de941526508a admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:18.211728 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4861e02d-f05b-43c5-aef0-de941526508a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:18.278655 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861e02d-f05b-43c5-aef0-de941526508a admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:18.283644 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7753cfb-5621-417e-9021-15216755b7ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:18.284425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7753cfb-5621-417e-9021-15216755b7ff service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:18.284714 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7753cfb-5621-417e-9021-15216755b7ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:18.284975 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7753cfb-5621-417e-9021-15216755b7ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:18.298408 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7753cfb-5621-417e-9021-15216755b7ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:18.299907 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7753cfb-5621-417e-9021-15216755b7ff service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:18.312460 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1303/2596] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:22.080277 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc1cc1-46c1-4b06-87a5-ca19c8cb093d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:22.082673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-92dc1cc1-46c1-4b06-87a5-ca19c8cb093d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:22.101346 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc1cc1-46c1-4b06-87a5-ca19c8cb093d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:22.108160 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ecbec-7591-47ea-8194-a66d7097db7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:22.109191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ecbec-7591-47ea-8194-a66d7097db7a service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:22.110008 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ecbec-7591-47ea-8194-a66d7097db7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:22.110371 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ecbec-7591-47ea-8194-a66d7097db7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:22.115257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-7c9ecbec-7591-47ea-8194-a66d7097db7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:22.131816 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ecbec-7591-47ea-8194-a66d7097db7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:22.133758 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ecbec-7591-47ea-8194-a66d7097db7a service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:22.146993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1294/2597] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:23.515315 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05128973-bded-4c54-be7c-c817d4f3a3e4 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:23.515865 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05128973-bded-4c54-be7c-c817d4f3a3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:23.515865 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05128973-bded-4c54-be7c-c817d4f3a3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:23.555239 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-05128973-bded-4c54-be7c-c817d4f3a3e4 None None] MFA Rules not processed for user `9203cb6fac9443328bb3cc98fa05a894`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:23.556464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-05128973-bded-4c54-be7c-c817d4f3a3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:23.565644 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:23.649141 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1304/2598] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:41:23.653940 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ecbec-7591-47ea-8194-a66d7097db7a service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:23.665276 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ecbec-7591-47ea-8194-a66d7097db7a service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:23.671229 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c29f19-3989-4035-ba12-0007254c2883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:23.671941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c29f19-3989-4035-ba12-0007254c2883 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:23.672265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c29f19-3989-4035-ba12-0007254c2883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:23.672548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c29f19-3989-4035-ba12-0007254c2883 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:23.673275 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c29f19-3989-4035-ba12-0007254c2883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:23.675263 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c29f19-3989-4035-ba12-0007254c2883 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:23.709796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1295/2599] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:41:23 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:23.716121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05128973-bded-4c54-be7c-c817d4f3a3e4 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:23.741019 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05128973-bded-4c54-be7c-c817d4f3a3e4 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:23.825203 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3515d-cca4-456b-b397-90a158dd5302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:23.825914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3515d-cca4-456b-b397-90a158dd5302 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:23.826207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3515d-cca4-456b-b397-90a158dd5302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:23.826486 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3515d-cca4-456b-b397-90a158dd5302 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:23.827203 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3515d-cca4-456b-b397-90a158dd5302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:23.829323 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3515d-cca4-456b-b397-90a158dd5302 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:23.867988 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1305/2600] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:41:23 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:23.871975 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c29f19-3989-4035-ba12-0007254c2883 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:23.883458 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c29f19-3989-4035-ba12-0007254c2883 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:23.889050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5afe8e-4cfb-4896-8a57-e0dbaac03b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:23.889760 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5afe8e-4cfb-4896-8a57-e0dbaac03b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:23.890050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5afe8e-4cfb-4896-8a57-e0dbaac03b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:23.890337 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5afe8e-4cfb-4896-8a57-e0dbaac03b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:23.891090 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5afe8e-4cfb-4896-8a57-e0dbaac03b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:23.892802 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5afe8e-4cfb-4896-8a57-e0dbaac03b02 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:23.906033 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1296/2601] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:41:23.910317 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3515d-cca4-456b-b397-90a158dd5302 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:23.922931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3515d-cca4-456b-b397-90a158dd5302 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:23.929318 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68f9af-95ba-4c0d-ae96-952d35fe1fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:23.930600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68f9af-95ba-4c0d-ae96-952d35fe1fba admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:23.931368 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68f9af-95ba-4c0d-ae96-952d35fe1fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:23.931865 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68f9af-95ba-4c0d-ae96-952d35fe1fba admin admin] PATH_INFO: `/v3/projects/ace5b857b63043ef830af9f536df4380/users/5ace1b529ba84867be9c1e70495876e3/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:23.956293 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68f9af-95ba-4c0d-ae96-952d35fe1fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace5b857b63043ef830af9f536df4380, user_id=5ace1b529ba84867be9c1e70495876e3, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:23.959805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68f9af-95ba-4c0d-ae96-952d35fe1fba admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:23.977709 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1306/2602] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:23 2022] PUT /identity/v3/projects/ace5b857b63043ef830af9f536df4380/users/5ace1b529ba84867be9c1e70495876e3/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:23.982686 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5afe8e-4cfb-4896-8a57-e0dbaac03b02 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:23.998800 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5afe8e-4cfb-4896-8a57-e0dbaac03b02 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:24.076085 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c103399-5dbe-4e2b-91b6-a3ed5c1bd9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:24.076910 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c103399-5dbe-4e2b-91b6-a3ed5c1bd9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:24.077296 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c103399-5dbe-4e2b-91b6-a3ed5c1bd9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:24.077780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c103399-5dbe-4e2b-91b6-a3ed5c1bd9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:24.078621 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c103399-5dbe-4e2b-91b6-a3ed5c1bd9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:24.080527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c103399-5dbe-4e2b-91b6-a3ed5c1bd9d1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:24.097534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1297/2603] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:24.098783 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68f9af-95ba-4c0d-ae96-952d35fe1fba admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:24.110595 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68f9af-95ba-4c0d-ae96-952d35fe1fba admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:24.115739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55b78b-17b8-4890-8aaa-fa5ec8852911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:24.117640 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55b78b-17b8-4890-8aaa-fa5ec8852911 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:24.117927 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55b78b-17b8-4890-8aaa-fa5ec8852911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:24.118211 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55b78b-17b8-4890-8aaa-fa5ec8852911 admin admin] PATH_INFO: `/v3/projects/ace5b857b63043ef830af9f536df4380/users/5ace1b529ba84867be9c1e70495876e3/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:24.120315 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55b78b-17b8-4890-8aaa-fa5ec8852911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace5b857b63043ef830af9f536df4380, user_id=5ace1b529ba84867be9c1e70495876e3, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:24.123111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55b78b-17b8-4890-8aaa-fa5ec8852911 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:24.135287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1307/2604] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:24 2022] PUT /identity/v3/projects/ace5b857b63043ef830af9f536df4380/users/5ace1b529ba84867be9c1e70495876e3/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:26.759836 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c103399-5dbe-4e2b-91b6-a3ed5c1bd9d1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:26.762984 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4c103399-5dbe-4e2b-91b6-a3ed5c1bd9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:26.855557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55b78b-17b8-4890-8aaa-fa5ec8852911 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:26.864965 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-df55b78b-17b8-4890-8aaa-fa5ec8852911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:26.888979 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:26.909124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c103399-5dbe-4e2b-91b6-a3ed5c1bd9d1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:26.979169 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55b78b-17b8-4890-8aaa-fa5ec8852911 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:26.984983 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ef0f6-70ea-460f-be16-c56fadaf7d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:26.985949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ef0f6-70ea-460f-be16-c56fadaf7d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:26.986235 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ef0f6-70ea-460f-be16-c56fadaf7d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:26.986558 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ef0f6-70ea-460f-be16-c56fadaf7d87 admin admin] PATH_INFO: `/v3/users/6d3dd7ad5436451a919ef8aaf9623f83` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:26.987916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ef0f6-70ea-460f-be16-c56fadaf7d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d3dd7ad5436451a919ef8aaf9623f83)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:26.989905 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ef0f6-70ea-460f-be16-c56fadaf7d87 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:26.991930 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:27.012073 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6d27d-ef9c-433d-8f05-5a482b414119 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1266a87d93da4f8d9a1ccafa03067169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:27.012758 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6d27d-ef9c-433d-8f05-5a482b414119 service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:27.013045 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6d27d-ef9c-433d-8f05-5a482b414119 service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:27.013322 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6d27d-ef9c-433d-8f05-5a482b414119 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:27.015777 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-65e6d27d-ef9c-433d-8f05-5a482b414119 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:27.030241 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6d27d-ef9c-433d-8f05-5a482b414119 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:27.034214 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6d27d-ef9c-433d-8f05-5a482b414119 service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:27.047793 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1298/2605] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:27.059604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a40ef0f6-70ea-460f-be16-c56fadaf7d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d3dd7ad5436451a919ef8aaf9623f83'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:27.060859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a40ef0f6-70ea-460f-be16-c56fadaf7d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d3dd7ad5436451a919ef8aaf9623f83'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:27.062039 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a40ef0f6-70ea-460f-be16-c56fadaf7d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d3dd7ad5436451a919ef8aaf9623f83'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:27.078768 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a40ef0f6-70ea-460f-be16-c56fadaf7d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d3dd7ad5436451a919ef8aaf9623f83'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:27.090174 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-a40ef0f6-70ea-460f-be16-c56fadaf7d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d3dd7ad5436451a919ef8aaf9623f83'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:27.109458 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1308/2606] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:41:26 2022] DELETE /identity/v3/users/6d3dd7ad5436451a919ef8aaf9623f83 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:27.365065 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6d27d-ef9c-433d-8f05-5a482b414119 service placement] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:27.398900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6d27d-ef9c-433d-8f05-5a482b414119 service placement] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:27.599339 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760297ac-5f57-4e42-b26e-d9c8aa5fc53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:27.600421 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760297ac-5f57-4e42-b26e-d9c8aa5fc53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:27.601031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760297ac-5f57-4e42-b26e-d9c8aa5fc53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:27.608203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760297ac-5f57-4e42-b26e-d9c8aa5fc53d admin admin] PATH_INFO: `/v3/projects/b36a8dc3f1e146ae99e0ca843e1bc93a` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:27.608203 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760297ac-5f57-4e42-b26e-d9c8aa5fc53d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b36a8dc3f1e146ae99e0ca843e1bc93a)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:27.611173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760297ac-5f57-4e42-b26e-d9c8aa5fc53d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:27.743213 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-760297ac-5f57-4e42-b26e-d9c8aa5fc53d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b36a8dc3f1e146ae99e0ca843e1bc93a', 'request_id': 'req-760297ac-5f57-4e42-b26e-d9c8aa5fc53d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:27.754185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-760297ac-5f57-4e42-b26e-d9c8aa5fc53d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b36a8dc3f1e146ae99e0ca843e1bc93a', 'request_id': 'req-760297ac-5f57-4e42-b26e-d9c8aa5fc53d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:27.785323 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-760297ac-5f57-4e42-b26e-d9c8aa5fc53d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b36a8dc3f1e146ae99e0ca843e1bc93a', 'request_id': 'req-760297ac-5f57-4e42-b26e-d9c8aa5fc53d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:27.800675 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-760297ac-5f57-4e42-b26e-d9c8aa5fc53d admin admin] The token cache is being invalidate because project b36a8dc3f1e146ae99e0ca843e1bc93a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:41:27.800973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-760297ac-5f57-4e42-b26e-d9c8aa5fc53d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:27.803607 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-760297ac-5f57-4e42-b26e-d9c8aa5fc53d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:27.809476 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1299/2607] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:41:27 2022] DELETE /identity/v3/projects/b36a8dc3f1e146ae99e0ca843e1bc93a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:27.816865 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb59734-6719-4e19-880f-22b4d73f9c27 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:27.817320 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb59734-6719-4e19-880f-22b4d73f9c27 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:27.817675 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb59734-6719-4e19-880f-22b4d73f9c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:27.855528 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1eb59734-6719-4e19-880f-22b4d73f9c27 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:27.857394 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1eb59734-6719-4e19-880f-22b4d73f9c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:27.954590 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1309/2608] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:27.964670 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710809dc-6995-4413-b840-b8bba267169f None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:27.964670 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710809dc-6995-4413-b840-b8bba267169f None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:27.964670 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710809dc-6995-4413-b840-b8bba267169f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:27.986863 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-710809dc-6995-4413-b840-b8bba267169f None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:27.988303 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-710809dc-6995-4413-b840-b8bba267169f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:28.011382 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1300/2609] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:28.015909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb59734-6719-4e19-880f-22b4d73f9c27 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:28.033863 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb59734-6719-4e19-880f-22b4d73f9c27 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:28.050583 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c478612-7281-42d0-b333-23d362d3f493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:28.051545 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c478612-7281-42d0-b333-23d362d3f493 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:28.052028 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c478612-7281-42d0-b333-23d362d3f493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:28.052587 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c478612-7281-42d0-b333-23d362d3f493 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:28.053650 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c478612-7281-42d0-b333-23d362d3f493 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:41:28.053958 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c478612-7281-42d0-b333-23d362d3f493 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:28.055913 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c478612-7281-42d0-b333-23d362d3f493 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:28.086578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1310/2610] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:41:28.090895 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710809dc-6995-4413-b840-b8bba267169f None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:28.101354 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710809dc-6995-4413-b840-b8bba267169f None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:28.107687 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fea9e-801c-4a6d-b9c2-23b733a839f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:28.108403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fea9e-801c-4a6d-b9c2-23b733a839f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:28.108692 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fea9e-801c-4a6d-b9c2-23b733a839f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:28.108972 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2fea9e-801c-4a6d-b9c2-23b733a839f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:28.109681 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fea9e-801c-4a6d-b9c2-23b733a839f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:28.111635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2fea9e-801c-4a6d-b9c2-23b733a839f1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:28.134900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:28.195818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1301/2611] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:41:28 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:28.199305 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c478612-7281-42d0-b333-23d362d3f493 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:28.214059 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c478612-7281-42d0-b333-23d362d3f493 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:28.356098 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41348d02-f672-498b-8522-c35b5a042cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:28.357915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348d02-f672-498b-8522-c35b5a042cff admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:28.357915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348d02-f672-498b-8522-c35b5a042cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:28.357915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348d02-f672-498b-8522-c35b5a042cff admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:28.358214 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41348d02-f672-498b-8522-c35b5a042cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:28.364978 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41348d02-f672-498b-8522-c35b5a042cff admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:28.397777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:28.418921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1311/2612] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:41:28 2022] POST /identity/v3/users => generated 303 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:28.423270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fea9e-801c-4a6d-b9c2-23b733a839f1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:28.440568 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2fea9e-801c-4a6d-b9c2-23b733a839f1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:28.457334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85675fe1-0b2e-4352-81f7-380cd72975b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:28.457334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85675fe1-0b2e-4352-81f7-380cd72975b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:28.458531 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85675fe1-0b2e-4352-81f7-380cd72975b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:28.458531 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85675fe1-0b2e-4352-81f7-380cd72975b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:28.458531 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85675fe1-0b2e-4352-81f7-380cd72975b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:28.460191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85675fe1-0b2e-4352-81f7-380cd72975b8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:28.474414 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1302/2613] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:28.480303 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41348d02-f672-498b-8522-c35b5a042cff admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:28.498357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41348d02-f672-498b-8522-c35b5a042cff admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:28.507606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1ae82-b184-41e6-8300-62c0380cd195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:28.508574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1ae82-b184-41e6-8300-62c0380cd195 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:28.508920 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1ae82-b184-41e6-8300-62c0380cd195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:28.509299 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1ae82-b184-41e6-8300-62c0380cd195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:28.510083 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1ae82-b184-41e6-8300-62c0380cd195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:28.511973 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c1ae82-b184-41e6-8300-62c0380cd195 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:28.530569 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1312/2614] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:28.535421 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85675fe1-0b2e-4352-81f7-380cd72975b8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:28.553422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85675fe1-0b2e-4352-81f7-380cd72975b8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:28.560665 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40f533-1cb3-45ea-ab91-564d11a41224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:28.562128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40f533-1cb3-45ea-ab91-564d11a41224 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:28.562648 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40f533-1cb3-45ea-ab91-564d11a41224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:28.563215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40f533-1cb3-45ea-ab91-564d11a41224 admin admin] PATH_INFO: `/v3/projects/c7962b19089946678332e76a15fe3402/users/f3b86b199dca43e79f06225501d9ea64/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:28.586924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40f533-1cb3-45ea-ab91-564d11a41224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7962b19089946678332e76a15fe3402, user_id=f3b86b199dca43e79f06225501d9ea64, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:28.590884 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40f533-1cb3-45ea-ab91-564d11a41224 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:28.642559 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1303/2615] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:28 2022] PUT /identity/v3/projects/c7962b19089946678332e76a15fe3402/users/f3b86b199dca43e79f06225501d9ea64/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:28.654351 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dccaf-e47a-4955-86e0-40696043eec6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:28.654641 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dccaf-e47a-4955-86e0-40696043eec6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:28.654919 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dccaf-e47a-4955-86e0-40696043eec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:28.687101 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c73dccaf-e47a-4955-86e0-40696043eec6 None None] MFA Rules not processed for user `f3b86b199dca43e79f06225501d9ea64`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:28.688684 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c73dccaf-e47a-4955-86e0-40696043eec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:28.836497 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1313/2616] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:28 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:28.838214 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40f533-1cb3-45ea-ab91-564d11a41224 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:29.022251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40f533-1cb3-45ea-ab91-564d11a41224 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:29.031245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a597b1-042e-4e47-9903-da91e30f7d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:29.036454 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a597b1-042e-4e47-9903-da91e30f7d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:29.037193 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a597b1-042e-4e47-9903-da91e30f7d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:29.041830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a597b1-042e-4e47-9903-da91e30f7d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:29.042969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a597b1-042e-4e47-9903-da91e30f7d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:29.045517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a597b1-042e-4e47-9903-da91e30f7d7d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:29.097960 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1304/2617] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:41:28 2022] POST /identity/v3/projects => generated 405 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:29.098983 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73dccaf-e47a-4955-86e0-40696043eec6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:29.125740 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73dccaf-e47a-4955-86e0-40696043eec6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:29.235066 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0437f5-e1b5-4365-aef2-496885f2195b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:29.235771 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0437f5-e1b5-4365-aef2-496885f2195b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:29.242182 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0437f5-e1b5-4365-aef2-496885f2195b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:29.242468 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0437f5-e1b5-4365-aef2-496885f2195b admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:29.243479 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0437f5-e1b5-4365-aef2-496885f2195b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:29.248653 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0437f5-e1b5-4365-aef2-496885f2195b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:29.296743 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1314/2618] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:41:29 2022] POST /identity/v3/users => generated 309 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:29.296846 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a597b1-042e-4e47-9903-da91e30f7d7d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:29.319074 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a597b1-042e-4e47-9903-da91e30f7d7d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:29.329378 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512af47d-3be2-47a8-aa49-df07c5492a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:29.331129 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512af47d-3be2-47a8-aa49-df07c5492a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:29.331314 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512af47d-3be2-47a8-aa49-df07c5492a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:29.331498 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512af47d-3be2-47a8-aa49-df07c5492a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:29.334508 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512af47d-3be2-47a8-aa49-df07c5492a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:29.336250 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512af47d-3be2-47a8-aa49-df07c5492a69 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:29.367811 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1305/2619] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:29.373291 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0437f5-e1b5-4365-aef2-496885f2195b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:29.406944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0437f5-e1b5-4365-aef2-496885f2195b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:29.425989 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae3ec1-83f3-48cc-868a-cc05ba8bd6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:29.430221 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae3ec1-83f3-48cc-868a-cc05ba8bd6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:29.431635 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae3ec1-83f3-48cc-868a-cc05ba8bd6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:29.432359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae3ec1-83f3-48cc-868a-cc05ba8bd6e2 admin admin] PATH_INFO: `/v3/projects/cd9dd21e7f7148b18dbf934e1e2ef229/users/c2fc4dbfc4fc42038f134def7f002ddb/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:29.486488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae3ec1-83f3-48cc-868a-cc05ba8bd6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9dd21e7f7148b18dbf934e1e2ef229, user_id=c2fc4dbfc4fc42038f134def7f002ddb, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:29.496248 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dae3ec1-83f3-48cc-868a-cc05ba8bd6e2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:29.523684 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1315/2620] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:29 2022] PUT /identity/v3/projects/cd9dd21e7f7148b18dbf934e1e2ef229/users/c2fc4dbfc4fc42038f134def7f002ddb/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:29.528079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512af47d-3be2-47a8-aa49-df07c5492a69 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:29.544367 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512af47d-3be2-47a8-aa49-df07c5492a69 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:29.664862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60134462-0d34-44ed-9979-b38483b81398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:29.665779 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60134462-0d34-44ed-9979-b38483b81398 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:29.666320 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60134462-0d34-44ed-9979-b38483b81398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:29.666667 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60134462-0d34-44ed-9979-b38483b81398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:29.667495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60134462-0d34-44ed-9979-b38483b81398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:29.669285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60134462-0d34-44ed-9979-b38483b81398 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:29.682944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1306/2621] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:29.688156 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae3ec1-83f3-48cc-868a-cc05ba8bd6e2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:29.704495 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae3ec1-83f3-48cc-868a-cc05ba8bd6e2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:29.709577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10d41a-e3a2-49ee-bf0c-8bd9ade36a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:29.710675 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10d41a-e3a2-49ee-bf0c-8bd9ade36a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:29.711107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10d41a-e3a2-49ee-bf0c-8bd9ade36a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:29.711388 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10d41a-e3a2-49ee-bf0c-8bd9ade36a94 admin admin] PATH_INFO: `/v3/projects/cd9dd21e7f7148b18dbf934e1e2ef229/users/c2fc4dbfc4fc42038f134def7f002ddb/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:29.713739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10d41a-e3a2-49ee-bf0c-8bd9ade36a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9dd21e7f7148b18dbf934e1e2ef229, user_id=c2fc4dbfc4fc42038f134def7f002ddb, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:29.718743 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10d41a-e3a2-49ee-bf0c-8bd9ade36a94 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:29.746461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1316/2622] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:29 2022] PUT /identity/v3/projects/cd9dd21e7f7148b18dbf934e1e2ef229/users/c2fc4dbfc4fc42038f134def7f002ddb/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:29.757889 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ccddb-1cff-492d-bbd4-1e9575e78d63 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:29.758187 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ccddb-1cff-492d-bbd4-1e9575e78d63 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:29.758466 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ccddb-1cff-492d-bbd4-1e9575e78d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:29.822134 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-635ccddb-1cff-492d-bbd4-1e9575e78d63 None None] MFA Rules not processed for user `c2fc4dbfc4fc42038f134def7f002ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:29.825741 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-635ccddb-1cff-492d-bbd4-1e9575e78d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:29.865354 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:30.013149 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1307/2623] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:29 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:30.034522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10d41a-e3a2-49ee-bf0c-8bd9ade36a94 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:30.037150 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1d10d41a-e3a2-49ee-bf0c-8bd9ade36a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:30.157838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:30.222955 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10d41a-e3a2-49ee-bf0c-8bd9ade36a94 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:30.226582 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b72e43-6492-423b-8a5e-d60ab87e6d2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:30.227397 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b72e43-6492-423b-8a5e-d60ab87e6d2c service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:30.228397 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b72e43-6492-423b-8a5e-d60ab87e6d2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:30.228397 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b72e43-6492-423b-8a5e-d60ab87e6d2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:30.244037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3320259-ea42-443a-92e1-7bda30cbc1f9 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:30.244332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3320259-ea42-443a-92e1-7bda30cbc1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:30.244718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3320259-ea42-443a-92e1-7bda30cbc1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:30.264761 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b72e43-6492-423b-8a5e-d60ab87e6d2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:30.266797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b72e43-6492-423b-8a5e-d60ab87e6d2c service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:30.301714 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-c3320259-ea42-443a-92e1-7bda30cbc1f9 None None] MFA Rules not processed for user `5ace1b529ba84867be9c1e70495876e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:30.303003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c3320259-ea42-443a-92e1-7bda30cbc1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:30.307521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1317/2624] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:30 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:30.458575 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1308/2625] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:30.481422 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b72e43-6492-423b-8a5e-d60ab87e6d2c service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:30.482885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-16b72e43-6492-423b-8a5e-d60ab87e6d2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:30.514109 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3320259-ea42-443a-92e1-7bda30cbc1f9 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:30.599565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b72e43-6492-423b-8a5e-d60ab87e6d2c service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:30.616204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1c07a-0828-451e-bfae-fd62c84c619b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:30.617055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1c07a-0828-451e-bfae-fd62c84c619b service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:30.620277 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1c07a-0828-451e-bfae-fd62c84c619b service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:30.623008 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1c07a-0828-451e-bfae-fd62c84c619b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:30.623324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3320259-ea42-443a-92e1-7bda30cbc1f9 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:30.627604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a0a1c07a-0828-451e-bfae-fd62c84c619b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:30.638285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e3382-d710-4dcc-a2ae-9344a0a0a53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:30.639797 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e3382-d710-4dcc-a2ae-9344a0a0a53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:30.640330 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e3382-d710-4dcc-a2ae-9344a0a0a53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:30.640794 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e3382-d710-4dcc-a2ae-9344a0a0a53c admin admin] PATH_INFO: `/v3/users/f3b86b199dca43e79f06225501d9ea64` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:30.642621 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e3382-d710-4dcc-a2ae-9344a0a0a53c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3b86b199dca43e79f06225501d9ea64)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:30.645610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e3382-d710-4dcc-a2ae-9344a0a0a53c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:30.729194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:30.737648 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-623e3382-d710-4dcc-a2ae-9344a0a0a53c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3b86b199dca43e79f06225501d9ea64'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:30.740806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1c07a-0828-451e-bfae-fd62c84c619b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:30.752047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1c07a-0828-451e-bfae-fd62c84c619b service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:30.758171 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-623e3382-d710-4dcc-a2ae-9344a0a0a53c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3b86b199dca43e79f06225501d9ea64'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:30.767056 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1318/2626] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:30 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:30.785691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-623e3382-d710-4dcc-a2ae-9344a0a0a53c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3b86b199dca43e79f06225501d9ea64'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:30.796180 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-623e3382-d710-4dcc-a2ae-9344a0a0a53c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3b86b199dca43e79f06225501d9ea64'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:30.798511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-623e3382-d710-4dcc-a2ae-9344a0a0a53c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3b86b199dca43e79f06225501d9ea64'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:30.806362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1309/2627] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:41:30 2022] DELETE /identity/v3/users/f3b86b199dca43e79f06225501d9ea64 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:41:30.810891 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c34c71-a74a-4500-9cd0-f0b7bb6dc6ea None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:30.811200 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c34c71-a74a-4500-9cd0-f0b7bb6dc6ea None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:30.811516 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c34c71-a74a-4500-9cd0-f0b7bb6dc6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:30.835161 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a5c34c71-a74a-4500-9cd0-f0b7bb6dc6ea None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:30.837395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a5c34c71-a74a-4500-9cd0-f0b7bb6dc6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:30.948425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1319/2628] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:30.965614 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e3382-d710-4dcc-a2ae-9344a0a0a53c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:30.967260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-623e3382-d710-4dcc-a2ae-9344a0a0a53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:31.087005 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e3382-d710-4dcc-a2ae-9344a0a0a53c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:31.091561 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c285cb-6dfc-4a11-95c6-3fcf536ff00e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:31.092783 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c285cb-6dfc-4a11-95c6-3fcf536ff00e service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:31.093099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c285cb-6dfc-4a11-95c6-3fcf536ff00e service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:31.093883 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c285cb-6dfc-4a11-95c6-3fcf536ff00e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:31.108824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c285cb-6dfc-4a11-95c6-3fcf536ff00e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:31.110764 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c285cb-6dfc-4a11-95c6-3fcf536ff00e service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:31.127140 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1310/2629] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:31.737535 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c34c71-a74a-4500-9cd0-f0b7bb6dc6ea None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:31.739563 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a5c34c71-a74a-4500-9cd0-f0b7bb6dc6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:31.753421 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c34c71-a74a-4500-9cd0-f0b7bb6dc6ea None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:31.775580 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141c991-3671-4155-89be-478d1262ad20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:31.776580 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141c991-3671-4155-89be-478d1262ad20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:31.777021 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141c991-3671-4155-89be-478d1262ad20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:31.777440 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141c991-3671-4155-89be-478d1262ad20 admin admin] PATH_INFO: `/v3/projects/c7962b19089946678332e76a15fe3402` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:31.779571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141c991-3671-4155-89be-478d1262ad20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7962b19089946678332e76a15fe3402)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:31.781801 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141c991-3671-4155-89be-478d1262ad20 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:31.783864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=100 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:31.868379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c141c991-3671-4155-89be-478d1262ad20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7962b19089946678332e76a15fe3402', 'request_id': 'req-c141c991-3671-4155-89be-478d1262ad20'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:31.884497 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c141c991-3671-4155-89be-478d1262ad20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7962b19089946678332e76a15fe3402', 'request_id': 'req-c141c991-3671-4155-89be-478d1262ad20'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:31.896969 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c141c991-3671-4155-89be-478d1262ad20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7962b19089946678332e76a15fe3402', 'request_id': 'req-c141c991-3671-4155-89be-478d1262ad20'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:31.915831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c141c991-3671-4155-89be-478d1262ad20 admin admin] The token cache is being invalidate because project c7962b19089946678332e76a15fe3402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:41:31.916178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c141c991-3671-4155-89be-478d1262ad20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:31.916938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c141c991-3671-4155-89be-478d1262ad20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:31.923755 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c285cb-6dfc-4a11-95c6-3fcf536ff00e service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:31.924393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1320/2630] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:41:31 2022] DELETE /identity/v3/projects/c7962b19089946678332e76a15fe3402 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:31.938509 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c285cb-6dfc-4a11-95c6-3fcf536ff00e service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:32.073524 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f6b3e-a592-4603-abd1-fd16b4115b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:32.074145 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f6b3e-a592-4603-abd1-fd16b4115b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:32.074777 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f6b3e-a592-4603-abd1-fd16b4115b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:32.075063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f6b3e-a592-4603-abd1-fd16b4115b5a admin admin] PATH_INFO: `/v3/users/c2fc4dbfc4fc42038f134def7f002ddb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:32.076531 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f6b3e-a592-4603-abd1-fd16b4115b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2fc4dbfc4fc42038f134def7f002ddb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:32.079262 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f6b3e-a592-4603-abd1-fd16b4115b5a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:32.151421 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d5f6b3e-a592-4603-abd1-fd16b4115b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2fc4dbfc4fc42038f134def7f002ddb'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:32.163852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d5f6b3e-a592-4603-abd1-fd16b4115b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2fc4dbfc4fc42038f134def7f002ddb'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:32.171436 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:32.181376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d5f6b3e-a592-4603-abd1-fd16b4115b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2fc4dbfc4fc42038f134def7f002ddb'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:32.189904 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d5f6b3e-a592-4603-abd1-fd16b4115b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2fc4dbfc4fc42038f134def7f002ddb'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:32.191758 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2d5f6b3e-a592-4603-abd1-fd16b4115b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2fc4dbfc4fc42038f134def7f002ddb'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:32.201571 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1311/2631] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:41:31 2022] DELETE /identity/v3/users/c2fc4dbfc4fc42038f134def7f002ddb => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:32.777859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141c991-3671-4155-89be-478d1262ad20 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:32.782309 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c141c991-3671-4155-89be-478d1262ad20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:32.804143 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141c991-3671-4155-89be-478d1262ad20 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:32.892699 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be1598-185d-44c2-aea0-771831faed00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:32.893614 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be1598-185d-44c2-aea0-771831faed00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:32.893952 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be1598-185d-44c2-aea0-771831faed00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:32.894172 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be1598-185d-44c2-aea0-771831faed00 admin admin] PATH_INFO: `/v3/projects/cd9dd21e7f7148b18dbf934e1e2ef229` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:32.895451 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be1598-185d-44c2-aea0-771831faed00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd9dd21e7f7148b18dbf934e1e2ef229)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:32.897662 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be1598-185d-44c2-aea0-771831faed00 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:32.963236 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e0be1598-185d-44c2-aea0-771831faed00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9dd21e7f7148b18dbf934e1e2ef229', 'request_id': 'req-e0be1598-185d-44c2-aea0-771831faed00'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:32.972842 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e0be1598-185d-44c2-aea0-771831faed00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9dd21e7f7148b18dbf934e1e2ef229', 'request_id': 'req-e0be1598-185d-44c2-aea0-771831faed00'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:32.982934 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e0be1598-185d-44c2-aea0-771831faed00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9dd21e7f7148b18dbf934e1e2ef229', 'request_id': 'req-e0be1598-185d-44c2-aea0-771831faed00'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:32.996042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e0be1598-185d-44c2-aea0-771831faed00 admin admin] The token cache is being invalidate because project cd9dd21e7f7148b18dbf934e1e2ef229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:41:32.996480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e0be1598-185d-44c2-aea0-771831faed00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:32.997266 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-e0be1598-185d-44c2-aea0-771831faed00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:32.999332 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1321/2632] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:41:32 2022] DELETE /identity/v3/projects/cd9dd21e7f7148b18dbf934e1e2ef229 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:33.004518 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e61531-b0be-4d55-86e2-a7b4680c6ebf None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:33.005002 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e61531-b0be-4d55-86e2-a7b4680c6ebf None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:33.005331 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e61531-b0be-4d55-86e2-a7b4680c6ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:33.032896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-79e61531-b0be-4d55-86e2-a7b4680c6ebf None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:33.034172 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-79e61531-b0be-4d55-86e2-a7b4680c6ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:33.142374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7c212-53e6-4a39-b376-194c1b53fa5e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:33.142766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7c212-53e6-4a39-b376-194c1b53fa5e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:33.143189 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7c212-53e6-4a39-b376-194c1b53fa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:33.145674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1312/2633] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:33.167521 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad44b64-7ffd-4504-a44f-f90e4fb5a898 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:33.167935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad44b64-7ffd-4504-a44f-f90e4fb5a898 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:33.168327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad44b64-7ffd-4504-a44f-f90e4fb5a898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:33.170633 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-05d7c212-53e6-4a39-b376-194c1b53fa5e None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:33.171861 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-05d7c212-53e6-4a39-b376-194c1b53fa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:33.180293 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1322/2634] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:33.184335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7c212-53e6-4a39-b376-194c1b53fa5e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:33.195516 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7c212-53e6-4a39-b376-194c1b53fa5e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:33.200636 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576b0dc-d86b-4534-b519-09c3133d59fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:33.201298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-2ad44b64-7ffd-4504-a44f-f90e4fb5a898 None None] MFA Rules not processed for user `9203cb6fac9443328bb3cc98fa05a894`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:33.201424 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576b0dc-d86b-4534-b519-09c3133d59fc admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:33.201584 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576b0dc-d86b-4534-b519-09c3133d59fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:33.201866 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576b0dc-d86b-4534-b519-09c3133d59fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:33.202603 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576b0dc-d86b-4534-b519-09c3133d59fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:41:33.202908 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576b0dc-d86b-4534-b519-09c3133d59fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:33.203006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2ad44b64-7ffd-4504-a44f-f90e4fb5a898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:33.204604 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576b0dc-d86b-4534-b519-09c3133d59fc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:33.219772 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:33.224086 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1323/2635] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:41:33.228683 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576b0dc-d86b-4534-b519-09c3133d59fc admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:33.263075 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576b0dc-d86b-4534-b519-09c3133d59fc admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:33.271773 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bdbe2-3ad0-41b0-ba48-602a2638a70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:33.272959 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bdbe2-3ad0-41b0-ba48-602a2638a70d admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:33.273392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bdbe2-3ad0-41b0-ba48-602a2638a70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:33.273809 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bdbe2-3ad0-41b0-ba48-602a2638a70d admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:33.274824 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551bdbe2-3ad0-41b0-ba48-602a2638a70d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:33.277465 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551bdbe2-3ad0-41b0-ba48-602a2638a70d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:33.278246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1313/2636] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:41:33.317585 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1324/2637] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:41:33 2022] POST /identity/v3/projects => generated 361 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:41:33.319689 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad44b64-7ffd-4504-a44f-f90e4fb5a898 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:33.333052 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad44b64-7ffd-4504-a44f-f90e4fb5a898 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:33.422572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244a625-b28c-4205-8aee-5ec5e4b7372b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:33.423373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244a625-b28c-4205-8aee-5ec5e4b7372b admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:33.423760 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244a625-b28c-4205-8aee-5ec5e4b7372b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:33.424147 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244a625-b28c-4205-8aee-5ec5e4b7372b admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:33.424935 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244a625-b28c-4205-8aee-5ec5e4b7372b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:33.426955 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244a625-b28c-4205-8aee-5ec5e4b7372b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:33.453434 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1314/2638] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:41:33 2022] POST /identity/v3/users => generated 281 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:41:33.457275 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bdbe2-3ad0-41b0-ba48-602a2638a70d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:33.471754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bdbe2-3ad0-41b0-ba48-602a2638a70d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:33.477553 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed41ad-e6ac-4952-9b43-f2c28d1bb8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:33.478415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed41ad-e6ac-4952-9b43-f2c28d1bb8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:33.478710 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed41ad-e6ac-4952-9b43-f2c28d1bb8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:33.478992 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed41ad-e6ac-4952-9b43-f2c28d1bb8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:33.479898 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed41ad-e6ac-4952-9b43-f2c28d1bb8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:33.481697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed41ad-e6ac-4952-9b43-f2c28d1bb8d7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:33.498070 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1325/2639] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:33.499321 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244a625-b28c-4205-8aee-5ec5e4b7372b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:33.513953 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244a625-b28c-4205-8aee-5ec5e4b7372b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:33.519764 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db76d4-bb66-4d42-8e4b-323c1df7b880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:33.520707 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db76d4-bb66-4d42-8e4b-323c1df7b880 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:33.520993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db76d4-bb66-4d42-8e4b-323c1df7b880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:33.521268 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db76d4-bb66-4d42-8e4b-323c1df7b880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:33.522088 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db76d4-bb66-4d42-8e4b-323c1df7b880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:33.523811 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db76d4-bb66-4d42-8e4b-323c1df7b880 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:33.543946 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1315/2640] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:33.544385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed41ad-e6ac-4952-9b43-f2c28d1bb8d7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:33.556548 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed41ad-e6ac-4952-9b43-f2c28d1bb8d7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:33.565243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22407bc7-4ae5-412a-b912-45df3299aab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:33.566301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407bc7-4ae5-412a-b912-45df3299aab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:33.566777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407bc7-4ae5-412a-b912-45df3299aab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:33.567148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407bc7-4ae5-412a-b912-45df3299aab0 admin admin] PATH_INFO: `/v3/projects/776f0dcb567f4a2f92124a81deda2895/users/bd2b7c513726424ab3b08dc9ab040498/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:33.587507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22407bc7-4ae5-412a-b912-45df3299aab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=776f0dcb567f4a2f92124a81deda2895, user_id=bd2b7c513726424ab3b08dc9ab040498, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:33.590488 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22407bc7-4ae5-412a-b912-45df3299aab0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:33.612433 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1326/2641] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:33 2022] PUT /identity/v3/projects/776f0dcb567f4a2f92124a81deda2895/users/bd2b7c513726424ab3b08dc9ab040498/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:41:33.624791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b9ca9-f460-455f-a438-9d0f89e39a1d None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:33.625335 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b9ca9-f460-455f-a438-9d0f89e39a1d None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:33.627022 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b9ca9-f460-455f-a438-9d0f89e39a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:33.635817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:33.691071 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-440b9ca9-f460-455f-a438-9d0f89e39a1d None None] MFA Rules not processed for user `bd2b7c513726424ab3b08dc9ab040498`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:33.692866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-440b9ca9-f460-455f-a438-9d0f89e39a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:33.790629 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1316/2642] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:33.795779 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22407bc7-4ae5-412a-b912-45df3299aab0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:33.890351 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22407bc7-4ae5-412a-b912-45df3299aab0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:33.903514 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde9d74-9bd4-4a84-b355-abf6eac4a288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:33.905215 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde9d74-9bd4-4a84-b355-abf6eac4a288 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:33.906532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde9d74-9bd4-4a84-b355-abf6eac4a288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:33.907678 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde9d74-9bd4-4a84-b355-abf6eac4a288 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:33.908569 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde9d74-9bd4-4a84-b355-abf6eac4a288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:33.911868 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde9d74-9bd4-4a84-b355-abf6eac4a288 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:33.948209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1327/2643] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:41:33 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:33.952378 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b9ca9-f460-455f-a438-9d0f89e39a1d None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:33.981666 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b9ca9-f460-455f-a438-9d0f89e39a1d None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:34.075612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d09c69-01fb-4389-9eaa-9dfd3ae5bdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:34.076924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d09c69-01fb-4389-9eaa-9dfd3ae5bdf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:34.077399 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d09c69-01fb-4389-9eaa-9dfd3ae5bdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:34.077988 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d09c69-01fb-4389-9eaa-9dfd3ae5bdf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:34.078899 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d09c69-01fb-4389-9eaa-9dfd3ae5bdf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:34.081606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d09c69-01fb-4389-9eaa-9dfd3ae5bdf8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:34.115908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1317/2644] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:41:33 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:41:34.121374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde9d74-9bd4-4a84-b355-abf6eac4a288 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:34.140519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde9d74-9bd4-4a84-b355-abf6eac4a288 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:34.146090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce83cbb-d65c-450b-a30c-9070374d83d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:34.147132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce83cbb-d65c-450b-a30c-9070374d83d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:34.147413 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce83cbb-d65c-450b-a30c-9070374d83d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:34.147687 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce83cbb-d65c-450b-a30c-9070374d83d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:34.148481 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce83cbb-d65c-450b-a30c-9070374d83d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:34.150133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce83cbb-d65c-450b-a30c-9070374d83d5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:34.162874 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1328/2645] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:34.167981 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d09c69-01fb-4389-9eaa-9dfd3ae5bdf8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:34.180667 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d09c69-01fb-4389-9eaa-9dfd3ae5bdf8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:34.185699 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bad024-c994-4c1c-801b-a9cbe7f5b9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:34.186756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bad024-c994-4c1c-801b-a9cbe7f5b9f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:34.187135 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bad024-c994-4c1c-801b-a9cbe7f5b9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:34.187494 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bad024-c994-4c1c-801b-a9cbe7f5b9f8 admin admin] PATH_INFO: `/v3/projects/b06f58a9c59143bda113c1ae8534c489/users/9cc8c14484c84871b5c83faae904d6e9/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:34.207703 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bad024-c994-4c1c-801b-a9cbe7f5b9f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06f58a9c59143bda113c1ae8534c489, user_id=9cc8c14484c84871b5c83faae904d6e9, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:34.211307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bad024-c994-4c1c-801b-a9cbe7f5b9f8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:34.241114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1318/2646] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:34 2022] PUT /identity/v3/projects/b06f58a9c59143bda113c1ae8534c489/users/9cc8c14484c84871b5c83faae904d6e9/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:34.243476 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce83cbb-d65c-450b-a30c-9070374d83d5 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:34.256954 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce83cbb-d65c-450b-a30c-9070374d83d5 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:34.325144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1214e2-ac2e-48ea-a4c4-68faa27dedb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:34.325928 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1214e2-ac2e-48ea-a4c4-68faa27dedb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:34.326303 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1214e2-ac2e-48ea-a4c4-68faa27dedb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:34.326665 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1214e2-ac2e-48ea-a4c4-68faa27dedb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:34.327508 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1214e2-ac2e-48ea-a4c4-68faa27dedb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:34.329392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1214e2-ac2e-48ea-a4c4-68faa27dedb8 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:34.341230 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1329/2647] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:34.345969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bad024-c994-4c1c-801b-a9cbe7f5b9f8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:34.359036 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bad024-c994-4c1c-801b-a9cbe7f5b9f8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:34.365051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2181d-77c8-4f1e-b70b-36a627567df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:34.366148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2181d-77c8-4f1e-b70b-36a627567df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:34.366429 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2181d-77c8-4f1e-b70b-36a627567df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:34.366703 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2181d-77c8-4f1e-b70b-36a627567df5 admin admin] PATH_INFO: `/v3/projects/b06f58a9c59143bda113c1ae8534c489/users/9cc8c14484c84871b5c83faae904d6e9/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:34.371430 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2181d-77c8-4f1e-b70b-36a627567df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06f58a9c59143bda113c1ae8534c489, user_id=9cc8c14484c84871b5c83faae904d6e9, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:34.374418 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2181d-77c8-4f1e-b70b-36a627567df5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:34.386879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1319/2648] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:34 2022] PUT /identity/v3/projects/b06f58a9c59143bda113c1ae8534c489/users/9cc8c14484c84871b5c83faae904d6e9/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:34.398462 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bb2cb-5ee4-44ba-9c0b-b5f790c38377 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:34.398861 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bb2cb-5ee4-44ba-9c0b-b5f790c38377 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:34.399115 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bb2cb-5ee4-44ba-9c0b-b5f790c38377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:34.433494 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:34.439792 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a44bb2cb-5ee4-44ba-9c0b-b5f790c38377 None None] MFA Rules not processed for user `9cc8c14484c84871b5c83faae904d6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:34.442207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a44bb2cb-5ee4-44ba-9c0b-b5f790c38377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:34.546649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1330/2649] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:34.560114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2181d-77c8-4f1e-b70b-36a627567df5 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:34.562780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-eec2181d-77c8-4f1e-b70b-36a627567df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:34.629070 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:34.642780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2181d-77c8-4f1e-b70b-36a627567df5 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:34.647777 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea8c65-41f1-4de8-bd56-8762a23e0588 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:34.648515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea8c65-41f1-4de8-bd56-8762a23e0588 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:34.648802 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea8c65-41f1-4de8-bd56-8762a23e0588 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:34.649079 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea8c65-41f1-4de8-bd56-8762a23e0588 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:34.661936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea8c65-41f1-4de8-bd56-8762a23e0588 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:34.663837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea8c65-41f1-4de8-bd56-8762a23e0588 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:34.684456 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1320/2650] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:34 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:34.790168 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bb2cb-5ee4-44ba-9c0b-b5f790c38377 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:34.791575 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a44bb2cb-5ee4-44ba-9c0b-b5f790c38377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:34.805661 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bb2cb-5ee4-44ba-9c0b-b5f790c38377 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:34.810298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fabf04-40a7-49f2-9e41-5d31e7501161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:34.811397 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fabf04-40a7-49f2-9e41-5d31e7501161 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:34.811896 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fabf04-40a7-49f2-9e41-5d31e7501161 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:34.817840 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fabf04-40a7-49f2-9e41-5d31e7501161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:34.923440 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fabf04-40a7-49f2-9e41-5d31e7501161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:34.924730 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fabf04-40a7-49f2-9e41-5d31e7501161 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:34.935964 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1331/2651] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:37.828902 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea8c65-41f1-4de8-bd56-8762a23e0588 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:37.909576 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea8c65-41f1-4de8-bd56-8762a23e0588 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:37.915089 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18369251-de24-41d4-b557-36d0bc2c019e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:37.916333 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18369251-de24-41d4-b557-36d0bc2c019e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:37.916910 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18369251-de24-41d4-b557-36d0bc2c019e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:37.917187 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18369251-de24-41d4-b557-36d0bc2c019e admin admin] PATH_INFO: `/v3/users/bd2b7c513726424ab3b08dc9ab040498` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:37.918481 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18369251-de24-41d4-b557-36d0bc2c019e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2b7c513726424ab3b08dc9ab040498)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:37.920473 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18369251-de24-41d4-b557-36d0bc2c019e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:37.985248 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-18369251-de24-41d4-b557-36d0bc2c019e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2b7c513726424ab3b08dc9ab040498'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:37.998237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-18369251-de24-41d4-b557-36d0bc2c019e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2b7c513726424ab3b08dc9ab040498'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:38.036319 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-18369251-de24-41d4-b557-36d0bc2c019e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2b7c513726424ab3b08dc9ab040498'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:38.048621 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-18369251-de24-41d4-b557-36d0bc2c019e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2b7c513726424ab3b08dc9ab040498'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:38.049576 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-18369251-de24-41d4-b557-36d0bc2c019e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2b7c513726424ab3b08dc9ab040498'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:38.060070 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1321/2652] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:41:37 2022] DELETE /identity/v3/users/bd2b7c513726424ab3b08dc9ab040498 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:38.063948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b45651-9cd6-4eb8-8873-ba42e17279b1 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:38.064847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b45651-9cd6-4eb8-8873-ba42e17279b1 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:38.064847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b45651-9cd6-4eb8-8873-ba42e17279b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:38.099745 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e9b45651-9cd6-4eb8-8873-ba42e17279b1 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:38.101333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e9b45651-9cd6-4eb8-8873-ba42e17279b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:38.200734 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1332/2653] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:38.211006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18369251-de24-41d4-b557-36d0bc2c019e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:38.217548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-18369251-de24-41d4-b557-36d0bc2c019e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:38.296689 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18369251-de24-41d4-b557-36d0bc2c019e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:38.300389 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcb408-5bb9-4046-9f28-a027108a171a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:38.301128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcb408-5bb9-4046-9f28-a027108a171a service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:38.301410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcb408-5bb9-4046-9f28-a027108a171a service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:38.301685 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcb408-5bb9-4046-9f28-a027108a171a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:38.311459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcb408-5bb9-4046-9f28-a027108a171a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:38.313104 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fcb408-5bb9-4046-9f28-a027108a171a service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:38.324445 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1322/2654] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:38.623654 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b45651-9cd6-4eb8-8873-ba42e17279b1 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:38.625141 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e9b45651-9cd6-4eb8-8873-ba42e17279b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:38.638444 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b45651-9cd6-4eb8-8873-ba42e17279b1 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:38.644126 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2cfd4-a637-4a78-9a68-ec5b6861f368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:38.645473 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2cfd4-a637-4a78-9a68-ec5b6861f368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:38.645473 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2cfd4-a637-4a78-9a68-ec5b6861f368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:38.645767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2cfd4-a637-4a78-9a68-ec5b6861f368 admin admin] PATH_INFO: `/v3/projects/776f0dcb567f4a2f92124a81deda2895` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:38.648048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2cfd4-a637-4a78-9a68-ec5b6861f368 admin admin] RBAC: Authorizing `identity:delete_project(project_id=776f0dcb567f4a2f92124a81deda2895)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:38.650607 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2cfd4-a637-4a78-9a68-ec5b6861f368 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:38.700774 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:38.719286 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6ee2cfd4-a637-4a78-9a68-ec5b6861f368 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '776f0dcb567f4a2f92124a81deda2895', 'request_id': 'req-6ee2cfd4-a637-4a78-9a68-ec5b6861f368'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:38.729627 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6ee2cfd4-a637-4a78-9a68-ec5b6861f368 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '776f0dcb567f4a2f92124a81deda2895', 'request_id': 'req-6ee2cfd4-a637-4a78-9a68-ec5b6861f368'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:38.737231 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6ee2cfd4-a637-4a78-9a68-ec5b6861f368 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '776f0dcb567f4a2f92124a81deda2895', 'request_id': 'req-6ee2cfd4-a637-4a78-9a68-ec5b6861f368'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:38.750667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6ee2cfd4-a637-4a78-9a68-ec5b6861f368 admin admin] The token cache is being invalidate because project 776f0dcb567f4a2f92124a81deda2895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:41:38.750957 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6ee2cfd4-a637-4a78-9a68-ec5b6861f368 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:38.751733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6ee2cfd4-a637-4a78-9a68-ec5b6861f368 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:38.754204 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1333/2655] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:41:38 2022] DELETE /identity/v3/projects/776f0dcb567f4a2f92124a81deda2895 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:38.758085 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcb408-5bb9-4046-9f28-a027108a171a service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:38.769246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcb408-5bb9-4046-9f28-a027108a171a service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:38.775862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:38.912854 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596033d-b30c-4a5b-949d-6bbbb4ac11f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:38.913926 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596033d-b30c-4a5b-949d-6bbbb4ac11f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:38.914316 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596033d-b30c-4a5b-949d-6bbbb4ac11f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:38.914729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596033d-b30c-4a5b-949d-6bbbb4ac11f6 admin admin] PATH_INFO: `/v3/users/9cc8c14484c84871b5c83faae904d6e9` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:38.916269 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596033d-b30c-4a5b-949d-6bbbb4ac11f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc8c14484c84871b5c83faae904d6e9)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:38.918251 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596033d-b30c-4a5b-949d-6bbbb4ac11f6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:38.976997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f596033d-b30c-4a5b-949d-6bbbb4ac11f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc8c14484c84871b5c83faae904d6e9'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:38.986249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f596033d-b30c-4a5b-949d-6bbbb4ac11f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc8c14484c84871b5c83faae904d6e9'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:39.002094 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f596033d-b30c-4a5b-949d-6bbbb4ac11f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc8c14484c84871b5c83faae904d6e9'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:39.009564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f596033d-b30c-4a5b-949d-6bbbb4ac11f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc8c14484c84871b5c83faae904d6e9'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:39.010190 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f596033d-b30c-4a5b-949d-6bbbb4ac11f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc8c14484c84871b5c83faae904d6e9'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:39.017205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1323/2656] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:41:38 2022] DELETE /identity/v3/users/9cc8c14484c84871b5c83faae904d6e9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:39.353869 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2cfd4-a637-4a78-9a68-ec5b6861f368 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:39.355313 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6ee2cfd4-a637-4a78-9a68-ec5b6861f368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:39.369828 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2cfd4-a637-4a78-9a68-ec5b6861f368 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:39.442451 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e0054-8430-4e9a-9aa5-191fc9fbbdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:39.443338 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e0054-8430-4e9a-9aa5-191fc9fbbdc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:39.443619 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e0054-8430-4e9a-9aa5-191fc9fbbdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:39.443891 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e0054-8430-4e9a-9aa5-191fc9fbbdc5 admin admin] PATH_INFO: `/v3/projects/b06f58a9c59143bda113c1ae8534c489` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:39.445472 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e0054-8430-4e9a-9aa5-191fc9fbbdc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b06f58a9c59143bda113c1ae8534c489)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:39.447925 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e0054-8430-4e9a-9aa5-191fc9fbbdc5 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:39.502964 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-271e0054-8430-4e9a-9aa5-191fc9fbbdc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b06f58a9c59143bda113c1ae8534c489', 'request_id': 'req-271e0054-8430-4e9a-9aa5-191fc9fbbdc5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:39.512996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-271e0054-8430-4e9a-9aa5-191fc9fbbdc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b06f58a9c59143bda113c1ae8534c489', 'request_id': 'req-271e0054-8430-4e9a-9aa5-191fc9fbbdc5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:39.520035 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-271e0054-8430-4e9a-9aa5-191fc9fbbdc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b06f58a9c59143bda113c1ae8534c489', 'request_id': 'req-271e0054-8430-4e9a-9aa5-191fc9fbbdc5'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:39.533807 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-271e0054-8430-4e9a-9aa5-191fc9fbbdc5 admin admin] The token cache is being invalidate because project b06f58a9c59143bda113c1ae8534c489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:41:39.534060 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-271e0054-8430-4e9a-9aa5-191fc9fbbdc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:39.535048 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-271e0054-8430-4e9a-9aa5-191fc9fbbdc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:39.537487 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1334/2657] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:41:39 2022] DELETE /identity/v3/projects/b06f58a9c59143bda113c1ae8534c489 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:41:39.543748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334760ee-7694-4ca9-98fc-695e8490c5ec None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:39.544038 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334760ee-7694-4ca9-98fc-695e8490c5ec None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:39.544348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334760ee-7694-4ca9-98fc-695e8490c5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:39.565711 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-334760ee-7694-4ca9-98fc-695e8490c5ec None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:39.566965 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-334760ee-7694-4ca9-98fc-695e8490c5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:39.630094 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1324/2658] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:39.639287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b00596-c396-41c6-8338-e842d4b178bd None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:39.639572 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b00596-c396-41c6-8338-e842d4b178bd None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:39.639845 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b00596-c396-41c6-8338-e842d4b178bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:39.660521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-88b00596-c396-41c6-8338-e842d4b178bd None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:39.661749 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-88b00596-c396-41c6-8338-e842d4b178bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:39.671757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1335/2659] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:39.676206 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334760ee-7694-4ca9-98fc-695e8490c5ec None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:39.687165 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334760ee-7694-4ca9-98fc-695e8490c5ec None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:39.692001 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0791d-6f44-4834-bb6a-af6fd0d461cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:39.692701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0791d-6f44-4834-bb6a-af6fd0d461cd admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:39.692987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0791d-6f44-4834-bb6a-af6fd0d461cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:39.693260 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0791d-6f44-4834-bb6a-af6fd0d461cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:39.693994 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0791d-6f44-4834-bb6a-af6fd0d461cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:41:39.694402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0791d-6f44-4834-bb6a-af6fd0d461cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:39.696687 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0791d-6f44-4834-bb6a-af6fd0d461cd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:39.708869 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1325/2660] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:41:39.713621 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b00596-c396-41c6-8338-e842d4b178bd None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:39.723697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b00596-c396-41c6-8338-e842d4b178bd None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:39.729795 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac972089-5c4c-47b9-ac38-129d812c9f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:39.730459 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac972089-5c4c-47b9-ac38-129d812c9f8d admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:39.730741 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac972089-5c4c-47b9-ac38-129d812c9f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:39.731008 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac972089-5c4c-47b9-ac38-129d812c9f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:39.731715 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac972089-5c4c-47b9-ac38-129d812c9f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:39.733738 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac972089-5c4c-47b9-ac38-129d812c9f8d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:39.769343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1336/2661] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:41:39 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:39.775941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0791d-6f44-4834-bb6a-af6fd0d461cd admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:39.786578 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0791d-6f44-4834-bb6a-af6fd0d461cd admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:39.798700 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:39.853117 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613479f-ba1f-414d-b048-5e94b8283de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:39.853815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613479f-ba1f-414d-b048-5e94b8283de2 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:39.854098 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613479f-ba1f-414d-b048-5e94b8283de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:39.854414 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613479f-ba1f-414d-b048-5e94b8283de2 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:39.855101 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613479f-ba1f-414d-b048-5e94b8283de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:39.857115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613479f-ba1f-414d-b048-5e94b8283de2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:39.880392 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1326/2662] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:41:39 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:39.885238 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac972089-5c4c-47b9-ac38-129d812c9f8d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:39.896361 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac972089-5c4c-47b9-ac38-129d812c9f8d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:39.903806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d83229-5e56-49f8-ba5d-f81feaaf9b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:39.904842 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d83229-5e56-49f8-ba5d-f81feaaf9b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:39.905128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d83229-5e56-49f8-ba5d-f81feaaf9b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:39.905402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d83229-5e56-49f8-ba5d-f81feaaf9b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:39.906148 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d83229-5e56-49f8-ba5d-f81feaaf9b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:39.907796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d83229-5e56-49f8-ba5d-f81feaaf9b40 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:39.924601 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1337/2663] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:39.925450 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613479f-ba1f-414d-b048-5e94b8283de2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:39.936230 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613479f-ba1f-414d-b048-5e94b8283de2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:39.942148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e7e9b-44bf-4d9d-b687-c93de7c451ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:39.943014 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e7e9b-44bf-4d9d-b687-c93de7c451ef admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:39.943532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e7e9b-44bf-4d9d-b687-c93de7c451ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:39.943884 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e7e9b-44bf-4d9d-b687-c93de7c451ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:39.945140 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e7e9b-44bf-4d9d-b687-c93de7c451ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:39.946862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e7e9b-44bf-4d9d-b687-c93de7c451ef admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:39.965548 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1327/2664] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:39.970226 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d83229-5e56-49f8-ba5d-f81feaaf9b40 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:39.984393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d83229-5e56-49f8-ba5d-f81feaaf9b40 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:39.989739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095eec7-e635-4e23-ab86-a5eb8d45ca4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:39.990721 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095eec7-e635-4e23-ab86-a5eb8d45ca4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:39.991002 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095eec7-e635-4e23-ab86-a5eb8d45ca4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:39.991830 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095eec7-e635-4e23-ab86-a5eb8d45ca4b admin admin] PATH_INFO: `/v3/projects/b0a52210d1ce4d20b3c602b91747e74e/users/877fc6a068004dcc96de13dfc3f7e539/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:40.000900 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:40.010802 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095eec7-e635-4e23-ab86-a5eb8d45ca4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a52210d1ce4d20b3c602b91747e74e, user_id=877fc6a068004dcc96de13dfc3f7e539, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:40.013831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095eec7-e635-4e23-ab86-a5eb8d45ca4b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:40.031737 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1338/2665] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:39 2022] PUT /identity/v3/projects/b0a52210d1ce4d20b3c602b91747e74e/users/877fc6a068004dcc96de13dfc3f7e539/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:40.042292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdd11e-c05e-48c8-be05-b41ea2f32b1e None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:40.042584 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdd11e-c05e-48c8-be05-b41ea2f32b1e None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:40.042853 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdd11e-c05e-48c8-be05-b41ea2f32b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:40.078331 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-94bdd11e-c05e-48c8-be05-b41ea2f32b1e None None] MFA Rules not processed for user `877fc6a068004dcc96de13dfc3f7e539`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:40.079566 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-94bdd11e-c05e-48c8-be05-b41ea2f32b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:40.175048 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1328/2666] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:40.180211 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095eec7-e635-4e23-ab86-a5eb8d45ca4b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:40.263647 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095eec7-e635-4e23-ab86-a5eb8d45ca4b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:40.268251 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9490946-2555-4150-952f-eb53e3e3f2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:40.268918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9490946-2555-4150-952f-eb53e3e3f2f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:40.269191 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9490946-2555-4150-952f-eb53e3e3f2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:40.270159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9490946-2555-4150-952f-eb53e3e3f2f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:40.270313 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9490946-2555-4150-952f-eb53e3e3f2f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:40.272514 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9490946-2555-4150-952f-eb53e3e3f2f9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:40.309360 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1339/2667] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:41:40 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:40.318130 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdd11e-c05e-48c8-be05-b41ea2f32b1e None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:40.331970 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdd11e-c05e-48c8-be05-b41ea2f32b1e None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:40.396891 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dd2c5-f680-4609-a233-10472d9663d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:40.397586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dd2c5-f680-4609-a233-10472d9663d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:40.397870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dd2c5-f680-4609-a233-10472d9663d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:40.398201 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dd2c5-f680-4609-a233-10472d9663d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:40.398893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91dd2c5-f680-4609-a233-10472d9663d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:40.400940 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91dd2c5-f680-4609-a233-10472d9663d5 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:40.426822 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1329/2668] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:41:40 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:41:40.431154 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9490946-2555-4150-952f-eb53e3e3f2f9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:40.442585 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9490946-2555-4150-952f-eb53e3e3f2f9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:40.449301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbea2a0-7fe6-4cf7-ad0c-f61272e022a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:40.449491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbea2a0-7fe6-4cf7-ad0c-f61272e022a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:40.449806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbea2a0-7fe6-4cf7-ad0c-f61272e022a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:40.450042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbea2a0-7fe6-4cf7-ad0c-f61272e022a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:40.450897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbea2a0-7fe6-4cf7-ad0c-f61272e022a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:40.452581 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbea2a0-7fe6-4cf7-ad0c-f61272e022a1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:40.470076 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1340/2669] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:40.471370 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dd2c5-f680-4609-a233-10472d9663d5 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:40.482106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dd2c5-f680-4609-a233-10472d9663d5 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:40.487185 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf631b5-31e1-48a9-ae8e-939b7052868c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:40.488497 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf631b5-31e1-48a9-ae8e-939b7052868c admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:40.488773 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf631b5-31e1-48a9-ae8e-939b7052868c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:40.489032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf631b5-31e1-48a9-ae8e-939b7052868c admin admin] PATH_INFO: `/v3/projects/eb7aa01cb4034b27a36fde5ce69faaf9/users/9985c30f2310439db726e769b25d886f/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:40.503076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:40.507525 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf631b5-31e1-48a9-ae8e-939b7052868c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7aa01cb4034b27a36fde5ce69faaf9, user_id=9985c30f2310439db726e769b25d886f, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:40.511317 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf631b5-31e1-48a9-ae8e-939b7052868c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:40.528677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1330/2670] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:40 2022] PUT /identity/v3/projects/eb7aa01cb4034b27a36fde5ce69faaf9/users/9985c30f2310439db726e769b25d886f/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:40.534178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbea2a0-7fe6-4cf7-ad0c-f61272e022a1 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:40.545246 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbea2a0-7fe6-4cf7-ad0c-f61272e022a1 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:40.616106 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0add2-854c-4c9e-a83a-58047ed7f266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:40.616744 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0add2-854c-4c9e-a83a-58047ed7f266 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:40.617025 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0add2-854c-4c9e-a83a-58047ed7f266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:40.617346 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0add2-854c-4c9e-a83a-58047ed7f266 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:40.618681 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0add2-854c-4c9e-a83a-58047ed7f266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:40.619909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0add2-854c-4c9e-a83a-58047ed7f266 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:40.631922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1341/2671] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:41:40.635424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf631b5-31e1-48a9-ae8e-939b7052868c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:40.646327 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf631b5-31e1-48a9-ae8e-939b7052868c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:40.651693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7c88c-da3f-4411-8a88-1dace3fc107d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:40.652750 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7c88c-da3f-4411-8a88-1dace3fc107d admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:40.653093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7c88c-da3f-4411-8a88-1dace3fc107d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:40.653433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7c88c-da3f-4411-8a88-1dace3fc107d admin admin] PATH_INFO: `/v3/projects/eb7aa01cb4034b27a36fde5ce69faaf9/users/9985c30f2310439db726e769b25d886f/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:40.655650 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7c88c-da3f-4411-8a88-1dace3fc107d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7aa01cb4034b27a36fde5ce69faaf9, user_id=9985c30f2310439db726e769b25d886f, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:40.659099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7c88c-da3f-4411-8a88-1dace3fc107d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:40.669972 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1331/2672] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:40 2022] PUT /identity/v3/projects/eb7aa01cb4034b27a36fde5ce69faaf9/users/9985c30f2310439db726e769b25d886f/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:40.680703 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779df224-a70f-459b-9b4b-b3680b27dbc5 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:40.681252 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779df224-a70f-459b-9b4b-b3680b27dbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:40.681692 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779df224-a70f-459b-9b4b-b3680b27dbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:40.714244 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-779df224-a70f-459b-9b4b-b3680b27dbc5 None None] MFA Rules not processed for user `9985c30f2310439db726e769b25d886f`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:40.715463 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-779df224-a70f-459b-9b4b-b3680b27dbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:40.764925 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:40.796300 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1342/2673] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:40 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:40.804811 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7c88c-da3f-4411-8a88-1dace3fc107d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:40.807024 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-13d7c88c-da3f-4411-8a88-1dace3fc107d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:40.872679 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7c88c-da3f-4411-8a88-1dace3fc107d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:40.876896 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0995711-8fc5-45fd-a807-c47c5353bed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:40.877567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0995711-8fc5-45fd-a807-c47c5353bed4 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:40.877885 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0995711-8fc5-45fd-a807-c47c5353bed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:40.878328 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0995711-8fc5-45fd-a807-c47c5353bed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:40.888895 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0995711-8fc5-45fd-a807-c47c5353bed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:40.890605 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0995711-8fc5-45fd-a807-c47c5353bed4 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:40.902792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1332/2674] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:40 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:42.514369 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779df224-a70f-459b-9b4b-b3680b27dbc5 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:42.542760 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36af7b3-0039-4d78-b31c-87c72c4392cc None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:42.543292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36af7b3-0039-4d78-b31c-87c72c4392cc None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:42.543292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36af7b3-0039-4d78-b31c-87c72c4392cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:42.564635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a36af7b3-0039-4d78-b31c-87c72c4392cc None None] MFA Rules not processed for user `b6264de254d24c43932f28527bea4acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:42.565855 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a36af7b3-0039-4d78-b31c-87c72c4392cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:42.592909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779df224-a70f-459b-9b4b-b3680b27dbc5 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:42.597468 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0640da-4c03-4e18-a43d-cae4f04d6a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:42.598360 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0640da-4c03-4e18-a43d-cae4f04d6a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:42.598643 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0640da-4c03-4e18-a43d-cae4f04d6a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:42.598921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0640da-4c03-4e18-a43d-cae4f04d6a5e admin admin] PATH_INFO: `/v3/users/877fc6a068004dcc96de13dfc3f7e539` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:42.600217 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0640da-4c03-4e18-a43d-cae4f04d6a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=877fc6a068004dcc96de13dfc3f7e539)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:42.602327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0640da-4c03-4e18-a43d-cae4f04d6a5e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:42.631387 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1333/2675] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:42.659320 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d0640da-4c03-4e18-a43d-cae4f04d6a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '877fc6a068004dcc96de13dfc3f7e539'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:42.660032 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d0640da-4c03-4e18-a43d-cae4f04d6a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '877fc6a068004dcc96de13dfc3f7e539'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:42.660750 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d0640da-4c03-4e18-a43d-cae4f04d6a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '877fc6a068004dcc96de13dfc3f7e539'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:42.677876 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d0640da-4c03-4e18-a43d-cae4f04d6a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '877fc6a068004dcc96de13dfc3f7e539'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:42.685672 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-6d0640da-4c03-4e18-a43d-cae4f04d6a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '877fc6a068004dcc96de13dfc3f7e539'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:42.701410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1343/2676] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:41:42 2022] DELETE /identity/v3/users/877fc6a068004dcc96de13dfc3f7e539 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:42.706051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ffbb3-a487-4b27-8cce-e6715c1646d4 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:42.706443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ffbb3-a487-4b27-8cce-e6715c1646d4 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:42.706832 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ffbb3-a487-4b27-8cce-e6715c1646d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:42.726403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-833ffbb3-a487-4b27-8cce-e6715c1646d4 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:42.728715 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-833ffbb3-a487-4b27-8cce-e6715c1646d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:42.803670 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1334/2677] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:42.820646 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0640da-4c03-4e18-a43d-cae4f04d6a5e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:42.822170 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6d0640da-4c03-4e18-a43d-cae4f04d6a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:42.889586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0640da-4c03-4e18-a43d-cae4f04d6a5e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:42.894356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1c8f3-9c57-4914-9591-d571ec4a03f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:42.895029 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1c8f3-9c57-4914-9591-d571ec4a03f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:42.895360 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1c8f3-9c57-4914-9591-d571ec4a03f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:42.895641 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1c8f3-9c57-4914-9591-d571ec4a03f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:42.905953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1c8f3-9c57-4914-9591-d571ec4a03f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:42.907453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1c8f3-9c57-4914-9591-d571ec4a03f9 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:42.918410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1344/2678] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:41:43.324492 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ffbb3-a487-4b27-8cce-e6715c1646d4 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:43.328058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-833ffbb3-a487-4b27-8cce-e6715c1646d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:43.342551 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ffbb3-a487-4b27-8cce-e6715c1646d4 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:43.348472 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d707b-5065-419e-b9d7-54ac35d4a2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:43.349447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d707b-5065-419e-b9d7-54ac35d4a2e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:43.349794 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d707b-5065-419e-b9d7-54ac35d4a2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:43.350167 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d707b-5065-419e-b9d7-54ac35d4a2e3 admin admin] PATH_INFO: `/v3/projects/b0a52210d1ce4d20b3c602b91747e74e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:43.351520 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d707b-5065-419e-b9d7-54ac35d4a2e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0a52210d1ce4d20b3c602b91747e74e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:43.354149 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d707b-5065-419e-b9d7-54ac35d4a2e3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:43.384473 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:43.419087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-995d707b-5065-419e-b9d7-54ac35d4a2e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0a52210d1ce4d20b3c602b91747e74e', 'request_id': 'req-995d707b-5065-419e-b9d7-54ac35d4a2e3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:43.426943 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-995d707b-5065-419e-b9d7-54ac35d4a2e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0a52210d1ce4d20b3c602b91747e74e', 'request_id': 'req-995d707b-5065-419e-b9d7-54ac35d4a2e3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:43.447417 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-995d707b-5065-419e-b9d7-54ac35d4a2e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0a52210d1ce4d20b3c602b91747e74e', 'request_id': 'req-995d707b-5065-419e-b9d7-54ac35d4a2e3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:43.465714 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-995d707b-5065-419e-b9d7-54ac35d4a2e3 admin admin] The token cache is being invalidate because project b0a52210d1ce4d20b3c602b91747e74e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:41:43.466092 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-995d707b-5065-419e-b9d7-54ac35d4a2e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:43.466950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-995d707b-5065-419e-b9d7-54ac35d4a2e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:43.468827 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1335/2679] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:41:43 2022] DELETE /identity/v3/projects/b0a52210d1ce4d20b3c602b91747e74e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:43.472885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1c8f3-9c57-4914-9591-d571ec4a03f9 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:43.480518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:43.486213 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1c8f3-9c57-4914-9591-d571ec4a03f9 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:43.564685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d79b4-d27f-4d46-9c0b-c7f8e89b0651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:43.565578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d79b4-d27f-4d46-9c0b-c7f8e89b0651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:43.565858 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d79b4-d27f-4d46-9c0b-c7f8e89b0651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:43.566125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d79b4-d27f-4d46-9c0b-c7f8e89b0651 admin admin] PATH_INFO: `/v3/users/9985c30f2310439db726e769b25d886f` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:43.567339 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d79b4-d27f-4d46-9c0b-c7f8e89b0651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9985c30f2310439db726e769b25d886f)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:43.569341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d79b4-d27f-4d46-9c0b-c7f8e89b0651 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:43.627497 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-489d79b4-d27f-4d46-9c0b-c7f8e89b0651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9985c30f2310439db726e769b25d886f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:43.628465 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-489d79b4-d27f-4d46-9c0b-c7f8e89b0651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9985c30f2310439db726e769b25d886f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:43.629243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-489d79b4-d27f-4d46-9c0b-c7f8e89b0651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9985c30f2310439db726e769b25d886f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:43.643743 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-489d79b4-d27f-4d46-9c0b-c7f8e89b0651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9985c30f2310439db726e769b25d886f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:43.651341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-489d79b4-d27f-4d46-9c0b-c7f8e89b0651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9985c30f2310439db726e769b25d886f'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:43.666935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1345/2680] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:41:43 2022] DELETE /identity/v3/users/9985c30f2310439db726e769b25d886f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:41:43.969194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d707b-5065-419e-b9d7-54ac35d4a2e3 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:43.970737 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-995d707b-5065-419e-b9d7-54ac35d4a2e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:43.987237 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d707b-5065-419e-b9d7-54ac35d4a2e3 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:44.056032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a82df-9268-4313-843e-dbf35c9a02b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:44.057030 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a82df-9268-4313-843e-dbf35c9a02b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:44.057312 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a82df-9268-4313-843e-dbf35c9a02b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:44.057609 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a82df-9268-4313-843e-dbf35c9a02b2 admin admin] PATH_INFO: `/v3/projects/eb7aa01cb4034b27a36fde5ce69faaf9` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:44.058869 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a82df-9268-4313-843e-dbf35c9a02b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb7aa01cb4034b27a36fde5ce69faaf9)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:44.060925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a82df-9268-4313-843e-dbf35c9a02b2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:44.118245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-793a82df-9268-4313-843e-dbf35c9a02b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb7aa01cb4034b27a36fde5ce69faaf9', 'request_id': 'req-793a82df-9268-4313-843e-dbf35c9a02b2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:44.123963 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-793a82df-9268-4313-843e-dbf35c9a02b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb7aa01cb4034b27a36fde5ce69faaf9', 'request_id': 'req-793a82df-9268-4313-843e-dbf35c9a02b2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:44.134208 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-793a82df-9268-4313-843e-dbf35c9a02b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb7aa01cb4034b27a36fde5ce69faaf9', 'request_id': 'req-793a82df-9268-4313-843e-dbf35c9a02b2'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:44.145508 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-793a82df-9268-4313-843e-dbf35c9a02b2 admin admin] The token cache is being invalidate because project eb7aa01cb4034b27a36fde5ce69faaf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:41:44.145794 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-793a82df-9268-4313-843e-dbf35c9a02b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:44.146427 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-793a82df-9268-4313-843e-dbf35c9a02b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:44.147976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1336/2681] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:41:43 2022] DELETE /identity/v3/projects/eb7aa01cb4034b27a36fde5ce69faaf9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:44.153605 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dee21-484b-4bcf-a452-9e8f3c940c20 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:44.153891 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dee21-484b-4bcf-a452-9e8f3c940c20 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:44.154170 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dee21-484b-4bcf-a452-9e8f3c940c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:44.173190 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f67dee21-484b-4bcf-a452-9e8f3c940c20 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:44.174404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f67dee21-484b-4bcf-a452-9e8f3c940c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:44.237278 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1346/2682] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:44.249798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65a2d1-47bf-4a02-a258-987a4e934f14 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:44.250099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65a2d1-47bf-4a02-a258-987a4e934f14 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:44.250374 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65a2d1-47bf-4a02-a258-987a4e934f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:44.271198 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8b65a2d1-47bf-4a02-a258-987a4e934f14 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:44.272468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8b65a2d1-47bf-4a02-a258-987a4e934f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:44.282506 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1337/2683] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:44.287605 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67dee21-484b-4bcf-a452-9e8f3c940c20 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:44.300814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67dee21-484b-4bcf-a452-9e8f3c940c20 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:44.307340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cac96-c5dc-4b98-ad48-961424e7e37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:44.308031 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cac96-c5dc-4b98-ad48-961424e7e37c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:44.308313 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cac96-c5dc-4b98-ad48-961424e7e37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:44.308586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cac96-c5dc-4b98-ad48-961424e7e37c admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:44.310013 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cac96-c5dc-4b98-ad48-961424e7e37c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:41:44.310013 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cac96-c5dc-4b98-ad48-961424e7e37c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:44.312042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cac96-c5dc-4b98-ad48-961424e7e37c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:44.324623 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1347/2684] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:41:44.328879 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65a2d1-47bf-4a02-a258-987a4e934f14 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:44.338850 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65a2d1-47bf-4a02-a258-987a4e934f14 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:44.344768 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49085c2-2313-43e7-9976-a401e836a6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:44.345433 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49085c2-2313-43e7-9976-a401e836a6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:44.345717 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49085c2-2313-43e7-9976-a401e836a6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:44.345981 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49085c2-2313-43e7-9976-a401e836a6d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:44.346691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49085c2-2313-43e7-9976-a401e836a6d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:44.348668 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49085c2-2313-43e7-9976-a401e836a6d8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:44.379095 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1338/2685] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:41:44 2022] POST /identity/v3/projects => generated 407 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:41:44.383020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cac96-c5dc-4b98-ad48-961424e7e37c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:44.394024 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cac96-c5dc-4b98-ad48-961424e7e37c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:44.403949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:44.465585 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71a679-c52d-4d45-987b-d5d265258955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:44.466459 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71a679-c52d-4d45-987b-d5d265258955 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:44.466837 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71a679-c52d-4d45-987b-d5d265258955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:44.467208 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71a679-c52d-4d45-987b-d5d265258955 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:44.468600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71a679-c52d-4d45-987b-d5d265258955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:44.471375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71a679-c52d-4d45-987b-d5d265258955 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:44.504522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1348/2686] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:41:44 2022] POST /identity/v3/users => generated 304 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:44.506165 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49085c2-2313-43e7-9976-a401e836a6d8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:44.520292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49085c2-2313-43e7-9976-a401e836a6d8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:44.527940 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50daee1-c2fc-4480-ae19-849732e50760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:44.528730 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50daee1-c2fc-4480-ae19-849732e50760 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:44.529032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50daee1-c2fc-4480-ae19-849732e50760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:44.529483 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50daee1-c2fc-4480-ae19-849732e50760 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:44.530365 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50daee1-c2fc-4480-ae19-849732e50760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:44.533142 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50daee1-c2fc-4480-ae19-849732e50760 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:44.536888 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:44.555735 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1339/2687] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:44.558425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71a679-c52d-4d45-987b-d5d265258955 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:44.572135 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71a679-c52d-4d45-987b-d5d265258955 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:44.578829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccd90c-d960-4ce1-8b6c-c7433d1be7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:44.579648 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccd90c-d960-4ce1-8b6c-c7433d1be7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:44.579994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccd90c-d960-4ce1-8b6c-c7433d1be7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:44.581418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccd90c-d960-4ce1-8b6c-c7433d1be7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:44.581418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ccd90c-d960-4ce1-8b6c-c7433d1be7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:44.583971 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ccd90c-d960-4ce1-8b6c-c7433d1be7c0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:44.607343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1349/2688] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:44.611278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50daee1-c2fc-4480-ae19-849732e50760 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:44.629458 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50daee1-c2fc-4480-ae19-849732e50760 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:44.636972 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0ec79-c1f7-48d5-918f-a5e1f20808b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:44.637942 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0ec79-c1f7-48d5-918f-a5e1f20808b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:44.638310 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0ec79-c1f7-48d5-918f-a5e1f20808b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:44.638630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0ec79-c1f7-48d5-918f-a5e1f20808b4 admin admin] PATH_INFO: `/v3/projects/16efe427e3c744d9807967355555431b/users/af61f7c8c20240ec87094ee0c218b3c6/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:44.661373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0ec79-c1f7-48d5-918f-a5e1f20808b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16efe427e3c744d9807967355555431b, user_id=af61f7c8c20240ec87094ee0c218b3c6, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:44.664329 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0ec79-c1f7-48d5-918f-a5e1f20808b4 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:44.700928 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1340/2689] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:44 2022] PUT /identity/v3/projects/16efe427e3c744d9807967355555431b/users/af61f7c8c20240ec87094ee0c218b3c6/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:44.702542 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c6f10-a862-40d8-b07f-4d00ae3b67b3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:44.702761 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c6f10-a862-40d8-b07f-4d00ae3b67b3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:44.702979 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c6f10-a862-40d8-b07f-4d00ae3b67b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:44.732227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-560c6f10-a862-40d8-b07f-4d00ae3b67b3 None None] MFA Rules not processed for user `af61f7c8c20240ec87094ee0c218b3c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:44.733460 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-560c6f10-a862-40d8-b07f-4d00ae3b67b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:44.808341 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1350/2690] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:44.813438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0ec79-c1f7-48d5-918f-a5e1f20808b4 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:44.887903 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0ec79-c1f7-48d5-918f-a5e1f20808b4 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:44.892713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcb2b0-51bb-4eb9-9ea2-22cd2482ab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:44.893392 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcb2b0-51bb-4eb9-9ea2-22cd2482ab54 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:44.893682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcb2b0-51bb-4eb9-9ea2-22cd2482ab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:44.893965 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcb2b0-51bb-4eb9-9ea2-22cd2482ab54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:44.894667 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcb2b0-51bb-4eb9-9ea2-22cd2482ab54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:44.896695 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcb2b0-51bb-4eb9-9ea2-22cd2482ab54 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:44.927608 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1341/2691] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:41:44 2022] POST /identity/v3/projects => generated 407 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:44.928876 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c6f10-a862-40d8-b07f-4d00ae3b67b3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:44.941000 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c6f10-a862-40d8-b07f-4d00ae3b67b3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:44.998858 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e69dcc-6157-49f7-b611-87b7b1de700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:44.999543 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e69dcc-6157-49f7-b611-87b7b1de700b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:44.999826 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e69dcc-6157-49f7-b611-87b7b1de700b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:45.000131 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e69dcc-6157-49f7-b611-87b7b1de700b admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:45.000857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e69dcc-6157-49f7-b611-87b7b1de700b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:45.002857 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e69dcc-6157-49f7-b611-87b7b1de700b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:45.026970 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1351/2692] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:41:44 2022] POST /identity/v3/users => generated 310 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:45.032787 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcb2b0-51bb-4eb9-9ea2-22cd2482ab54 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:45.050865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcb2b0-51bb-4eb9-9ea2-22cd2482ab54 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:45.058018 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2fe6b-96cc-48ab-93ef-6a2517cdee87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:45.058753 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2fe6b-96cc-48ab-93ef-6a2517cdee87 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:45.059037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2fe6b-96cc-48ab-93ef-6a2517cdee87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:45.059351 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2fe6b-96cc-48ab-93ef-6a2517cdee87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:45.060126 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2fe6b-96cc-48ab-93ef-6a2517cdee87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:45.061880 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2fe6b-96cc-48ab-93ef-6a2517cdee87 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:45.075031 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1342/2693] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:45.079770 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e69dcc-6157-49f7-b611-87b7b1de700b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:45.091662 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e69dcc-6157-49f7-b611-87b7b1de700b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:45.097283 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f4eb6-b74e-4db0-ba17-fd7437f3d5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:45.098199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f4eb6-b74e-4db0-ba17-fd7437f3d5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:45.098481 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f4eb6-b74e-4db0-ba17-fd7437f3d5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:45.098757 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f4eb6-b74e-4db0-ba17-fd7437f3d5ac admin admin] PATH_INFO: `/v3/projects/945117e28ea948bc88953f05b0bd6410/users/a6e36ec86e86403d8c428e3db8d38def/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:45.103779 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:45.117820 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f4eb6-b74e-4db0-ba17-fd7437f3d5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=945117e28ea948bc88953f05b0bd6410, user_id=a6e36ec86e86403d8c428e3db8d38def, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:45.120665 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f4eb6-b74e-4db0-ba17-fd7437f3d5ac admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:45.139025 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1352/2694] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:45 2022] PUT /identity/v3/projects/945117e28ea948bc88953f05b0bd6410/users/a6e36ec86e86403d8c428e3db8d38def/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:45.143280 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2fe6b-96cc-48ab-93ef-6a2517cdee87 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:45.154869 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2fe6b-96cc-48ab-93ef-6a2517cdee87 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:45.213193 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3b31a-3b71-47fe-b459-d1a94085bb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:45.213923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3b31a-3b71-47fe-b459-d1a94085bb34 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:45.214186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3b31a-3b71-47fe-b459-d1a94085bb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:45.214543 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3b31a-3b71-47fe-b459-d1a94085bb34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:45.215247 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3b31a-3b71-47fe-b459-d1a94085bb34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:45.216937 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3b31a-3b71-47fe-b459-d1a94085bb34 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:45.231173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1343/2695] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:45.232719 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f4eb6-b74e-4db0-ba17-fd7437f3d5ac admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:45.243671 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f4eb6-b74e-4db0-ba17-fd7437f3d5ac admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:45.248735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a9f5c-96b8-48bd-ae8d-74c2475949d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:45.249608 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a9f5c-96b8-48bd-ae8d-74c2475949d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:45.249886 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a9f5c-96b8-48bd-ae8d-74c2475949d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:45.250157 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a9f5c-96b8-48bd-ae8d-74c2475949d7 admin admin] PATH_INFO: `/v3/projects/945117e28ea948bc88953f05b0bd6410/users/a6e36ec86e86403d8c428e3db8d38def/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:45.252283 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a9f5c-96b8-48bd-ae8d-74c2475949d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=945117e28ea948bc88953f05b0bd6410, user_id=a6e36ec86e86403d8c428e3db8d38def, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:45.254935 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a9f5c-96b8-48bd-ae8d-74c2475949d7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:45.266480 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1353/2696] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:45 2022] PUT /identity/v3/projects/945117e28ea948bc88953f05b0bd6410/users/a6e36ec86e86403d8c428e3db8d38def/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:45.279905 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bdd5c-7671-4b92-957e-b5e200c16144 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:45.280261 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bdd5c-7671-4b92-957e-b5e200c16144 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:45.280653 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bdd5c-7671-4b92-957e-b5e200c16144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:45.315770 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-143bdd5c-7671-4b92-957e-b5e200c16144 None None] MFA Rules not processed for user `a6e36ec86e86403d8c428e3db8d38def`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:45.316969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-143bdd5c-7671-4b92-957e-b5e200c16144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:45.352828 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:45.399650 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1344/2697] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:45 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:45.411144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a9f5c-96b8-48bd-ae8d-74c2475949d7 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:45.413939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-676a9f5c-96b8-48bd-ae8d-74c2475949d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:45.483273 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a9f5c-96b8-48bd-ae8d-74c2475949d7 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:45.488103 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cd90f-888a-4770-840d-a13ba7d57edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:45.488801 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cd90f-888a-4770-840d-a13ba7d57edd service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:45.489129 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cd90f-888a-4770-840d-a13ba7d57edd service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:45.490609 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cd90f-888a-4770-840d-a13ba7d57edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:45.500350 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17cd90f-888a-4770-840d-a13ba7d57edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:45.501833 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17cd90f-888a-4770-840d-a13ba7d57edd service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:45.516095 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1354/2698] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:45 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:45.703106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bdd5c-7671-4b92-957e-b5e200c16144 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:45.713812 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143bdd5c-7671-4b92-957e-b5e200c16144 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:45.718581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3009b8-0885-45a2-8fb4-9d86f0292cce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:45.719366 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3009b8-0885-45a2-8fb4-9d86f0292cce service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:45.719650 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3009b8-0885-45a2-8fb4-9d86f0292cce service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:45.720033 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3009b8-0885-45a2-8fb4-9d86f0292cce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:45.790868 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3009b8-0885-45a2-8fb4-9d86f0292cce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:45.792531 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3009b8-0885-45a2-8fb4-9d86f0292cce service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:45.802657 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1345/2699] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:45 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:51.293397 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cd90f-888a-4770-840d-a13ba7d57edd service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:51.356154 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cd90f-888a-4770-840d-a13ba7d57edd service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:51.360933 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11743d30-e929-49f5-94d2-e610f25368c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:51.361951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11743d30-e929-49f5-94d2-e610f25368c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:51.362297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11743d30-e929-49f5-94d2-e610f25368c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:51.362637 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11743d30-e929-49f5-94d2-e610f25368c4 admin admin] PATH_INFO: `/v3/users/af61f7c8c20240ec87094ee0c218b3c6` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:51.363913 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11743d30-e929-49f5-94d2-e610f25368c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af61f7c8c20240ec87094ee0c218b3c6)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:51.366012 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11743d30-e929-49f5-94d2-e610f25368c4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:51.436997 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-11743d30-e929-49f5-94d2-e610f25368c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af61f7c8c20240ec87094ee0c218b3c6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:51.437885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-11743d30-e929-49f5-94d2-e610f25368c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af61f7c8c20240ec87094ee0c218b3c6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:51.438805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-11743d30-e929-49f5-94d2-e610f25368c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af61f7c8c20240ec87094ee0c218b3c6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:51.455366 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-11743d30-e929-49f5-94d2-e610f25368c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af61f7c8c20240ec87094ee0c218b3c6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:51.464680 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-11743d30-e929-49f5-94d2-e610f25368c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af61f7c8c20240ec87094ee0c218b3c6'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:51.468292 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:51.483194 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1355/2700] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:41:51 2022] DELETE /identity/v3/users/af61f7c8c20240ec87094ee0c218b3c6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:51.488165 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d90ea-6a1c-423a-9321-5c60fe2b76c0 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:51.488644 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d90ea-6a1c-423a-9321-5c60fe2b76c0 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:51.488809 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d90ea-6a1c-423a-9321-5c60fe2b76c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:51.507698 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8d7d90ea-6a1c-423a-9321-5c60fe2b76c0 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:51.509018 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8d7d90ea-6a1c-423a-9321-5c60fe2b76c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:51.573324 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1346/2701] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:51.583188 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11743d30-e929-49f5-94d2-e610f25368c4 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:51.584762 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-11743d30-e929-49f5-94d2-e610f25368c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:51.658866 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11743d30-e929-49f5-94d2-e610f25368c4 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:51.663087 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a114de1-5358-4a66-b1d8-e31a3cb97099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:51.663758 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a114de1-5358-4a66-b1d8-e31a3cb97099 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:51.664196 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a114de1-5358-4a66-b1d8-e31a3cb97099 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:51.664343 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a114de1-5358-4a66-b1d8-e31a3cb97099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:51.674544 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a114de1-5358-4a66-b1d8-e31a3cb97099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:51.676038 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a114de1-5358-4a66-b1d8-e31a3cb97099 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:51.686171 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1356/2702] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:51.982044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d90ea-6a1c-423a-9321-5c60fe2b76c0 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:51.983614 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8d7d90ea-6a1c-423a-9321-5c60fe2b76c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:51.996701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d90ea-6a1c-423a-9321-5c60fe2b76c0 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:52.001674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b0074-f723-4868-9921-7f24b39d7201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:52.002725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b0074-f723-4868-9921-7f24b39d7201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:52.003009 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b0074-f723-4868-9921-7f24b39d7201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:52.003314 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b0074-f723-4868-9921-7f24b39d7201 admin admin] PATH_INFO: `/v3/projects/16efe427e3c744d9807967355555431b` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:52.004592 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b0074-f723-4868-9921-7f24b39d7201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16efe427e3c744d9807967355555431b)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:52.006557 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b0074-f723-4868-9921-7f24b39d7201 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:52.056133 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-966b0074-f723-4868-9921-7f24b39d7201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16efe427e3c744d9807967355555431b', 'request_id': 'req-966b0074-f723-4868-9921-7f24b39d7201'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:52.062292 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-966b0074-f723-4868-9921-7f24b39d7201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16efe427e3c744d9807967355555431b', 'request_id': 'req-966b0074-f723-4868-9921-7f24b39d7201'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:52.066530 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:52.073214 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-966b0074-f723-4868-9921-7f24b39d7201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16efe427e3c744d9807967355555431b', 'request_id': 'req-966b0074-f723-4868-9921-7f24b39d7201'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:52.093410 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-966b0074-f723-4868-9921-7f24b39d7201 admin admin] The token cache is being invalidate because project 16efe427e3c744d9807967355555431b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:41:52.093647 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-966b0074-f723-4868-9921-7f24b39d7201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:52.094332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-966b0074-f723-4868-9921-7f24b39d7201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:52.096178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1347/2703] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:41:51 2022] DELETE /identity/v3/projects/16efe427e3c744d9807967355555431b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:52.100285 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a114de1-5358-4a66-b1d8-e31a3cb97099 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:52.111119 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a114de1-5358-4a66-b1d8-e31a3cb97099 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:52.173293 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71c498-7f78-491e-8ae9-f9d8f70d07fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:52.174183 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71c498-7f78-491e-8ae9-f9d8f70d07fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:52.174464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71c498-7f78-491e-8ae9-f9d8f70d07fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:52.174739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71c498-7f78-491e-8ae9-f9d8f70d07fe admin admin] PATH_INFO: `/v3/users/a6e36ec86e86403d8c428e3db8d38def` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:52.175949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71c498-7f78-491e-8ae9-f9d8f70d07fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e36ec86e86403d8c428e3db8d38def)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:52.177938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71c498-7f78-491e-8ae9-f9d8f70d07fe admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:52.250901 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dd71c498-7f78-491e-8ae9-f9d8f70d07fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e36ec86e86403d8c428e3db8d38def'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:52.251791 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dd71c498-7f78-491e-8ae9-f9d8f70d07fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e36ec86e86403d8c428e3db8d38def'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:52.252738 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dd71c498-7f78-491e-8ae9-f9d8f70d07fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e36ec86e86403d8c428e3db8d38def'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:52.275702 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dd71c498-7f78-491e-8ae9-f9d8f70d07fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e36ec86e86403d8c428e3db8d38def'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:52.284309 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-dd71c498-7f78-491e-8ae9-f9d8f70d07fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e36ec86e86403d8c428e3db8d38def'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:52.320597 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1357/2704] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:41:52 2022] DELETE /identity/v3/users/a6e36ec86e86403d8c428e3db8d38def => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:52.689564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b0074-f723-4868-9921-7f24b39d7201 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:52.691119 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-966b0074-f723-4868-9921-7f24b39d7201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:52.710682 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b0074-f723-4868-9921-7f24b39d7201 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:52.770721 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e8b12-1a75-4c2f-9814-9a1d1c6d7cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:52.771592 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e8b12-1a75-4c2f-9814-9a1d1c6d7cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:52.771865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e8b12-1a75-4c2f-9814-9a1d1c6d7cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:52.772173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e8b12-1a75-4c2f-9814-9a1d1c6d7cd1 admin admin] PATH_INFO: `/v3/projects/945117e28ea948bc88953f05b0bd6410` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:52.773377 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e8b12-1a75-4c2f-9814-9a1d1c6d7cd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=945117e28ea948bc88953f05b0bd6410)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:52.775475 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e8b12-1a75-4c2f-9814-9a1d1c6d7cd1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:52.825340 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c22e8b12-1a75-4c2f-9814-9a1d1c6d7cd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945117e28ea948bc88953f05b0bd6410', 'request_id': 'req-c22e8b12-1a75-4c2f-9814-9a1d1c6d7cd1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:52.831120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c22e8b12-1a75-4c2f-9814-9a1d1c6d7cd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945117e28ea948bc88953f05b0bd6410', 'request_id': 'req-c22e8b12-1a75-4c2f-9814-9a1d1c6d7cd1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:52.839681 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c22e8b12-1a75-4c2f-9814-9a1d1c6d7cd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945117e28ea948bc88953f05b0bd6410', 'request_id': 'req-c22e8b12-1a75-4c2f-9814-9a1d1c6d7cd1'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:52.851052 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c22e8b12-1a75-4c2f-9814-9a1d1c6d7cd1 admin admin] The token cache is being invalidate because project 945117e28ea948bc88953f05b0bd6410 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:41:52.851409 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c22e8b12-1a75-4c2f-9814-9a1d1c6d7cd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:52.852284 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c22e8b12-1a75-4c2f-9814-9a1d1c6d7cd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:41:52.854092 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1348/2705] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:41:52 2022] DELETE /identity/v3/projects/945117e28ea948bc88953f05b0bd6410 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:52.859263 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3ff7c-7b48-49e2-ae05-0e187b3eca74 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:52.859552 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3ff7c-7b48-49e2-ae05-0e187b3eca74 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:52.859831 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3ff7c-7b48-49e2-ae05-0e187b3eca74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:52.878532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a0b3ff7c-7b48-49e2-ae05-0e187b3eca74 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:52.879743 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a0b3ff7c-7b48-49e2-ae05-0e187b3eca74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:52.890297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:52.956593 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1358/2706] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:52.965550 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5200e-202a-45f8-95bd-3217ab19a65b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:52.965863 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5200e-202a-45f8-95bd-3217ab19a65b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:52.966140 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5200e-202a-45f8-95bd-3217ab19a65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:52.986127 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-bdd5200e-202a-45f8-95bd-3217ab19a65b None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:52.987404 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-bdd5200e-202a-45f8-95bd-3217ab19a65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:52.995850 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1349/2707] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:53.000233 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3ff7c-7b48-49e2-ae05-0e187b3eca74 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:53.010285 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3ff7c-7b48-49e2-ae05-0e187b3eca74 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:53.015115 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83802858-5a56-4519-b23c-60cb107ffcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:53.015780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83802858-5a56-4519-b23c-60cb107ffcee admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:53.016054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83802858-5a56-4519-b23c-60cb107ffcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:53.016362 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83802858-5a56-4519-b23c-60cb107ffcee admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:53.017090 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83802858-5a56-4519-b23c-60cb107ffcee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:41:53.017420 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83802858-5a56-4519-b23c-60cb107ffcee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:53.019037 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83802858-5a56-4519-b23c-60cb107ffcee admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:53.031208 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1359/2708] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:41:53.035647 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5200e-202a-45f8-95bd-3217ab19a65b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:53.045754 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5200e-202a-45f8-95bd-3217ab19a65b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:53.050865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a7743-030a-457a-bb67-df7934fbad5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:53.051515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a7743-030a-457a-bb67-df7934fbad5a admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:53.051795 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a7743-030a-457a-bb67-df7934fbad5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:53.052094 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a7743-030a-457a-bb67-df7934fbad5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:53.052926 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a7743-030a-457a-bb67-df7934fbad5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:53.054882 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a7743-030a-457a-bb67-df7934fbad5a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:53.086680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1350/2709] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:41:53 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:53.091399 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83802858-5a56-4519-b23c-60cb107ffcee admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:53.105419 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83802858-5a56-4519-b23c-60cb107ffcee admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:53.175840 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da307187-2b68-4f50-8196-a830ca427600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:53.176558 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da307187-2b68-4f50-8196-a830ca427600 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:53.176843 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da307187-2b68-4f50-8196-a830ca427600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:53.177133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da307187-2b68-4f50-8196-a830ca427600 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:53.177807 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da307187-2b68-4f50-8196-a830ca427600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:53.179762 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da307187-2b68-4f50-8196-a830ca427600 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:53.203726 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1360/2710] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:41:53 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:53.207997 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a7743-030a-457a-bb67-df7934fbad5a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:53.219290 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a7743-030a-457a-bb67-df7934fbad5a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:53.224622 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afd9bd-ac75-45ef-812c-7742f1e1400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:53.225285 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afd9bd-ac75-45ef-812c-7742f1e1400d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:53.225595 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afd9bd-ac75-45ef-812c-7742f1e1400d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:53.225867 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22afd9bd-ac75-45ef-812c-7742f1e1400d admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:53.226584 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afd9bd-ac75-45ef-812c-7742f1e1400d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:53.228255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22afd9bd-ac75-45ef-812c-7742f1e1400d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:53.240348 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1351/2711] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:41:53.245464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da307187-2b68-4f50-8196-a830ca427600 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:53.256571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da307187-2b68-4f50-8196-a830ca427600 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:53.261552 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e37e7-8907-407c-b3ed-b8075ff4acb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:53.262227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e37e7-8907-407c-b3ed-b8075ff4acb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:53.262507 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e37e7-8907-407c-b3ed-b8075ff4acb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:53.262780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e37e7-8907-407c-b3ed-b8075ff4acb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:53.263498 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e37e7-8907-407c-b3ed-b8075ff4acb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:53.265258 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e37e7-8907-407c-b3ed-b8075ff4acb1 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:53.277404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1361/2712] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:53.281954 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afd9bd-ac75-45ef-812c-7742f1e1400d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:53.295234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22afd9bd-ac75-45ef-812c-7742f1e1400d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:53.300076 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276448a-81fe-4ece-94aa-19fa5310c84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:53.301017 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276448a-81fe-4ece-94aa-19fa5310c84d admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:53.301298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276448a-81fe-4ece-94aa-19fa5310c84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:53.301566 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276448a-81fe-4ece-94aa-19fa5310c84d admin admin] PATH_INFO: `/v3/projects/5ed17659282e4c608920ab85541da200/users/470c15ec1a3b4b6e8d2142936db14259/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:53.317984 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276448a-81fe-4ece-94aa-19fa5310c84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed17659282e4c608920ab85541da200, user_id=470c15ec1a3b4b6e8d2142936db14259, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:53.321083 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276448a-81fe-4ece-94aa-19fa5310c84d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:53.337125 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1352/2713] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:53 2022] PUT /identity/v3/projects/5ed17659282e4c608920ab85541da200/users/470c15ec1a3b4b6e8d2142936db14259/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:41:53.347559 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044d93d-03d0-459f-929d-ed03cc875e3f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:53.348083 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044d93d-03d0-459f-929d-ed03cc875e3f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:53.348183 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044d93d-03d0-459f-929d-ed03cc875e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:53.377900 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6044d93d-03d0-459f-929d-ed03cc875e3f None None] MFA Rules not processed for user `470c15ec1a3b4b6e8d2142936db14259`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:53.379091 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6044d93d-03d0-459f-929d-ed03cc875e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:53.452985 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1362/2714] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:53.460395 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276448a-81fe-4ece-94aa-19fa5310c84d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:53.483765 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:53.531727 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276448a-81fe-4ece-94aa-19fa5310c84d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:53.536695 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec144ee-fd7e-4047-a5b2-41a16b6b425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:53.537362 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec144ee-fd7e-4047-a5b2-41a16b6b425a admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:53.537648 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec144ee-fd7e-4047-a5b2-41a16b6b425a admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:53.537915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec144ee-fd7e-4047-a5b2-41a16b6b425a admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:53.538611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec144ee-fd7e-4047-a5b2-41a16b6b425a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:53.542178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec144ee-fd7e-4047-a5b2-41a16b6b425a admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:53.573388 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1353/2715] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:41:53 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:53.577848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044d93d-03d0-459f-929d-ed03cc875e3f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:53.590657 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044d93d-03d0-459f-929d-ed03cc875e3f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:53.600491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:53.651914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed5463-5e4c-4e9d-b100-814e785a30fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:53.652611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed5463-5e4c-4e9d-b100-814e785a30fb admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:53.652906 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed5463-5e4c-4e9d-b100-814e785a30fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:53.653162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed5463-5e4c-4e9d-b100-814e785a30fb admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:53.653838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed5463-5e4c-4e9d-b100-814e785a30fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:53.655780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed5463-5e4c-4e9d-b100-814e785a30fb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:53.685036 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1363/2716] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:41:53 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:53.686208 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec144ee-fd7e-4047-a5b2-41a16b6b425a admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:53.697461 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec144ee-fd7e-4047-a5b2-41a16b6b425a admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:53.702234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9630cb7-67cb-4a1b-a71d-662008788297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:53.702970 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9630cb7-67cb-4a1b-a71d-662008788297 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:53.703299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9630cb7-67cb-4a1b-a71d-662008788297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:53.703522 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9630cb7-67cb-4a1b-a71d-662008788297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:53.704267 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9630cb7-67cb-4a1b-a71d-662008788297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:53.705910 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9630cb7-67cb-4a1b-a71d-662008788297 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:53.724398 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1354/2717] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:41:53.725271 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed5463-5e4c-4e9d-b100-814e785a30fb admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:53.738643 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed5463-5e4c-4e9d-b100-814e785a30fb admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:53.745908 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd6c7d-1efc-4526-9580-4e2f622816dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:53.746795 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd6c7d-1efc-4526-9580-4e2f622816dc admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:53.747133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd6c7d-1efc-4526-9580-4e2f622816dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:53.747493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd6c7d-1efc-4526-9580-4e2f622816dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:53.748500 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd6c7d-1efc-4526-9580-4e2f622816dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:53.750102 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd6c7d-1efc-4526-9580-4e2f622816dc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:53.761736 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1364/2718] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:41:53.765897 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9630cb7-67cb-4a1b-a71d-662008788297 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:53.781576 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9630cb7-67cb-4a1b-a71d-662008788297 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:53.787120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614fa97-dd24-4f23-ac7d-d170e6aec875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:53.788245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614fa97-dd24-4f23-ac7d-d170e6aec875 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:53.788582 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614fa97-dd24-4f23-ac7d-d170e6aec875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:53.788913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614fa97-dd24-4f23-ac7d-d170e6aec875 admin admin] PATH_INFO: `/v3/projects/c74035ce41714bb688351ab62a90c11f/users/11cc705e4c094e20abd2432bdcc86bdb/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:53.810649 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614fa97-dd24-4f23-ac7d-d170e6aec875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74035ce41714bb688351ab62a90c11f, user_id=11cc705e4c094e20abd2432bdcc86bdb, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:53.813386 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614fa97-dd24-4f23-ac7d-d170e6aec875 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:53.828826 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1355/2719] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:53 2022] PUT /identity/v3/projects/c74035ce41714bb688351ab62a90c11f/users/11cc705e4c094e20abd2432bdcc86bdb/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:53.840354 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a9586-fbd9-4211-a883-e6c0d78f3de0 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:53.840753 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a9586-fbd9-4211-a883-e6c0d78f3de0 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:53.841094 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a9586-fbd9-4211-a883-e6c0d78f3de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:53.870393 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-0b8a9586-fbd9-4211-a883-e6c0d78f3de0 None None] MFA Rules not processed for user `11cc705e4c094e20abd2432bdcc86bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:53.871721 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0b8a9586-fbd9-4211-a883-e6c0d78f3de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:53.950767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1365/2720] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:53.955538 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614fa97-dd24-4f23-ac7d-d170e6aec875 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:54.027436 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614fa97-dd24-4f23-ac7d-d170e6aec875 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:54.032490 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb699477-68f6-44b2-89c3-ae3633e69fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:54.033206 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb699477-68f6-44b2-89c3-ae3633e69fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:54.033482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb699477-68f6-44b2-89c3-ae3633e69fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:54.033762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb699477-68f6-44b2-89c3-ae3633e69fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:54.034479 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb699477-68f6-44b2-89c3-ae3633e69fc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:54.036518 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb699477-68f6-44b2-89c3-ae3633e69fc2 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:54.070808 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1356/2721] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:41:53 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:54.075525 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a9586-fbd9-4211-a883-e6c0d78f3de0 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:54.092442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a9586-fbd9-4211-a883-e6c0d78f3de0 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:54.165274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c49de-f569-412b-8465-4ced78ad4dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:54.166143 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c49de-f569-412b-8465-4ced78ad4dbf admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:54.166298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c49de-f569-412b-8465-4ced78ad4dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:54.166572 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c49de-f569-412b-8465-4ced78ad4dbf admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:54.167619 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c49de-f569-412b-8465-4ced78ad4dbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:54.170128 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c49de-f569-412b-8465-4ced78ad4dbf admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:54.200425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1366/2722] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:41:54 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:41:54.201703 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb699477-68f6-44b2-89c3-ae3633e69fc2 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:54.213612 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb699477-68f6-44b2-89c3-ae3633e69fc2 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:54.220645 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec4ef7-90b3-4d91-a4cc-e28fee8c7603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:54.221408 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec4ef7-90b3-4d91-a4cc-e28fee8c7603 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:54.222178 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec4ef7-90b3-4d91-a4cc-e28fee8c7603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:54.222535 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec4ef7-90b3-4d91-a4cc-e28fee8c7603 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:54.224166 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec4ef7-90b3-4d91-a4cc-e28fee8c7603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:54.226043 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eec4ef7-90b3-4d91-a4cc-e28fee8c7603 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:54.240043 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1357/2723] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:41:54.244289 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c49de-f569-412b-8465-4ced78ad4dbf admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:54.255557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c49de-f569-412b-8465-4ced78ad4dbf admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:54.260888 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bbef4-20a1-4a5f-8c3c-c36cd0092f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:54.261827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bbef4-20a1-4a5f-8c3c-c36cd0092f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:54.262104 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bbef4-20a1-4a5f-8c3c-c36cd0092f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:54.262373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bbef4-20a1-4a5f-8c3c-c36cd0092f08 admin admin] PATH_INFO: `/v3/projects/9d074c053a6b496184a68973a52b80c5/users/8b6fcd6a1ef74ace82878a92fe74d65c/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:54.266337 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:54.284794 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bbef4-20a1-4a5f-8c3c-c36cd0092f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d074c053a6b496184a68973a52b80c5, user_id=8b6fcd6a1ef74ace82878a92fe74d65c, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:54.285805 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bbef4-20a1-4a5f-8c3c-c36cd0092f08 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:54.302223 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1367/2724] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:54 2022] PUT /identity/v3/projects/9d074c053a6b496184a68973a52b80c5/users/8b6fcd6a1ef74ace82878a92fe74d65c/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:54.306346 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec4ef7-90b3-4d91-a4cc-e28fee8c7603 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:54.317867 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec4ef7-90b3-4d91-a4cc-e28fee8c7603 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:54.364986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:54.383345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a5302-cf78-4d66-8ff7-2c93758a84a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:54.384043 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a5302-cf78-4d66-8ff7-2c93758a84a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:54.384392 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a5302-cf78-4d66-8ff7-2c93758a84a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:54.384730 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a5302-cf78-4d66-8ff7-2c93758a84a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:54.385570 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a5302-cf78-4d66-8ff7-2c93758a84a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:54.387188 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a5302-cf78-4d66-8ff7-2c93758a84a7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:54.398332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1358/2725] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 16:41:54.402495 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bbef4-20a1-4a5f-8c3c-c36cd0092f08 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:54.413258 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bbef4-20a1-4a5f-8c3c-c36cd0092f08 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:54.418194 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf515e-0583-49a2-a897-29fba6f752cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:54.419144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf515e-0583-49a2-a897-29fba6f752cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:54.419425 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf515e-0583-49a2-a897-29fba6f752cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:54.419695 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf515e-0583-49a2-a897-29fba6f752cf admin admin] PATH_INFO: `/v3/projects/9d074c053a6b496184a68973a52b80c5/users/8b6fcd6a1ef74ace82878a92fe74d65c/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:54.421670 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf515e-0583-49a2-a897-29fba6f752cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d074c053a6b496184a68973a52b80c5, user_id=8b6fcd6a1ef74ace82878a92fe74d65c, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:54.424359 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf515e-0583-49a2-a897-29fba6f752cf admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:54.435635 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1368/2726] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:41:54 2022] PUT /identity/v3/projects/9d074c053a6b496184a68973a52b80c5/users/8b6fcd6a1ef74ace82878a92fe74d65c/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:41:54.446726 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bd159-c953-4b42-a582-d07e02a4ec74 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:54.447084 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bd159-c953-4b42-a582-d07e02a4ec74 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:54.447447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bd159-c953-4b42-a582-d07e02a4ec74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:54.478529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-086bd159-c953-4b42-a582-d07e02a4ec74 None None] MFA Rules not processed for user `8b6fcd6a1ef74ace82878a92fe74d65c`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:41:54.479378 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-086bd159-c953-4b42-a582-d07e02a4ec74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:54.557391 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1359/2727] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:41:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:41:54.570114 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf515e-0583-49a2-a897-29fba6f752cf admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:54.572470 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-56bf515e-0583-49a2-a897-29fba6f752cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:54.633240 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf515e-0583-49a2-a897-29fba6f752cf admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:54.637178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a1efa-f4db-4364-9dd2-201364e76d9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:54.637921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a1efa-f4db-4364-9dd2-201364e76d9e service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:54.638264 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a1efa-f4db-4364-9dd2-201364e76d9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:54.638606 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a1efa-f4db-4364-9dd2-201364e76d9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:54.706244 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a1efa-f4db-4364-9dd2-201364e76d9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:54.707882 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a1efa-f4db-4364-9dd2-201364e76d9e service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:54.719146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1369/2728] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:56.277246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bd159-c953-4b42-a582-d07e02a4ec74 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:56.278611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-086bd159-c953-4b42-a582-d07e02a4ec74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:56.297234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bd159-c953-4b42-a582-d07e02a4ec74 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:56.300786 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d3151-7c70-416b-a0e9-a3bfad7e81bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:56.301596 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d3151-7c70-416b-a0e9-a3bfad7e81bd service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:56.301986 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d3151-7c70-416b-a0e9-a3bfad7e81bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:56.302556 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d3151-7c70-416b-a0e9-a3bfad7e81bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:56.374734 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d3151-7c70-416b-a0e9-a3bfad7e81bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:56.376269 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d3151-7c70-416b-a0e9-a3bfad7e81bd service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:56.386582 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1360/2729] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:56.996567 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a1efa-f4db-4364-9dd2-201364e76d9e service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:57.006376 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a1efa-f4db-4364-9dd2-201364e76d9e service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:57.010932 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e453f-913f-4ba3-93bb-d300ec14bce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:57.011585 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e453f-913f-4ba3-93bb-d300ec14bce7 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:57.011868 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e453f-913f-4ba3-93bb-d300ec14bce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:57.012180 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e453f-913f-4ba3-93bb-d300ec14bce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:57.021694 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e453f-913f-4ba3-93bb-d300ec14bce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:57.023157 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e453f-913f-4ba3-93bb-d300ec14bce7 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:57.034965 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1370/2730] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:41:58.936880 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d3151-7c70-416b-a0e9-a3bfad7e81bd service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:41:58.938579 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-918d3151-7c70-416b-a0e9-a3bfad7e81bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:59.000353 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d3151-7c70-416b-a0e9-a3bfad7e81bd service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:41:59.003930 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6a14d-a756-45f4-8878-2dadc683d07c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:41:59.004610 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6a14d-a756-45f4-8878-2dadc683d07c service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:41:59.004917 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6a14d-a756-45f4-8878-2dadc683d07c service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:41:59.005189 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6a14d-a756-45f4-8878-2dadc683d07c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:41:59.006941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e4e6a14d-a756-45f4-8878-2dadc683d07c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:41:59.023293 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:41:59.074818 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6a14d-a756-45f4-8878-2dadc683d07c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:41:59.076480 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6a14d-a756-45f4-8878-2dadc683d07c service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:41:59.086953 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1361/2731] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:41:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:42:00.945583 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e453f-913f-4ba3-93bb-d300ec14bce7 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:01.009183 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e453f-913f-4ba3-93bb-d300ec14bce7 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:01.014113 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f84c1-c717-4f2c-84d4-f416eba1811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:01.015080 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f84c1-c717-4f2c-84d4-f416eba1811c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:01.015290 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f84c1-c717-4f2c-84d4-f416eba1811c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:01.016146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f84c1-c717-4f2c-84d4-f416eba1811c admin admin] PATH_INFO: `/v3/users/470c15ec1a3b4b6e8d2142936db14259` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:01.017504 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f84c1-c717-4f2c-84d4-f416eba1811c admin admin] RBAC: Authorizing `identity:delete_user(user_id=470c15ec1a3b4b6e8d2142936db14259)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:01.019536 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f84c1-c717-4f2c-84d4-f416eba1811c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:01.038641 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:01.081198 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ba4f84c1-c717-4f2c-84d4-f416eba1811c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '470c15ec1a3b4b6e8d2142936db14259'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:01.081867 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ba4f84c1-c717-4f2c-84d4-f416eba1811c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '470c15ec1a3b4b6e8d2142936db14259'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:01.082487 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ba4f84c1-c717-4f2c-84d4-f416eba1811c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '470c15ec1a3b4b6e8d2142936db14259'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:01.098887 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ba4f84c1-c717-4f2c-84d4-f416eba1811c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '470c15ec1a3b4b6e8d2142936db14259'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:01.108657 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-ba4f84c1-c717-4f2c-84d4-f416eba1811c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '470c15ec1a3b4b6e8d2142936db14259'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:01.128554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1371/2732] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:42:00 2022] DELETE /identity/v3/users/470c15ec1a3b4b6e8d2142936db14259 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:01.130455 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a4092-3f8c-440f-bef1-11ceaec45d3b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:01.130930 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a4092-3f8c-440f-bef1-11ceaec45d3b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:01.131068 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a4092-3f8c-440f-bef1-11ceaec45d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:01.151714 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-937a4092-3f8c-440f-bef1-11ceaec45d3b None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:01.153011 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-937a4092-3f8c-440f-bef1-11ceaec45d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:01.222713 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1362/2733] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:01.233826 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f84c1-c717-4f2c-84d4-f416eba1811c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:01.235448 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ba4f84c1-c717-4f2c-84d4-f416eba1811c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:01.310011 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f84c1-c717-4f2c-84d4-f416eba1811c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:01.313885 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae58a4-723b-4760-9596-5042702ee8fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:01.314615 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae58a4-723b-4760-9596-5042702ee8fd service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:01.314955 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae58a4-723b-4760-9596-5042702ee8fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:01.315312 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae58a4-723b-4760-9596-5042702ee8fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:01.328335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae58a4-723b-4760-9596-5042702ee8fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:01.329862 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae58a4-723b-4760-9596-5042702ee8fd service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:01.340140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1372/2734] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:42:01.796711 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a4092-3f8c-440f-bef1-11ceaec45d3b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:01.804415 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-937a4092-3f8c-440f-bef1-11ceaec45d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:01.831717 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a4092-3f8c-440f-bef1-11ceaec45d3b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:01.837131 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488de2aa-ed9b-45dc-86c1-e6dc5c97c08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:01.838023 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488de2aa-ed9b-45dc-86c1-e6dc5c97c08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:01.838305 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488de2aa-ed9b-45dc-86c1-e6dc5c97c08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:01.838583 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488de2aa-ed9b-45dc-86c1-e6dc5c97c08e admin admin] PATH_INFO: `/v3/projects/5ed17659282e4c608920ab85541da200` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:01.839793 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488de2aa-ed9b-45dc-86c1-e6dc5c97c08e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed17659282e4c608920ab85541da200)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:01.841856 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488de2aa-ed9b-45dc-86c1-e6dc5c97c08e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:01.904256 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-488de2aa-ed9b-45dc-86c1-e6dc5c97c08e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed17659282e4c608920ab85541da200', 'request_id': 'req-488de2aa-ed9b-45dc-86c1-e6dc5c97c08e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:01.914322 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-488de2aa-ed9b-45dc-86c1-e6dc5c97c08e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed17659282e4c608920ab85541da200', 'request_id': 'req-488de2aa-ed9b-45dc-86c1-e6dc5c97c08e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:01.925524 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-488de2aa-ed9b-45dc-86c1-e6dc5c97c08e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed17659282e4c608920ab85541da200', 'request_id': 'req-488de2aa-ed9b-45dc-86c1-e6dc5c97c08e'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:01.939926 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-488de2aa-ed9b-45dc-86c1-e6dc5c97c08e admin admin] The token cache is being invalidate because project 5ed17659282e4c608920ab85541da200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:42:01.940336 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-488de2aa-ed9b-45dc-86c1-e6dc5c97c08e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:01.940968 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-488de2aa-ed9b-45dc-86c1-e6dc5c97c08e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:01.943174 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1363/2735] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:42:01 2022] DELETE /identity/v3/projects/5ed17659282e4c608920ab85541da200 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:01.947880 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae58a4-723b-4760-9596-5042702ee8fd service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:01.958169 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae58a4-723b-4760-9596-5042702ee8fd service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:02.028955 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb8292-aa45-471d-be8c-e9faa1eb707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:02.029962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb8292-aa45-471d-be8c-e9faa1eb707d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:02.030246 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb8292-aa45-471d-be8c-e9faa1eb707d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:02.030524 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb8292-aa45-471d-be8c-e9faa1eb707d admin admin] PATH_INFO: `/v3/users/11cc705e4c094e20abd2432bdcc86bdb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:02.031736 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb8292-aa45-471d-be8c-e9faa1eb707d admin admin] RBAC: Authorizing `identity:delete_user(user_id=11cc705e4c094e20abd2432bdcc86bdb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:02.033724 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb8292-aa45-471d-be8c-e9faa1eb707d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:02.077951 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:02.089984 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eecb8292-aa45-471d-be8c-e9faa1eb707d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11cc705e4c094e20abd2432bdcc86bdb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:02.091043 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eecb8292-aa45-471d-be8c-e9faa1eb707d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11cc705e4c094e20abd2432bdcc86bdb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:02.092358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eecb8292-aa45-471d-be8c-e9faa1eb707d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11cc705e4c094e20abd2432bdcc86bdb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:02.105336 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eecb8292-aa45-471d-be8c-e9faa1eb707d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11cc705e4c094e20abd2432bdcc86bdb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:02.112802 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-eecb8292-aa45-471d-be8c-e9faa1eb707d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11cc705e4c094e20abd2432bdcc86bdb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:02.131522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1373/2736] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:42:01 2022] DELETE /identity/v3/users/11cc705e4c094e20abd2432bdcc86bdb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:02.416248 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488de2aa-ed9b-45dc-86c1-e6dc5c97c08e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:02.417810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-488de2aa-ed9b-45dc-86c1-e6dc5c97c08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:02.433740 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488de2aa-ed9b-45dc-86c1-e6dc5c97c08e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:02.471604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:02.498638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96a3de-f42b-4abd-8597-a19ed60d2637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:02.499400 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96a3de-f42b-4abd-8597-a19ed60d2637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:02.499674 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96a3de-f42b-4abd-8597-a19ed60d2637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:02.499941 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96a3de-f42b-4abd-8597-a19ed60d2637 admin admin] PATH_INFO: `/v3/projects/c74035ce41714bb688351ab62a90c11f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:02.501158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96a3de-f42b-4abd-8597-a19ed60d2637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c74035ce41714bb688351ab62a90c11f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:02.503120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96a3de-f42b-4abd-8597-a19ed60d2637 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:02.561712 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-af96a3de-f42b-4abd-8597-a19ed60d2637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c74035ce41714bb688351ab62a90c11f', 'request_id': 'req-af96a3de-f42b-4abd-8597-a19ed60d2637'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:02.568416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-af96a3de-f42b-4abd-8597-a19ed60d2637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c74035ce41714bb688351ab62a90c11f', 'request_id': 'req-af96a3de-f42b-4abd-8597-a19ed60d2637'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:02.580142 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-af96a3de-f42b-4abd-8597-a19ed60d2637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c74035ce41714bb688351ab62a90c11f', 'request_id': 'req-af96a3de-f42b-4abd-8597-a19ed60d2637'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:02.591917 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-af96a3de-f42b-4abd-8597-a19ed60d2637 admin admin] The token cache is being invalidate because project c74035ce41714bb688351ab62a90c11f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:42:02.592244 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-af96a3de-f42b-4abd-8597-a19ed60d2637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:02.592966 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-af96a3de-f42b-4abd-8597-a19ed60d2637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:02.594668 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1364/2737] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:42:02 2022] DELETE /identity/v3/projects/c74035ce41714bb688351ab62a90c11f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:02.598819 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb8292-aa45-471d-be8c-e9faa1eb707d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:02.600418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-eecb8292-aa45-471d-be8c-e9faa1eb707d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:02.614132 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb8292-aa45-471d-be8c-e9faa1eb707d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:02.671643 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60dc8d-4e13-43c2-94fd-bbee66fc17e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:02.672577 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60dc8d-4e13-43c2-94fd-bbee66fc17e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:02.672888 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60dc8d-4e13-43c2-94fd-bbee66fc17e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:02.673143 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60dc8d-4e13-43c2-94fd-bbee66fc17e7 admin admin] PATH_INFO: `/v3/users/8b6fcd6a1ef74ace82878a92fe74d65c` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:02.674443 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60dc8d-4e13-43c2-94fd-bbee66fc17e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b6fcd6a1ef74ace82878a92fe74d65c)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:02.676454 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60dc8d-4e13-43c2-94fd-bbee66fc17e7 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:02.736449 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7b60dc8d-4e13-43c2-94fd-bbee66fc17e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b6fcd6a1ef74ace82878a92fe74d65c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:02.737120 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7b60dc8d-4e13-43c2-94fd-bbee66fc17e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b6fcd6a1ef74ace82878a92fe74d65c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:02.737746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7b60dc8d-4e13-43c2-94fd-bbee66fc17e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b6fcd6a1ef74ace82878a92fe74d65c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:02.749784 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7b60dc8d-4e13-43c2-94fd-bbee66fc17e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b6fcd6a1ef74ace82878a92fe74d65c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:02.756618 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-7b60dc8d-4e13-43c2-94fd-bbee66fc17e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b6fcd6a1ef74ace82878a92fe74d65c'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:02.772379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1374/2738] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:42:02 2022] DELETE /identity/v3/users/8b6fcd6a1ef74ace82878a92fe74d65c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:03.063322 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96a3de-f42b-4abd-8597-a19ed60d2637 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:03.064983 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-af96a3de-f42b-4abd-8597-a19ed60d2637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:03.085745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96a3de-f42b-4abd-8597-a19ed60d2637 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:03.153412 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08a17f-b41f-49c0-ab20-04d387553a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:03.154521 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08a17f-b41f-49c0-ab20-04d387553a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:03.154810 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08a17f-b41f-49c0-ab20-04d387553a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:03.155087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08a17f-b41f-49c0-ab20-04d387553a82 admin admin] PATH_INFO: `/v3/projects/9d074c053a6b496184a68973a52b80c5` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:03.156419 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf08a17f-b41f-49c0-ab20-04d387553a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d074c053a6b496184a68973a52b80c5)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:03.158375 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf08a17f-b41f-49c0-ab20-04d387553a82 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:03.208180 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bf08a17f-b41f-49c0-ab20-04d387553a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d074c053a6b496184a68973a52b80c5', 'request_id': 'req-bf08a17f-b41f-49c0-ab20-04d387553a82'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:03.213883 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bf08a17f-b41f-49c0-ab20-04d387553a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d074c053a6b496184a68973a52b80c5', 'request_id': 'req-bf08a17f-b41f-49c0-ab20-04d387553a82'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:03.223725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bf08a17f-b41f-49c0-ab20-04d387553a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d074c053a6b496184a68973a52b80c5', 'request_id': 'req-bf08a17f-b41f-49c0-ab20-04d387553a82'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:03.225834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:03.236512 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bf08a17f-b41f-49c0-ab20-04d387553a82 admin admin] The token cache is being invalidate because project 9d074c053a6b496184a68973a52b80c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:42:03.236830 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bf08a17f-b41f-49c0-ab20-04d387553a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:03.240446 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-bf08a17f-b41f-49c0-ab20-04d387553a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:03.242032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1365/2739] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:42:03 2022] DELETE /identity/v3/projects/9d074c053a6b496184a68973a52b80c5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:03.247046 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db6580-f912-4fe9-b510-a7e6d784ece3 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:03.247601 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db6580-f912-4fe9-b510-a7e6d784ece3 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:03.247702 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db6580-f912-4fe9-b510-a7e6d784ece3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:03.266597 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c4db6580-f912-4fe9-b510-a7e6d784ece3 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:03.267812 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c4db6580-f912-4fe9-b510-a7e6d784ece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:03.301307 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:03.334681 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1375/2740] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:42:03.342780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d540cf1-f4b6-4022-9c2e-fb61cc273643 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:03.343064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d540cf1-f4b6-4022-9c2e-fb61cc273643 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:03.343345 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d540cf1-f4b6-4022-9c2e-fb61cc273643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:03.362552 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8d540cf1-f4b6-4022-9c2e-fb61cc273643 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:03.363767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8d540cf1-f4b6-4022-9c2e-fb61cc273643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:03.373310 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1366/2741] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:03.378596 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db6580-f912-4fe9-b510-a7e6d784ece3 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:03.389160 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db6580-f912-4fe9-b510-a7e6d784ece3 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:03.394114 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17193c2-dc09-4bc2-ba66-fa02aa92a240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:03.394790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17193c2-dc09-4bc2-ba66-fa02aa92a240 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:03.395074 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17193c2-dc09-4bc2-ba66-fa02aa92a240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:03.395357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17193c2-dc09-4bc2-ba66-fa02aa92a240 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:03.396110 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17193c2-dc09-4bc2-ba66-fa02aa92a240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:42:03.396415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17193c2-dc09-4bc2-ba66-fa02aa92a240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:03.398046 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17193c2-dc09-4bc2-ba66-fa02aa92a240 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:03.411321 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1376/2742] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:42:03.415915 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d540cf1-f4b6-4022-9c2e-fb61cc273643 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:03.425650 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d540cf1-f4b6-4022-9c2e-fb61cc273643 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:03.430814 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4d8b1-a5d4-4bcf-ace2-2a35453d6c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:03.431467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4d8b1-a5d4-4bcf-ace2-2a35453d6c78 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:03.431751 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4d8b1-a5d4-4bcf-ace2-2a35453d6c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:03.432106 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4d8b1-a5d4-4bcf-ace2-2a35453d6c78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:03.432817 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4d8b1-a5d4-4bcf-ace2-2a35453d6c78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:03.434821 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4d8b1-a5d4-4bcf-ace2-2a35453d6c78 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:03.465151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1367/2743] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:42:03 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:42:03.470327 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17193c2-dc09-4bc2-ba66-fa02aa92a240 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:03.481194 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17193c2-dc09-4bc2-ba66-fa02aa92a240 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:03.555898 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768e885-a9db-4bab-89d0-fbd07f4a7f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:03.556599 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768e885-a9db-4bab-89d0-fbd07f4a7f8b admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:03.556878 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768e885-a9db-4bab-89d0-fbd07f4a7f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:03.557155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768e885-a9db-4bab-89d0-fbd07f4a7f8b admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:03.557882 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768e885-a9db-4bab-89d0-fbd07f4a7f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:03.559820 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768e885-a9db-4bab-89d0-fbd07f4a7f8b admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:03.583356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1377/2744] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:42:03 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:42:03.589149 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4d8b1-a5d4-4bcf-ace2-2a35453d6c78 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:03.600322 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4d8b1-a5d4-4bcf-ace2-2a35453d6c78 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:03.605799 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3820c-8851-4018-8e67-94a7bc98c1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:03.606480 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3820c-8851-4018-8e67-94a7bc98c1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:03.606759 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3820c-8851-4018-8e67-94a7bc98c1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:03.607043 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3820c-8851-4018-8e67-94a7bc98c1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:03.607780 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3820c-8851-4018-8e67-94a7bc98c1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:03.609442 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3820c-8851-4018-8e67-94a7bc98c1b6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:03.620183 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1368/2745] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:42:03.625529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768e885-a9db-4bab-89d0-fbd07f4a7f8b admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:03.637806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768e885-a9db-4bab-89d0-fbd07f4a7f8b admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:03.645829 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df49b0e-10f4-49f9-8394-2362e7d9fe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:03.646791 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df49b0e-10f4-49f9-8394-2362e7d9fe6c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:03.647151 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df49b0e-10f4-49f9-8394-2362e7d9fe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:03.647494 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df49b0e-10f4-49f9-8394-2362e7d9fe6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:03.648513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df49b0e-10f4-49f9-8394-2362e7d9fe6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:03.650974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df49b0e-10f4-49f9-8394-2362e7d9fe6c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:03.663465 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1378/2746] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:42:03.668115 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3820c-8851-4018-8e67-94a7bc98c1b6 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:03.682266 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3820c-8851-4018-8e67-94a7bc98c1b6 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:03.688903 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735ed2e-4f6e-47c4-b833-b22514d24e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:03.689831 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735ed2e-4f6e-47c4-b833-b22514d24e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:03.690112 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735ed2e-4f6e-47c4-b833-b22514d24e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:03.690385 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735ed2e-4f6e-47c4-b833-b22514d24e8d admin admin] PATH_INFO: `/v3/projects/1eddf6f4ddae40508e191766ddd5afcb/users/8975cd79c1d2471ba715469979338d90/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:03.712415 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735ed2e-4f6e-47c4-b833-b22514d24e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eddf6f4ddae40508e191766ddd5afcb, user_id=8975cd79c1d2471ba715469979338d90, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:03.717032 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735ed2e-4f6e-47c4-b833-b22514d24e8d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:03.735276 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1369/2747] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:42:03 2022] PUT /identity/v3/projects/1eddf6f4ddae40508e191766ddd5afcb/users/8975cd79c1d2471ba715469979338d90/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:03.742289 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fe49-6f41-4ef2-bdec-64158298d782 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:03.742580 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fe49-6f41-4ef2-bdec-64158298d782 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:03.743092 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77fe49-6f41-4ef2-bdec-64158298d782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:03.762889 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-ae77fe49-6f41-4ef2-bdec-64158298d782 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:03.764215 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-ae77fe49-6f41-4ef2-bdec-64158298d782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:03.827621 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1379/2748] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:03.841513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735ed2e-4f6e-47c4-b833-b22514d24e8d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:03.843760 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-c735ed2e-4f6e-47c4-b833-b22514d24e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:03.905397 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735ed2e-4f6e-47c4-b833-b22514d24e8d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:03.909470 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3716f-1fcd-46e7-be1f-937fedae9556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:03.910191 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3716f-1fcd-46e7-be1f-937fedae9556 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:03.910478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3716f-1fcd-46e7-be1f-937fedae9556 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:03.910756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3716f-1fcd-46e7-be1f-937fedae9556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:03.920951 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3716f-1fcd-46e7-be1f-937fedae9556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:03.922403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3716f-1fcd-46e7-be1f-937fedae9556 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:03.931805 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1370/2749] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:42:04.625091 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dea480-e216-4e0e-9d22-dc18716ad35f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:04.626020 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dea480-e216-4e0e-9d22-dc18716ad35f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:04.626461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dea480-e216-4e0e-9d22-dc18716ad35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:04.657115 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-b4dea480-e216-4e0e-9d22-dc18716ad35f None None] MFA Rules not processed for user `8975cd79c1d2471ba715469979338d90`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:04.658406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b4dea480-e216-4e0e-9d22-dc18716ad35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:04.691067 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:04.731348 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1380/2750] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:42:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:04.742221 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3716f-1fcd-46e7-be1f-937fedae9556 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:04.743692 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-91d3716f-1fcd-46e7-be1f-937fedae9556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:04.803978 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3716f-1fcd-46e7-be1f-937fedae9556 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:04.807677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a630e-e410-4413-b873-84db5f4f12ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:04.808369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a630e-e410-4413-b873-84db5f4f12ab service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:04.808655 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a630e-e410-4413-b873-84db5f4f12ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:04.808930 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a630e-e410-4413-b873-84db5f4f12ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:04.818499 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a630e-e410-4413-b873-84db5f4f12ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:04.820367 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a630e-e410-4413-b873-84db5f4f12ab service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:04.829824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1371/2751] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:42:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:42:06.204838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309ddfb-9070-48a7-9e6b-a7c9ac226c21 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:06.205382 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309ddfb-9070-48a7-9e6b-a7c9ac226c21 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:06.205382 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309ddfb-9070-48a7-9e6b-a7c9ac226c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:06.224617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1309ddfb-9070-48a7-9e6b-a7c9ac226c21 None None] MFA Rules not processed for user `8975cd79c1d2471ba715469979338d90`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:06.225838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1309ddfb-9070-48a7-9e6b-a7c9ac226c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:06.236766 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1381/2752] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:42:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:14.825563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=81,keystone:INSERT=2 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:16.218989 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=17 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:21.733725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6c657-0237-4236-a60a-229d06311173 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:21.734364 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6c657-0237-4236-a60a-229d06311173 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:21.734364 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6c657-0237-4236-a60a-229d06311173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:21.753606 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-cbf6c657-0237-4236-a60a-229d06311173 None None] MFA Rules not processed for user `8975cd79c1d2471ba715469979338d90`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:21.754813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cbf6c657-0237-4236-a60a-229d06311173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:21.762580 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1372/2753] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:42:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:31.747762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:35.724759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309ddfb-9070-48a7-9e6b-a7c9ac226c21 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:35.726684 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1309ddfb-9070-48a7-9e6b-a7c9ac226c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:35.810110 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309ddfb-9070-48a7-9e6b-a7c9ac226c21 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:35.815530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b32635-898a-4097-af3d-025b33ce1635 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1266a87d93da4f8d9a1ccafa03067169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:35.816259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b32635-898a-4097-af3d-025b33ce1635 service placement] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:35.816492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b32635-898a-4097-af3d-025b33ce1635 service placement] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:35.816764 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b32635-898a-4097-af3d-025b33ce1635 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:35.818901 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e3b32635-898a-4097-af3d-025b33ce1635 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:35.832552 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b32635-898a-4097-af3d-025b33ce1635 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:35.834221 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b32635-898a-4097-af3d-025b33ce1635 service placement] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:35.845043 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1382/2754] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:42:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:42:37.905913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9685c8d-3951-4d91-9ce6-b8875f52c04b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:37.906386 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9685c8d-3951-4d91-9ce6-b8875f52c04b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:37.906545 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9685c8d-3951-4d91-9ce6-b8875f52c04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:37.927862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d9685c8d-3951-4d91-9ce6-b8875f52c04b None None] MFA Rules not processed for user `2ccee0bc7e2b41f4a2fe2a891a95b318`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:37.929151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d9685c8d-3951-4d91-9ce6-b8875f52c04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:37.990739 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1373/2755] 10.222.0.41 () {58 vars in 1009 bytes} [Fri May 27 16:42:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:38.043224 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b32635-898a-4097-af3d-025b33ce1635 service placement] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:38.045069 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e3b32635-898a-4097-af3d-025b33ce1635 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:38.134160 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b32635-898a-4097-af3d-025b33ce1635 service placement] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:38.140036 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361f484-6e1e-4460-9b8a-3ae47dd01eed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbfcca96ad754692b3fb7f891013dafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:38.140711 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361f484-6e1e-4460-9b8a-3ae47dd01eed service swift] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:38.140996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361f484-6e1e-4460-9b8a-3ae47dd01eed service swift] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:38.141410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361f484-6e1e-4460-9b8a-3ae47dd01eed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:38.150939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361f484-6e1e-4460-9b8a-3ae47dd01eed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:38.152828 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361f484-6e1e-4460-9b8a-3ae47dd01eed service swift] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:38.161754 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1383/2756] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 16:42:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:42:44.465114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364190f-370b-42d3-8133-805b8452a338 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:44.465902 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364190f-370b-42d3-8133-805b8452a338 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:44.465902 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364190f-370b-42d3-8133-805b8452a338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:44.486441 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-1364190f-370b-42d3-8133-805b8452a338 None None] MFA Rules not processed for user `b6264de254d24c43932f28527bea4acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:44.487677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-1364190f-370b-42d3-8133-805b8452a338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:44.561529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1374/2757] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:42:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:42:48.158158 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=64 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:54.552465 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=50 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:54.848339 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8182f18-8577-47d4-862c-d38f5db9a6ab None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:54.848872 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8182f18-8577-47d4-862c-d38f5db9a6ab None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:54.849003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8182f18-8577-47d4-862c-d38f5db9a6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:54.868695 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-d8182f18-8577-47d4-862c-d38f5db9a6ab None None] MFA Rules not processed for user `2ccee0bc7e2b41f4a2fe2a891a95b318`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:54.870702 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-d8182f18-8577-47d4-862c-d38f5db9a6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:54.878874 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1384/2758] 10.222.0.41 () {58 vars in 967 bytes} [Fri May 27 16:42:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:54.892308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364190f-370b-42d3-8133-805b8452a338 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:54.905555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364190f-370b-42d3-8133-805b8452a338 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:54.911511 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a6130-916e-4375-927c-d9fef7739d42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbfcca96ad754692b3fb7f891013dafb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:54.912211 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a6130-916e-4375-927c-d9fef7739d42 service swift] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:54.912865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a6130-916e-4375-927c-d9fef7739d42 service swift] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:54.912865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a6130-916e-4375-927c-d9fef7739d42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:54.923438 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a6130-916e-4375-927c-d9fef7739d42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:54.925150 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a6130-916e-4375-927c-d9fef7739d42 service swift] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:54.935018 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1375/2759] 10.222.0.41 () {60 vars in 1384 bytes} [Fri May 27 16:42:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 16:42:56.996851 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8182f18-8577-47d4-862c-d38f5db9a6ab None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:57.011022 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8182f18-8577-47d4-862c-d38f5db9a6ab None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:57.016441 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61753b8-ba10-4288-b8e1-34994a37dfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:57.017360 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61753b8-ba10-4288-b8e1-34994a37dfce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:57.017641 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61753b8-ba10-4288-b8e1-34994a37dfce admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:57.018058 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61753b8-ba10-4288-b8e1-34994a37dfce admin admin] PATH_INFO: `/v3/users/8975cd79c1d2471ba715469979338d90` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:57.019328 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61753b8-ba10-4288-b8e1-34994a37dfce admin admin] RBAC: Authorizing `identity:delete_user(user_id=8975cd79c1d2471ba715469979338d90)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:57.021352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61753b8-ba10-4288-b8e1-34994a37dfce admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:57.102331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c61753b8-ba10-4288-b8e1-34994a37dfce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8975cd79c1d2471ba715469979338d90'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:57.104107 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c61753b8-ba10-4288-b8e1-34994a37dfce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8975cd79c1d2471ba715469979338d90'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:57.104860 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c61753b8-ba10-4288-b8e1-34994a37dfce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8975cd79c1d2471ba715469979338d90'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:57.122238 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c61753b8-ba10-4288-b8e1-34994a37dfce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8975cd79c1d2471ba715469979338d90'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:57.130853 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-c61753b8-ba10-4288-b8e1-34994a37dfce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8975cd79c1d2471ba715469979338d90'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:57.149529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1385/2760] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:42:56 2022] DELETE /identity/v3/users/8975cd79c1d2471ba715469979338d90 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:57.362257 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a6130-916e-4375-927c-d9fef7739d42 service swift] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:57.374505 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a6130-916e-4375-927c-d9fef7739d42 service swift] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:57.448360 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6487e8-714d-41db-af5f-c38afbe5c67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:57.449274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6487e8-714d-41db-af5f-c38afbe5c67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:57.449567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6487e8-714d-41db-af5f-c38afbe5c67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:57.449850 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6487e8-714d-41db-af5f-c38afbe5c67c admin admin] PATH_INFO: `/v3/projects/1eddf6f4ddae40508e191766ddd5afcb` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:57.451266 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6487e8-714d-41db-af5f-c38afbe5c67c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eddf6f4ddae40508e191766ddd5afcb)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:57.453300 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6487e8-714d-41db-af5f-c38afbe5c67c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:57.511436 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6c6487e8-714d-41db-af5f-c38afbe5c67c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eddf6f4ddae40508e191766ddd5afcb', 'request_id': 'req-6c6487e8-714d-41db-af5f-c38afbe5c67c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:57.521865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6c6487e8-714d-41db-af5f-c38afbe5c67c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eddf6f4ddae40508e191766ddd5afcb', 'request_id': 'req-6c6487e8-714d-41db-af5f-c38afbe5c67c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:57.533976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6c6487e8-714d-41db-af5f-c38afbe5c67c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eddf6f4ddae40508e191766ddd5afcb', 'request_id': 'req-6c6487e8-714d-41db-af5f-c38afbe5c67c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:57.560003 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6c6487e8-714d-41db-af5f-c38afbe5c67c admin admin] The token cache is being invalidate because project 1eddf6f4ddae40508e191766ddd5afcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:42:57.560358 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6c6487e8-714d-41db-af5f-c38afbe5c67c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:57.561215 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-6c6487e8-714d-41db-af5f-c38afbe5c67c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:42:57.563393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1376/2761] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:42:57 2022] DELETE /identity/v3/projects/1eddf6f4ddae40508e191766ddd5afcb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:57.568826 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e28881-e93a-423a-88c0-7c1b0cd21d12 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:57.569494 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e28881-e93a-423a-88c0-7c1b0cd21d12 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:57.569782 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e28881-e93a-423a-88c0-7c1b0cd21d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:57.592047 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-f5e28881-e93a-423a-88c0-7c1b0cd21d12 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:57.593351 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-f5e28881-e93a-423a-88c0-7c1b0cd21d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:57.692340 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1386/2762] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:57.694170 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50944757-e2f8-4b33-be08-e71fb787c8bb None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:57.694491 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50944757-e2f8-4b33-be08-e71fb787c8bb None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:57.694771 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50944757-e2f8-4b33-be08-e71fb787c8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:57.719630 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-50944757-e2f8-4b33-be08-e71fb787c8bb None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:57.721108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-50944757-e2f8-4b33-be08-e71fb787c8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:57.734701 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1377/2763] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:57.739244 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e28881-e93a-423a-88c0-7c1b0cd21d12 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:57.749624 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e28881-e93a-423a-88c0-7c1b0cd21d12 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:57.755578 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f781a-aec5-4639-ab77-ce4848e98413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:57.756323 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f781a-aec5-4639-ab77-ce4848e98413 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:57.756822 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f781a-aec5-4639-ab77-ce4848e98413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:57.757739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f781a-aec5-4639-ab77-ce4848e98413 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:57.757904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f781a-aec5-4639-ab77-ce4848e98413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:42:57.758162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f781a-aec5-4639-ab77-ce4848e98413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:57.759898 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f781a-aec5-4639-ab77-ce4848e98413 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:57.779531 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1387/2764] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:42:57.782168 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50944757-e2f8-4b33-be08-e71fb787c8bb None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:57.792883 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50944757-e2f8-4b33-be08-e71fb787c8bb None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:57.798286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e974eba-9746-478e-96a9-4ac6b15fc59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:57.798996 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e974eba-9746-478e-96a9-4ac6b15fc59d admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:57.799286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e974eba-9746-478e-96a9-4ac6b15fc59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:57.800389 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e974eba-9746-478e-96a9-4ac6b15fc59d admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:57.801338 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e974eba-9746-478e-96a9-4ac6b15fc59d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:57.803478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e974eba-9746-478e-96a9-4ac6b15fc59d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:57.838412 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1378/2765] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:42:57 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:42:57.843449 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f781a-aec5-4639-ab77-ce4848e98413 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:57.854363 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f781a-aec5-4639-ab77-ce4848e98413 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:57.920389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:57.939046 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026b16f-4d4d-4c91-b8c5-b3867ddb0c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:57.940301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026b16f-4d4d-4c91-b8c5-b3867ddb0c7e admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:57.940749 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026b16f-4d4d-4c91-b8c5-b3867ddb0c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:57.941254 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026b16f-4d4d-4c91-b8c5-b3867ddb0c7e admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:57.942619 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5026b16f-4d4d-4c91-b8c5-b3867ddb0c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:57.947642 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5026b16f-4d4d-4c91-b8c5-b3867ddb0c7e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:57.977715 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1388/2766] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:42:57 2022] POST /identity/v3/users => generated 285 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:42:57.985012 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e974eba-9746-478e-96a9-4ac6b15fc59d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:58.003231 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e974eba-9746-478e-96a9-4ac6b15fc59d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:58.011084 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4797b-ff3c-4530-bac5-45ee9abaae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:58.012094 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4797b-ff3c-4530-bac5-45ee9abaae00 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:58.012391 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4797b-ff3c-4530-bac5-45ee9abaae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:58.012869 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4797b-ff3c-4530-bac5-45ee9abaae00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:58.014313 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4797b-ff3c-4530-bac5-45ee9abaae00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:58.016336 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4797b-ff3c-4530-bac5-45ee9abaae00 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:58.032155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1379/2767] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:42:58.036837 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026b16f-4d4d-4c91-b8c5-b3867ddb0c7e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:58.053305 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026b16f-4d4d-4c91-b8c5-b3867ddb0c7e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:58.060466 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25920cc-ae0f-4b20-99b4-4c3b17943d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:58.061334 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25920cc-ae0f-4b20-99b4-4c3b17943d82 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:58.061698 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25920cc-ae0f-4b20-99b4-4c3b17943d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:58.062072 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25920cc-ae0f-4b20-99b4-4c3b17943d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:58.062931 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25920cc-ae0f-4b20-99b4-4c3b17943d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:58.065518 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25920cc-ae0f-4b20-99b4-4c3b17943d82 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:58.082806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1389/2768] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:42:58.088046 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4797b-ff3c-4530-bac5-45ee9abaae00 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:58.113186 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4797b-ff3c-4530-bac5-45ee9abaae00 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:58.124034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cdb8c-bb9a-45af-8d51-37ccb5f2a45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:58.124034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cdb8c-bb9a-45af-8d51-37ccb5f2a45f admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:58.124034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cdb8c-bb9a-45af-8d51-37ccb5f2a45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:58.124034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cdb8c-bb9a-45af-8d51-37ccb5f2a45f admin admin] PATH_INFO: `/v3/projects/c4052f8b62254d8c9a0b2d00fae7e908/users/0537aba2433e4d2891e851c9bcb3bd91/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:58.144060 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cdb8c-bb9a-45af-8d51-37ccb5f2a45f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4052f8b62254d8c9a0b2d00fae7e908, user_id=0537aba2433e4d2891e851c9bcb3bd91, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:58.146447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cdb8c-bb9a-45af-8d51-37ccb5f2a45f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:58.165467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1380/2769] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:42:58 2022] PUT /identity/v3/projects/c4052f8b62254d8c9a0b2d00fae7e908/users/0537aba2433e4d2891e851c9bcb3bd91/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:42:58.185140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f9101-de6b-4dee-882e-5c992718f809 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:58.185646 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f9101-de6b-4dee-882e-5c992718f809 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:58.186139 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f9101-de6b-4dee-882e-5c992718f809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:58.236210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a73f9101-de6b-4dee-882e-5c992718f809 None None] MFA Rules not processed for user `0537aba2433e4d2891e851c9bcb3bd91`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:42:58.238194 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a73f9101-de6b-4dee-882e-5c992718f809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:58.336406 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1390/2770] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:42:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:42:58.352478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cdb8c-bb9a-45af-8d51-37ccb5f2a45f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:42:58.354041 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a68cdb8c-bb9a-45af-8d51-37ccb5f2a45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:42:58.377286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:42:58.444037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cdb8c-bb9a-45af-8d51-37ccb5f2a45f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:42:58.449139 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f82dc-ef37-4aac-a8cb-0fcb1d59e334 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b72987d279bf4767bad23918fc33302b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:42:58.449844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f82dc-ef37-4aac-a8cb-0fcb1d59e334 service glance] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:42:58.450122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f82dc-ef37-4aac-a8cb-0fcb1d59e334 service glance] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:42:58.450396 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f82dc-ef37-4aac-a8cb-0fcb1d59e334 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:42:58.461039 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f82dc-ef37-4aac-a8cb-0fcb1d59e334 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:42:58.462547 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f82dc-ef37-4aac-a8cb-0fcb1d59e334 service glance] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:42:58.474388 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1381/2771] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:42:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:43:08.330121 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:08.469000 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=20 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:19.525840 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f9101-de6b-4dee-882e-5c992718f809 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:19.594070 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f9101-de6b-4dee-882e-5c992718f809 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:19.599216 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe7bc1-0b92-437f-802e-e9e86c1a4582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:19.600139 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe7bc1-0b92-437f-802e-e9e86c1a4582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:19.600423 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe7bc1-0b92-437f-802e-e9e86c1a4582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:19.600699 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe7bc1-0b92-437f-802e-e9e86c1a4582 admin admin] PATH_INFO: `/v3/users/0537aba2433e4d2891e851c9bcb3bd91` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:19.601977 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe7bc1-0b92-437f-802e-e9e86c1a4582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0537aba2433e4d2891e851c9bcb3bd91)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:19.603940 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe7bc1-0b92-437f-802e-e9e86c1a4582 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:19.656249 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0ebe7bc1-0b92-437f-802e-e9e86c1a4582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0537aba2433e4d2891e851c9bcb3bd91'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:19.656925 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0ebe7bc1-0b92-437f-802e-e9e86c1a4582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0537aba2433e4d2891e851c9bcb3bd91'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:19.658839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0ebe7bc1-0b92-437f-802e-e9e86c1a4582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0537aba2433e4d2891e851c9bcb3bd91'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:19.671416 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0ebe7bc1-0b92-437f-802e-e9e86c1a4582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0537aba2433e4d2891e851c9bcb3bd91'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:19.679978 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0ebe7bc1-0b92-437f-802e-e9e86c1a4582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0537aba2433e4d2891e851c9bcb3bd91'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:19.696358 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1391/2772] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:43:19 2022] DELETE /identity/v3/users/0537aba2433e4d2891e851c9bcb3bd91 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:43:19.702594 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d7f23-91be-4723-bd70-9b6cbdb4bc04 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:19.703158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d7f23-91be-4723-bd70-9b6cbdb4bc04 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:19.703158 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d7f23-91be-4723-bd70-9b6cbdb4bc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:19.722101 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d40d7f23-91be-4723-bd70-9b6cbdb4bc04 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:43:19.723308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d40d7f23-91be-4723-bd70-9b6cbdb4bc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:19.795804 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1382/2773] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:43:19.806071 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe7bc1-0b92-437f-802e-e9e86c1a4582 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:19.807746 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-0ebe7bc1-0b92-437f-802e-e9e86c1a4582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:19.866939 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe7bc1-0b92-437f-802e-e9e86c1a4582 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:19.870759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef0454-211e-407e-a7e5-0d01a32e77de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:19.871411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef0454-211e-407e-a7e5-0d01a32e77de service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:19.871697 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef0454-211e-407e-a7e5-0d01a32e77de service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:19.871976 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef0454-211e-407e-a7e5-0d01a32e77de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:19.881799 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef0454-211e-407e-a7e5-0d01a32e77de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:19.883270 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef0454-211e-407e-a7e5-0d01a32e77de service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:19.892950 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1392/2774] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:43:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:43:20.186835 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d7f23-91be-4723-bd70-9b6cbdb4bc04 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:20.188425 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d40d7f23-91be-4723-bd70-9b6cbdb4bc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:20.204402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d7f23-91be-4723-bd70-9b6cbdb4bc04 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:20.210716 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973c8e5-5260-4e06-8d79-cb4859fc68cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:20.212193 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973c8e5-5260-4e06-8d79-cb4859fc68cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:20.212539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973c8e5-5260-4e06-8d79-cb4859fc68cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:20.212885 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973c8e5-5260-4e06-8d79-cb4859fc68cd admin admin] PATH_INFO: `/v3/projects/c4052f8b62254d8c9a0b2d00fae7e908` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:20.214747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973c8e5-5260-4e06-8d79-cb4859fc68cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4052f8b62254d8c9a0b2d00fae7e908)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:20.217745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973c8e5-5260-4e06-8d79-cb4859fc68cd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:20.271985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e973c8e5-5260-4e06-8d79-cb4859fc68cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4052f8b62254d8c9a0b2d00fae7e908', 'request_id': 'req-e973c8e5-5260-4e06-8d79-cb4859fc68cd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:20.277678 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e973c8e5-5260-4e06-8d79-cb4859fc68cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4052f8b62254d8c9a0b2d00fae7e908', 'request_id': 'req-e973c8e5-5260-4e06-8d79-cb4859fc68cd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:20.286561 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e973c8e5-5260-4e06-8d79-cb4859fc68cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4052f8b62254d8c9a0b2d00fae7e908', 'request_id': 'req-e973c8e5-5260-4e06-8d79-cb4859fc68cd'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:20.299886 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e973c8e5-5260-4e06-8d79-cb4859fc68cd admin admin] The token cache is being invalidate because project c4052f8b62254d8c9a0b2d00fae7e908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:43:20.300205 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e973c8e5-5260-4e06-8d79-cb4859fc68cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:20.300961 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e973c8e5-5260-4e06-8d79-cb4859fc68cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:20.302950 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1383/2775] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:43:20 2022] DELETE /identity/v3/projects/c4052f8b62254d8c9a0b2d00fae7e908 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:43:29.888797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:30.296513 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:49.901701 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef0454-211e-407e-a7e5-0d01a32e77de service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:49.903945 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a7ef0454-211e-407e-a7e5-0d01a32e77de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:49.918093 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef0454-211e-407e-a7e5-0d01a32e77de service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:49.984224 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c1ba8-39c9-4a01-89b9-ba4c29ea2a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:49.985108 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c1ba8-39c9-4a01-89b9-ba4c29ea2a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:49.985402 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c1ba8-39c9-4a01-89b9-ba4c29ea2a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:49.985666 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c1ba8-39c9-4a01-89b9-ba4c29ea2a08 admin admin] PATH_INFO: `/v3/users/b6264de254d24c43932f28527bea4acc` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:49.986916 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c1ba8-39c9-4a01-89b9-ba4c29ea2a08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6264de254d24c43932f28527bea4acc)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:49.989755 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c1ba8-39c9-4a01-89b9-ba4c29ea2a08 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:50.039429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-580c1ba8-39c9-4a01-89b9-ba4c29ea2a08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6264de254d24c43932f28527bea4acc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:50.040024 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-580c1ba8-39c9-4a01-89b9-ba4c29ea2a08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6264de254d24c43932f28527bea4acc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:50.040637 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-580c1ba8-39c9-4a01-89b9-ba4c29ea2a08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6264de254d24c43932f28527bea4acc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:50.058055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-580c1ba8-39c9-4a01-89b9-ba4c29ea2a08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6264de254d24c43932f28527bea4acc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:50.064764 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-580c1ba8-39c9-4a01-89b9-ba4c29ea2a08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6264de254d24c43932f28527bea4acc'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:50.082498 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1393/2776] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:43:49 2022] DELETE /identity/v3/users/b6264de254d24c43932f28527bea4acc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:43:50.266538 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973c8e5-5260-4e06-8d79-cb4859fc68cd admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:50.268249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-e973c8e5-5260-4e06-8d79-cb4859fc68cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:50.282431 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973c8e5-5260-4e06-8d79-cb4859fc68cd admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:50.349118 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43ec65-9e82-45aa-b8a7-722f90e152ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:50.349970 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43ec65-9e82-45aa-b8a7-722f90e152ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:50.350255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43ec65-9e82-45aa-b8a7-722f90e152ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:50.350538 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43ec65-9e82-45aa-b8a7-722f90e152ff admin admin] PATH_INFO: `/v3/projects/51ed0152b4a14210b54391ed5fb1f02e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:50.351794 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43ec65-9e82-45aa-b8a7-722f90e152ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ed0152b4a14210b54391ed5fb1f02e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:50.354013 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43ec65-9e82-45aa-b8a7-722f90e152ff admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:50.402246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb43ec65-9e82-45aa-b8a7-722f90e152ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ed0152b4a14210b54391ed5fb1f02e', 'request_id': 'req-fb43ec65-9e82-45aa-b8a7-722f90e152ff'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:50.407985 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb43ec65-9e82-45aa-b8a7-722f90e152ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ed0152b4a14210b54391ed5fb1f02e', 'request_id': 'req-fb43ec65-9e82-45aa-b8a7-722f90e152ff'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:50.416954 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb43ec65-9e82-45aa-b8a7-722f90e152ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ed0152b4a14210b54391ed5fb1f02e', 'request_id': 'req-fb43ec65-9e82-45aa-b8a7-722f90e152ff'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:50.428645 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb43ec65-9e82-45aa-b8a7-722f90e152ff admin admin] The token cache is being invalidate because project 51ed0152b4a14210b54391ed5fb1f02e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:43:50.428921 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb43ec65-9e82-45aa-b8a7-722f90e152ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:50.429631 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-fb43ec65-9e82-45aa-b8a7-722f90e152ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:43:50.431265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1384/2777] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:43:50 2022] DELETE /identity/v3/projects/51ed0152b4a14210b54391ed5fb1f02e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:43:50.436490 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a14880-3c2f-4750-9ff9-43356a95d513 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:50.436783 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a14880-3c2f-4750-9ff9-43356a95d513 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:50.437091 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a14880-3c2f-4750-9ff9-43356a95d513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:50.456854 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-24a14880-3c2f-4750-9ff9-43356a95d513 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:43:50.458082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-24a14880-3c2f-4750-9ff9-43356a95d513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:50.537184 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1394/2778] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:43:50.549550 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b61b0-671f-4909-ae9c-13430b6f0171 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:50.549845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b61b0-671f-4909-ae9c-13430b6f0171 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:50.550131 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b61b0-671f-4909-ae9c-13430b6f0171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:50.571116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8f1b61b0-671f-4909-ae9c-13430b6f0171 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:43:50.572379 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8f1b61b0-671f-4909-ae9c-13430b6f0171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:50.580515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1385/2779] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:43:50.585181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a14880-3c2f-4750-9ff9-43356a95d513 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:50.595080 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a14880-3c2f-4750-9ff9-43356a95d513 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:50.599969 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5128757-8bf5-413e-8c17-ae9b11aebf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:50.600648 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5128757-8bf5-413e-8c17-ae9b11aebf23 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:50.600923 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5128757-8bf5-413e-8c17-ae9b11aebf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:50.601193 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5128757-8bf5-413e-8c17-ae9b11aebf23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:50.601974 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5128757-8bf5-413e-8c17-ae9b11aebf23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:43:50.602289 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5128757-8bf5-413e-8c17-ae9b11aebf23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:50.603948 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5128757-8bf5-413e-8c17-ae9b11aebf23 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:50.615897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1395/2780] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:43:50.620407 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b61b0-671f-4909-ae9c-13430b6f0171 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:50.629744 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b61b0-671f-4909-ae9c-13430b6f0171 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:50.634837 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83190b-d2c3-455a-9591-90cf9b9e24d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:50.635517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83190b-d2c3-455a-9591-90cf9b9e24d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:50.635775 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83190b-d2c3-455a-9591-90cf9b9e24d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:50.636081 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83190b-d2c3-455a-9591-90cf9b9e24d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:50.636783 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83190b-d2c3-455a-9591-90cf9b9e24d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:50.638718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83190b-d2c3-455a-9591-90cf9b9e24d6 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:50.667847 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1386/2781] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:43:50 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:43:50.672234 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5128757-8bf5-413e-8c17-ae9b11aebf23 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:50.683562 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5128757-8bf5-413e-8c17-ae9b11aebf23 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:50.687962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:50.749173 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9422cf-1ffc-4967-9b1e-cf6271376134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:50.749854 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9422cf-1ffc-4967-9b1e-cf6271376134 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:50.750144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9422cf-1ffc-4967-9b1e-cf6271376134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:50.750418 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9422cf-1ffc-4967-9b1e-cf6271376134 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:50.751238 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9422cf-1ffc-4967-9b1e-cf6271376134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:50.753300 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9422cf-1ffc-4967-9b1e-cf6271376134 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:50.777611 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1396/2782] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:43:50 2022] POST /identity/v3/users => generated 278 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:43:50.783296 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83190b-d2c3-455a-9591-90cf9b9e24d6 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:50.798416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83190b-d2c3-455a-9591-90cf9b9e24d6 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:50.803495 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb924f-bf2b-436c-8180-bc4d800bae8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:50.804209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb924f-bf2b-436c-8180-bc4d800bae8d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:50.804497 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb924f-bf2b-436c-8180-bc4d800bae8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:50.804776 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb924f-bf2b-436c-8180-bc4d800bae8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:50.805508 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb924f-bf2b-436c-8180-bc4d800bae8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:50.807136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb924f-bf2b-436c-8180-bc4d800bae8d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:50.818769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1387/2783] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:43:50.823422 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9422cf-1ffc-4967-9b1e-cf6271376134 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:50.834695 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9422cf-1ffc-4967-9b1e-cf6271376134 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:50.839729 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed639f02-7a08-4bfc-8d6c-831841ece22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:50.840449 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed639f02-7a08-4bfc-8d6c-831841ece22c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:50.840738 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed639f02-7a08-4bfc-8d6c-831841ece22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:50.841013 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed639f02-7a08-4bfc-8d6c-831841ece22c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:50.841747 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed639f02-7a08-4bfc-8d6c-831841ece22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:50.843389 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed639f02-7a08-4bfc-8d6c-831841ece22c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:50.856996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1397/2784] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:43:50.861265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb924f-bf2b-436c-8180-bc4d800bae8d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:50.871783 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb924f-bf2b-436c-8180-bc4d800bae8d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:50.876905 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaefc13-b8ec-4e26-b160-be9970562b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:50.877793 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaefc13-b8ec-4e26-b160-be9970562b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:50.878082 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaefc13-b8ec-4e26-b160-be9970562b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:50.878900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaefc13-b8ec-4e26-b160-be9970562b7e admin admin] PATH_INFO: `/v3/projects/28ffdc3893d14f0381903c6aadbdab0f/users/fa1dc0bcc7494616a95251127b5c443a/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:50.895918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaefc13-b8ec-4e26-b160-be9970562b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ffdc3893d14f0381903c6aadbdab0f, user_id=fa1dc0bcc7494616a95251127b5c443a, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:50.900188 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaefc13-b8ec-4e26-b160-be9970562b7e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:50.921537 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1388/2785] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:43:50 2022] PUT /identity/v3/projects/28ffdc3893d14f0381903c6aadbdab0f/users/fa1dc0bcc7494616a95251127b5c443a/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:43:50.932396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01231a1-852c-4b8f-a8f8-714e5ce62104 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:50.932920 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01231a1-852c-4b8f-a8f8-714e5ce62104 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:50.932920 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01231a1-852c-4b8f-a8f8-714e5ce62104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:50.961914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-e01231a1-852c-4b8f-a8f8-714e5ce62104 None None] MFA Rules not processed for user `fa1dc0bcc7494616a95251127b5c443a`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:43:50.963159 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e01231a1-852c-4b8f-a8f8-714e5ce62104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:51.031626 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1398/2786] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:43:50 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:43:51.036842 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaefc13-b8ec-4e26-b160-be9970562b7e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:51.069052 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:51.104165 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaefc13-b8ec-4e26-b160-be9970562b7e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:51.109120 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bc873-b8f3-49ea-adc4-0dacb7ef0546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:51.109812 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc873-b8f3-49ea-adc4-0dacb7ef0546 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:51.110095 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc873-b8f3-49ea-adc4-0dacb7ef0546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:51.110371 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bc873-b8f3-49ea-adc4-0dacb7ef0546 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:51.111069 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bc873-b8f3-49ea-adc4-0dacb7ef0546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:51.113174 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bc873-b8f3-49ea-adc4-0dacb7ef0546 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:51.140405 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1389/2787] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:43:51 2022] POST /identity/v3/projects => generated 355 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:43:51.144785 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01231a1-852c-4b8f-a8f8-714e5ce62104 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:51.156178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01231a1-852c-4b8f-a8f8-714e5ce62104 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:51.216314 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d7edc-a577-4ce9-bbb5-10c144842c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:51.216903 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d7edc-a577-4ce9-bbb5-10c144842c4f admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:51.217185 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d7edc-a577-4ce9-bbb5-10c144842c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:51.217445 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d7edc-a577-4ce9-bbb5-10c144842c4f admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:51.218136 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d7edc-a577-4ce9-bbb5-10c144842c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:51.220146 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d7edc-a577-4ce9-bbb5-10c144842c4f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:51.242761 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1399/2788] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:43:51 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:43:51.247249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bc873-b8f3-49ea-adc4-0dacb7ef0546 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:51.258636 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bc873-b8f3-49ea-adc4-0dacb7ef0546 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:51.264478 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d63234-90d3-409e-b2d9-0a943e2be192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:51.265265 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d63234-90d3-409e-b2d9-0a943e2be192 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:51.265419 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d63234-90d3-409e-b2d9-0a943e2be192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:51.265705 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d63234-90d3-409e-b2d9-0a943e2be192 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:51.266461 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d63234-90d3-409e-b2d9-0a943e2be192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:51.268054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d63234-90d3-409e-b2d9-0a943e2be192 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:51.279544 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1390/2789] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:43:51.283895 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d7edc-a577-4ce9-bbb5-10c144842c4f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:51.291013 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:51.295590 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d7edc-a577-4ce9-bbb5-10c144842c4f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:51.301357 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035247c0-040d-4027-b7ed-a845de6eec71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:51.302261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035247c0-040d-4027-b7ed-a845de6eec71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:51.302543 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035247c0-040d-4027-b7ed-a845de6eec71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:51.302814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035247c0-040d-4027-b7ed-a845de6eec71 admin admin] PATH_INFO: `/v3/projects/32fc4f19a5b14fb3aecefa850ecba133/users/f0308db2b90f42deb80333ee6ae745b9/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:51.318721 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035247c0-040d-4027-b7ed-a845de6eec71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fc4f19a5b14fb3aecefa850ecba133, user_id=f0308db2b90f42deb80333ee6ae745b9, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:51.321785 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035247c0-040d-4027-b7ed-a845de6eec71 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:51.337186 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1400/2790] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:43:51 2022] PUT /identity/v3/projects/32fc4f19a5b14fb3aecefa850ecba133/users/f0308db2b90f42deb80333ee6ae745b9/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:43:51.341248 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d63234-90d3-409e-b2d9-0a943e2be192 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:51.352514 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d63234-90d3-409e-b2d9-0a943e2be192 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:51.410729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508c5c4-906b-4197-9de0-09de3aaec83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:51.411406 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508c5c4-906b-4197-9de0-09de3aaec83c admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:51.411687 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508c5c4-906b-4197-9de0-09de3aaec83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:51.411953 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508c5c4-906b-4197-9de0-09de3aaec83c admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:51.412890 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508c5c4-906b-4197-9de0-09de3aaec83c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:51.414554 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508c5c4-906b-4197-9de0-09de3aaec83c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:51.426655 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1391/2791] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:43:51.432591 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035247c0-040d-4027-b7ed-a845de6eec71 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:51.446211 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035247c0-040d-4027-b7ed-a845de6eec71 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:51.454249 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9369d4-5a15-4c32-9940-7cc5af1cb275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:51.455138 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9369d4-5a15-4c32-9940-7cc5af1cb275 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:51.455380 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9369d4-5a15-4c32-9940-7cc5af1cb275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:51.455680 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9369d4-5a15-4c32-9940-7cc5af1cb275 admin admin] PATH_INFO: `/v3/projects/32fc4f19a5b14fb3aecefa850ecba133/users/f0308db2b90f42deb80333ee6ae745b9/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:51.458241 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9369d4-5a15-4c32-9940-7cc5af1cb275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fc4f19a5b14fb3aecefa850ecba133, user_id=f0308db2b90f42deb80333ee6ae745b9, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:51.461004 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9369d4-5a15-4c32-9940-7cc5af1cb275 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:51.471959 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1401/2792] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:43:51 2022] PUT /identity/v3/projects/32fc4f19a5b14fb3aecefa850ecba133/users/f0308db2b90f42deb80333ee6ae745b9/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:43:51.482700 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1c5cd-e0a2-4399-a756-4b364f027f47 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:51.482996 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1c5cd-e0a2-4399-a756-4b364f027f47 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:51.483259 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1c5cd-e0a2-4399-a756-4b364f027f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:51.511225 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-16e1c5cd-e0a2-4399-a756-4b364f027f47 None None] MFA Rules not processed for user `f0308db2b90f42deb80333ee6ae745b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:43:51.512506 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-16e1c5cd-e0a2-4399-a756-4b364f027f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:51.592675 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1392/2793] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:43:51 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:43:51.605244 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9369d4-5a15-4c32-9940-7cc5af1cb275 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:51.607035 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-be9369d4-5a15-4c32-9940-7cc5af1cb275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:43:51.667710 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9369d4-5a15-4c32-9940-7cc5af1cb275 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:51.672404 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd99bc-d3f5-48c5-957e-094893e71bbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:51.673054 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd99bc-d3f5-48c5-957e-094893e71bbc service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:51.673336 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd99bc-d3f5-48c5-957e-094893e71bbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:51.673725 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd99bc-d3f5-48c5-957e-094893e71bbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:51.688666 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd99bc-d3f5-48c5-957e-094893e71bbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:51.690816 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd99bc-d3f5-48c5-957e-094893e71bbc service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:51.701583 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1402/2794] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:43:51 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:43:51.790628 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1c5cd-e0a2-4399-a756-4b364f027f47 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:43:51.801972 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1c5cd-e0a2-4399-a756-4b364f027f47 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:43:51.806038 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7831b3-265c-4b06-8a57-66413e5869fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:43:51.806697 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7831b3-265c-4b06-8a57-66413e5869fc service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:43:51.806965 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7831b3-265c-4b06-8a57-66413e5869fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:43:51.807350 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7831b3-265c-4b06-8a57-66413e5869fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:43:51.827455 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:43:51.868938 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7831b3-265c-4b06-8a57-66413e5869fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:43:51.870420 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7831b3-265c-4b06-8a57-66413e5869fc service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:43:51.880083 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1393/2795] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:43:51 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:44:01.697042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=39,keystone:INSERT=2 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:01.875642 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=18 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:06.955175 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd99bc-d3f5-48c5-957e-094893e71bbc service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:07.021111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd99bc-d3f5-48c5-957e-094893e71bbc service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:07.025970 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe232b57-ef03-42c2-96ee-6bb3163baab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:07.026858 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe232b57-ef03-42c2-96ee-6bb3163baab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:07.027145 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe232b57-ef03-42c2-96ee-6bb3163baab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:07.027421 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe232b57-ef03-42c2-96ee-6bb3163baab0 admin admin] PATH_INFO: `/v3/users/fa1dc0bcc7494616a95251127b5c443a` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:07.028715 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe232b57-ef03-42c2-96ee-6bb3163baab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa1dc0bcc7494616a95251127b5c443a)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:07.030646 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe232b57-ef03-42c2-96ee-6bb3163baab0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:07.092969 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe232b57-ef03-42c2-96ee-6bb3163baab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa1dc0bcc7494616a95251127b5c443a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:07.093879 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe232b57-ef03-42c2-96ee-6bb3163baab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa1dc0bcc7494616a95251127b5c443a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:07.094656 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe232b57-ef03-42c2-96ee-6bb3163baab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa1dc0bcc7494616a95251127b5c443a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:07.108994 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe232b57-ef03-42c2-96ee-6bb3163baab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa1dc0bcc7494616a95251127b5c443a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:07.116061 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-fe232b57-ef03-42c2-96ee-6bb3163baab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa1dc0bcc7494616a95251127b5c443a'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:07.131140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1403/2796] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:44:06 2022] DELETE /identity/v3/users/fa1dc0bcc7494616a95251127b5c443a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:07.135873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43fedd-9947-4957-9b20-9d3660ec7ce8 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:07.136416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43fedd-9947-4957-9b20-9d3660ec7ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:07.136416 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43fedd-9947-4957-9b20-9d3660ec7ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:07.155420 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-be43fedd-9947-4957-9b20-9d3660ec7ce8 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:07.156706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-be43fedd-9947-4957-9b20-9d3660ec7ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:07.228437 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1394/2797] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:44:07.238434 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe232b57-ef03-42c2-96ee-6bb3163baab0 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:07.240003 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fe232b57-ef03-42c2-96ee-6bb3163baab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:07.303912 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe232b57-ef03-42c2-96ee-6bb3163baab0 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:07.307790 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82559382-a2cd-4263-b1d0-34301707969e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:07.308487 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82559382-a2cd-4263-b1d0-34301707969e service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:07.308768 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82559382-a2cd-4263-b1d0-34301707969e service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:07.309035 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82559382-a2cd-4263-b1d0-34301707969e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:07.318634 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82559382-a2cd-4263-b1d0-34301707969e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:07.320144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82559382-a2cd-4263-b1d0-34301707969e service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:07.331310 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1404/2798] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:44:07.614177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43fedd-9947-4957-9b20-9d3660ec7ce8 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:07.615925 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-be43fedd-9947-4957-9b20-9d3660ec7ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:07.628558 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43fedd-9947-4957-9b20-9d3660ec7ce8 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:07.633881 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dbe03-b26a-4ad0-8bc8-c6f51fcb4c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:07.634784 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dbe03-b26a-4ad0-8bc8-c6f51fcb4c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:07.635062 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dbe03-b26a-4ad0-8bc8-c6f51fcb4c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:07.635359 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571dbe03-b26a-4ad0-8bc8-c6f51fcb4c0d admin admin] PATH_INFO: `/v3/projects/28ffdc3893d14f0381903c6aadbdab0f` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:07.636614 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dbe03-b26a-4ad0-8bc8-c6f51fcb4c0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=28ffdc3893d14f0381903c6aadbdab0f)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:07.638968 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571dbe03-b26a-4ad0-8bc8-c6f51fcb4c0d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:07.701183 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-571dbe03-b26a-4ad0-8bc8-c6f51fcb4c0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28ffdc3893d14f0381903c6aadbdab0f', 'request_id': 'req-571dbe03-b26a-4ad0-8bc8-c6f51fcb4c0d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:07.707011 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-571dbe03-b26a-4ad0-8bc8-c6f51fcb4c0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28ffdc3893d14f0381903c6aadbdab0f', 'request_id': 'req-571dbe03-b26a-4ad0-8bc8-c6f51fcb4c0d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:07.716037 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-571dbe03-b26a-4ad0-8bc8-c6f51fcb4c0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28ffdc3893d14f0381903c6aadbdab0f', 'request_id': 'req-571dbe03-b26a-4ad0-8bc8-c6f51fcb4c0d'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:07.727309 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-571dbe03-b26a-4ad0-8bc8-c6f51fcb4c0d admin admin] The token cache is being invalidate because project 28ffdc3893d14f0381903c6aadbdab0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:44:07.727593 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-571dbe03-b26a-4ad0-8bc8-c6f51fcb4c0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:07.728259 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-571dbe03-b26a-4ad0-8bc8-c6f51fcb4c0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:07.729853 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1395/2799] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:44:07 2022] DELETE /identity/v3/projects/28ffdc3893d14f0381903c6aadbdab0f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:07.734396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82559382-a2cd-4263-b1d0-34301707969e service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:07.744163 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82559382-a2cd-4263-b1d0-34301707969e service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:07.780950 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:07.831771 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb254c9-e847-4994-b059-686debae13cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:07.832668 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb254c9-e847-4994-b059-686debae13cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:07.832924 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb254c9-e847-4994-b059-686debae13cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:07.833228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb254c9-e847-4994-b059-686debae13cc admin admin] PATH_INFO: `/v3/users/f0308db2b90f42deb80333ee6ae745b9` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:07.834442 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb254c9-e847-4994-b059-686debae13cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0308db2b90f42deb80333ee6ae745b9)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:07.836646 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb254c9-e847-4994-b059-686debae13cc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:07.896511 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cfb254c9-e847-4994-b059-686debae13cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0308db2b90f42deb80333ee6ae745b9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:07.897315 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cfb254c9-e847-4994-b059-686debae13cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0308db2b90f42deb80333ee6ae745b9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:07.898079 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cfb254c9-e847-4994-b059-686debae13cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0308db2b90f42deb80333ee6ae745b9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:07.915506 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cfb254c9-e847-4994-b059-686debae13cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0308db2b90f42deb80333ee6ae745b9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:07.925915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-cfb254c9-e847-4994-b059-686debae13cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0308db2b90f42deb80333ee6ae745b9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:07.944216 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1405/2800] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:44:07 2022] DELETE /identity/v3/users/f0308db2b90f42deb80333ee6ae745b9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:08.236646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dbe03-b26a-4ad0-8bc8-c6f51fcb4c0d admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:08.238735 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-571dbe03-b26a-4ad0-8bc8-c6f51fcb4c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:08.262737 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571dbe03-b26a-4ad0-8bc8-c6f51fcb4c0d admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:08.323618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf677f-718a-4729-87b5-f95357680702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:08.324529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf677f-718a-4729-87b5-f95357680702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:08.324821 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf677f-718a-4729-87b5-f95357680702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:08.325053 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf677f-718a-4729-87b5-f95357680702 admin admin] PATH_INFO: `/v3/projects/32fc4f19a5b14fb3aecefa850ecba133` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:08.326457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf677f-718a-4729-87b5-f95357680702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32fc4f19a5b14fb3aecefa850ecba133)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:08.328424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf677f-718a-4729-87b5-f95357680702 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:08.364411 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:08.389246 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-98cf677f-718a-4729-87b5-f95357680702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32fc4f19a5b14fb3aecefa850ecba133', 'request_id': 'req-98cf677f-718a-4729-87b5-f95357680702'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:08.395555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-98cf677f-718a-4729-87b5-f95357680702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32fc4f19a5b14fb3aecefa850ecba133', 'request_id': 'req-98cf677f-718a-4729-87b5-f95357680702'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:08.405233 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-98cf677f-718a-4729-87b5-f95357680702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32fc4f19a5b14fb3aecefa850ecba133', 'request_id': 'req-98cf677f-718a-4729-87b5-f95357680702'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:08.416859 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-98cf677f-718a-4729-87b5-f95357680702 admin admin] The token cache is being invalidate because project 32fc4f19a5b14fb3aecefa850ecba133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:44:08.417142 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-98cf677f-718a-4729-87b5-f95357680702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:08.417770 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-98cf677f-718a-4729-87b5-f95357680702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:08.419990 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1396/2801] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:44:08 2022] DELETE /identity/v3/projects/32fc4f19a5b14fb3aecefa850ecba133 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:08.425252 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0d4ec-d031-40a4-a575-361c79a980d9 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:08.425739 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0d4ec-d031-40a4-a575-361c79a980d9 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:08.425854 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0d4ec-d031-40a4-a575-361c79a980d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:08.446542 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-10e0d4ec-d031-40a4-a575-361c79a980d9 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:08.447780 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-10e0d4ec-d031-40a4-a575-361c79a980d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:08.518454 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1406/2802] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:44:08.527772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3336c3f-cf0d-45f6-ac8c-3eefec535631 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:08.528056 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3336c3f-cf0d-45f6-ac8c-3eefec535631 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:08.528364 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3336c3f-cf0d-45f6-ac8c-3eefec535631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:08.550305 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-d3336c3f-cf0d-45f6-ac8c-3eefec535631 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:08.551532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-d3336c3f-cf0d-45f6-ac8c-3eefec535631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:08.562142 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1397/2803] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:44:08.567509 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0d4ec-d031-40a4-a575-361c79a980d9 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:08.583429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0d4ec-d031-40a4-a575-361c79a980d9 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:08.590059 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f726a5-9bdf-4355-ae21-4a4efcc89ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:08.590725 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f726a5-9bdf-4355-ae21-4a4efcc89ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:08.591057 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f726a5-9bdf-4355-ae21-4a4efcc89ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:08.591457 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f726a5-9bdf-4355-ae21-4a4efcc89ee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:08.592489 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f726a5-9bdf-4355-ae21-4a4efcc89ee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:44:08.592799 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f726a5-9bdf-4355-ae21-4a4efcc89ee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:08.594472 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f726a5-9bdf-4355-ae21-4a4efcc89ee9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:08.606477 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1407/2804] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:44:08.612284 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3336c3f-cf0d-45f6-ac8c-3eefec535631 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:08.625859 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3336c3f-cf0d-45f6-ac8c-3eefec535631 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:08.630703 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8bab4-55c3-4634-98cd-527929887867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:08.631361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8bab4-55c3-4634-98cd-527929887867 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:08.631643 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8bab4-55c3-4634-98cd-527929887867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:08.631918 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8bab4-55c3-4634-98cd-527929887867 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:08.632635 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8bab4-55c3-4634-98cd-527929887867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:08.634562 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8bab4-55c3-4634-98cd-527929887867 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:08.665172 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1398/2805] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:44:08 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:44:08.669647 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f726a5-9bdf-4355-ae21-4a4efcc89ee9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:08.680297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f726a5-9bdf-4355-ae21-4a4efcc89ee9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:08.707521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:08.742279 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9078f-2a08-407e-934f-7b2cbc0516fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:08.742964 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9078f-2a08-407e-934f-7b2cbc0516fc admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:08.743247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9078f-2a08-407e-934f-7b2cbc0516fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:08.743524 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9078f-2a08-407e-934f-7b2cbc0516fc admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:08.744256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9078f-2a08-407e-934f-7b2cbc0516fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:08.746245 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9078f-2a08-407e-934f-7b2cbc0516fc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:08.773353 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1408/2806] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:44:08 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:44:08.779538 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8bab4-55c3-4634-98cd-527929887867 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:08.790448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8bab4-55c3-4634-98cd-527929887867 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:08.795439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8b542-f3ae-448a-a2b7-319c9ebfad12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:08.796207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8b542-f3ae-448a-a2b7-319c9ebfad12 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:08.796522 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8b542-f3ae-448a-a2b7-319c9ebfad12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:08.796801 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8b542-f3ae-448a-a2b7-319c9ebfad12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:08.797532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8b542-f3ae-448a-a2b7-319c9ebfad12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:08.799149 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8b542-f3ae-448a-a2b7-319c9ebfad12 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:08.815082 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1399/2807] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:44:08.817527 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9078f-2a08-407e-934f-7b2cbc0516fc admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:08.830215 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9078f-2a08-407e-934f-7b2cbc0516fc admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:08.836451 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23118658-7687-4a6a-a9fb-d28ef01106f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:08.837152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23118658-7687-4a6a-a9fb-d28ef01106f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:08.837436 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23118658-7687-4a6a-a9fb-d28ef01106f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:08.837707 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23118658-7687-4a6a-a9fb-d28ef01106f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:08.838451 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23118658-7687-4a6a-a9fb-d28ef01106f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:08.840168 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23118658-7687-4a6a-a9fb-d28ef01106f0 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:08.851914 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1409/2808] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:44:08.856444 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8b542-f3ae-448a-a2b7-319c9ebfad12 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:08.867756 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8b542-f3ae-448a-a2b7-319c9ebfad12 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:08.873439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641549c3-40dd-4147-a2d9-a1f1c8d1dddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:08.874869 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641549c3-40dd-4147-a2d9-a1f1c8d1dddd admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:08.874869 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641549c3-40dd-4147-a2d9-a1f1c8d1dddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:08.875097 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641549c3-40dd-4147-a2d9-a1f1c8d1dddd admin admin] PATH_INFO: `/v3/projects/13503b357fd448c48904ed2ffad412b1/users/6c2d4145c6b94ccc9e140110a9d96607/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:08.893351 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641549c3-40dd-4147-a2d9-a1f1c8d1dddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=13503b357fd448c48904ed2ffad412b1, user_id=6c2d4145c6b94ccc9e140110a9d96607, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:08.896238 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641549c3-40dd-4147-a2d9-a1f1c8d1dddd admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:08.915587 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1400/2809] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:44:08 2022] PUT /identity/v3/projects/13503b357fd448c48904ed2ffad412b1/users/6c2d4145c6b94ccc9e140110a9d96607/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:44:08.927612 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0acd0-7dc0-4e77-b515-58fa8565cce6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:08.928298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0acd0-7dc0-4e77-b515-58fa8565cce6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:08.928298 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0acd0-7dc0-4e77-b515-58fa8565cce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:08.956809 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-6df0acd0-7dc0-4e77-b515-58fa8565cce6 None None] MFA Rules not processed for user `6c2d4145c6b94ccc9e140110a9d96607`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:08.958055 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-6df0acd0-7dc0-4e77-b515-58fa8565cce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:09.031679 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1410/2810] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:44:09.035936 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641549c3-40dd-4147-a2d9-a1f1c8d1dddd admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:09.106249 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641549c3-40dd-4147-a2d9-a1f1c8d1dddd admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:09.111549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c0796-c11f-4d0c-aaa6-7ee5e1e328c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:09.112301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0796-c11f-4d0c-aaa6-7ee5e1e328c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:09.112586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0796-c11f-4d0c-aaa6-7ee5e1e328c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:09.112866 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0796-c11f-4d0c-aaa6-7ee5e1e328c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:09.113563 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c0796-c11f-4d0c-aaa6-7ee5e1e328c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:09.115517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c0796-c11f-4d0c-aaa6-7ee5e1e328c8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:09.146124 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1401/2811] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:44:09 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:44:09.150253 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0acd0-7dc0-4e77-b515-58fa8565cce6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:09.162111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0acd0-7dc0-4e77-b515-58fa8565cce6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:09.235036 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b21251-2dd2-4422-a81a-a845d036c182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:09.236617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b21251-2dd2-4422-a81a-a845d036c182 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:09.236617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b21251-2dd2-4422-a81a-a845d036c182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:09.236825 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b21251-2dd2-4422-a81a-a845d036c182 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:09.239946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b21251-2dd2-4422-a81a-a845d036c182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:09.239946 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b21251-2dd2-4422-a81a-a845d036c182 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:09.266193 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1411/2812] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:44:09 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:44:09.270192 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c0796-c11f-4d0c-aaa6-7ee5e1e328c8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:09.281549 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c0796-c11f-4d0c-aaa6-7ee5e1e328c8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:09.293044 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7525bcc-2df5-4a64-9904-9cfc4775dd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:09.293894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7525bcc-2df5-4a64-9904-9cfc4775dd30 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:09.294376 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7525bcc-2df5-4a64-9904-9cfc4775dd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:09.294716 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7525bcc-2df5-4a64-9904-9cfc4775dd30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:09.295788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7525bcc-2df5-4a64-9904-9cfc4775dd30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:09.298024 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7525bcc-2df5-4a64-9904-9cfc4775dd30 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:09.311515 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1402/2813] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:44:09.316440 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b21251-2dd2-4422-a81a-a845d036c182 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:09.327866 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b21251-2dd2-4422-a81a-a845d036c182 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:09.332707 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d782fe-e8ab-4552-8801-6042140f79a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:09.333615 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d782fe-e8ab-4552-8801-6042140f79a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:09.333894 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d782fe-e8ab-4552-8801-6042140f79a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:09.334163 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d782fe-e8ab-4552-8801-6042140f79a2 admin admin] PATH_INFO: `/v3/projects/d793f2f0f25249bcab681b6fbc0716a1/users/f1db2e56afb14536b3e71663e27891fb/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:09.350452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d782fe-e8ab-4552-8801-6042140f79a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d793f2f0f25249bcab681b6fbc0716a1, user_id=f1db2e56afb14536b3e71663e27891fb, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:09.353259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d782fe-e8ab-4552-8801-6042140f79a2 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:09.387059 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1412/2814] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:44:09 2022] PUT /identity/v3/projects/d793f2f0f25249bcab681b6fbc0716a1/users/f1db2e56afb14536b3e71663e27891fb/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:09.389167 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7525bcc-2df5-4a64-9904-9cfc4775dd30 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:09.399652 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7525bcc-2df5-4a64-9904-9cfc4775dd30 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:09.424214 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:09.470468 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4a2f8-aa72-4142-8f3a-146fd3f52e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:09.471131 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4a2f8-aa72-4142-8f3a-146fd3f52e8b admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:09.471414 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4a2f8-aa72-4142-8f3a-146fd3f52e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:09.471689 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4a2f8-aa72-4142-8f3a-146fd3f52e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:09.472492 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4a2f8-aa72-4142-8f3a-146fd3f52e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:09.474155 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4a2f8-aa72-4142-8f3a-146fd3f52e8b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:09.488722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1403/2815] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:44:09.489774 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d782fe-e8ab-4552-8801-6042140f79a2 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:09.497937 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:09.504203 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d782fe-e8ab-4552-8801-6042140f79a2 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:09.511899 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b62b6f-6f2d-48e5-a712-d057db72652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:09.512863 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b62b6f-6f2d-48e5-a712-d057db72652e admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:09.513140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b62b6f-6f2d-48e5-a712-d057db72652e admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:09.513415 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b62b6f-6f2d-48e5-a712-d057db72652e admin admin] PATH_INFO: `/v3/projects/d793f2f0f25249bcab681b6fbc0716a1/users/f1db2e56afb14536b3e71663e27891fb/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:09.516071 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b62b6f-6f2d-48e5-a712-d057db72652e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d793f2f0f25249bcab681b6fbc0716a1, user_id=f1db2e56afb14536b3e71663e27891fb, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:09.518752 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b62b6f-6f2d-48e5-a712-d057db72652e admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:09.530569 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1413/2816] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:44:09 2022] PUT /identity/v3/projects/d793f2f0f25249bcab681b6fbc0716a1/users/f1db2e56afb14536b3e71663e27891fb/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:09.541691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c7272-287f-4927-812c-4b5229d47aab None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:09.541889 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c7272-287f-4927-812c-4b5229d47aab None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:09.542169 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c7272-287f-4927-812c-4b5229d47aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:09.572775 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-774c7272-287f-4927-812c-4b5229d47aab None None] MFA Rules not processed for user `f1db2e56afb14536b3e71663e27891fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:09.574006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-774c7272-287f-4927-812c-4b5229d47aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:09.647325 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1404/2817] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:09 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:44:09.659412 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b62b6f-6f2d-48e5-a712-d057db72652e admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:09.661570 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-09b62b6f-6f2d-48e5-a712-d057db72652e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:09.722915 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b62b6f-6f2d-48e5-a712-d057db72652e admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:09.726848 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d29d7-c733-4a81-8329-3df9b1895b66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:09.727533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d29d7-c733-4a81-8329-3df9b1895b66 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:09.727797 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d29d7-c733-4a81-8329-3df9b1895b66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:09.728111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d29d7-c733-4a81-8329-3df9b1895b66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:09.738042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d29d7-c733-4a81-8329-3df9b1895b66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:09.739521 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d29d7-c733-4a81-8329-3df9b1895b66 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:09.749545 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1414/2818] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:44:09 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:44:09.795993 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c7272-287f-4927-812c-4b5229d47aab None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:09.797710 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-774c7272-287f-4927-812c-4b5229d47aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:09.811638 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c7272-287f-4927-812c-4b5229d47aab None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:09.815861 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbc5c4-4bee-4a4b-9a73-cd0a1e57af7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:09.816532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbc5c4-4bee-4a4b-9a73-cd0a1e57af7b service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:09.816825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbc5c4-4bee-4a4b-9a73-cd0a1e57af7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:09.817092 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbc5c4-4bee-4a4b-9a73-cd0a1e57af7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:09.881907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbc5c4-4bee-4a4b-9a73-cd0a1e57af7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:09.883623 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbc5c4-4bee-4a4b-9a73-cd0a1e57af7b service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:09.892954 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1405/2819] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:44:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:44:12.034808 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d29d7-c733-4a81-8329-3df9b1895b66 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:12.036427 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-089d29d7-c733-4a81-8329-3df9b1895b66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:12.106605 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d29d7-c733-4a81-8329-3df9b1895b66 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:12.110366 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e236e9-f6d4-40c8-a981-d137f9a537fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:12.111026 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e236e9-f6d4-40c8-a981-d137f9a537fe service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:12.111305 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e236e9-f6d4-40c8-a981-d137f9a537fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:12.111576 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e236e9-f6d4-40c8-a981-d137f9a537fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:12.113391 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-e3e236e9-f6d4-40c8-a981-d137f9a537fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:12.123640 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e236e9-f6d4-40c8-a981-d137f9a537fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:12.125167 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e236e9-f6d4-40c8-a981-d137f9a537fe service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:12.134023 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1415/2820] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:44:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:44:12.207840 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbc5c4-4bee-4a4b-9a73-cd0a1e57af7b service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:12.218137 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbc5c4-4bee-4a4b-9a73-cd0a1e57af7b service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:12.222504 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c269c-89ea-4cd9-bb5f-71828b7d8d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:12.223161 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c269c-89ea-4cd9-bb5f-71828b7d8d8c service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:12.223448 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c269c-89ea-4cd9-bb5f-71828b7d8d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:12.223725 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c269c-89ea-4cd9-bb5f-71828b7d8d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:12.225676 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a89c269c-89ea-4cd9-bb5f-71828b7d8d8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:12.273282 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:12.305167 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c269c-89ea-4cd9-bb5f-71828b7d8d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:12.306649 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c269c-89ea-4cd9-bb5f-71828b7d8d8c service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:12.318210 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1406/2821] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:44:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:44:13.319394 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e236e9-f6d4-40c8-a981-d137f9a537fe service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:13.391043 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e236e9-f6d4-40c8-a981-d137f9a537fe service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:13.395542 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cca8cc-5ad5-4dd4-98c6-205155a9c6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:13.396451 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cca8cc-5ad5-4dd4-98c6-205155a9c6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:13.396733 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cca8cc-5ad5-4dd4-98c6-205155a9c6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:13.397008 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cca8cc-5ad5-4dd4-98c6-205155a9c6b3 admin admin] PATH_INFO: `/v3/users/6c2d4145c6b94ccc9e140110a9d96607` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:13.398191 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cca8cc-5ad5-4dd4-98c6-205155a9c6b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c2d4145c6b94ccc9e140110a9d96607)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:13.400214 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cca8cc-5ad5-4dd4-98c6-205155a9c6b3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:13.445408 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:13.457140 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-74cca8cc-5ad5-4dd4-98c6-205155a9c6b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c2d4145c6b94ccc9e140110a9d96607'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:13.457847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-74cca8cc-5ad5-4dd4-98c6-205155a9c6b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c2d4145c6b94ccc9e140110a9d96607'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:13.458498 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-74cca8cc-5ad5-4dd4-98c6-205155a9c6b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c2d4145c6b94ccc9e140110a9d96607'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:13.470383 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-74cca8cc-5ad5-4dd4-98c6-205155a9c6b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c2d4145c6b94ccc9e140110a9d96607'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:13.477622 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-74cca8cc-5ad5-4dd4-98c6-205155a9c6b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c2d4145c6b94ccc9e140110a9d96607'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:13.491929 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1416/2822] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:44:13 2022] DELETE /identity/v3/users/6c2d4145c6b94ccc9e140110a9d96607 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:13.496913 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaff65-65f0-4dad-8e93-6f4380805acd None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:13.497659 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaff65-65f0-4dad-8e93-6f4380805acd None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:13.497659 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaff65-65f0-4dad-8e93-6f4380805acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:13.517642 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-f1aaff65-65f0-4dad-8e93-6f4380805acd None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:13.518871 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f1aaff65-65f0-4dad-8e93-6f4380805acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:13.597027 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1407/2823] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:44:13.607106 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cca8cc-5ad5-4dd4-98c6-205155a9c6b3 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:13.608727 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-74cca8cc-5ad5-4dd4-98c6-205155a9c6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:13.669505 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cca8cc-5ad5-4dd4-98c6-205155a9c6b3 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:13.674456 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9a5d5-e6d3-4f52-85d9-f24225b0c5a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:13.675199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9a5d5-e6d3-4f52-85d9-f24225b0c5a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:13.675554 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9a5d5-e6d3-4f52-85d9-f24225b0c5a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:13.675901 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9a5d5-e6d3-4f52-85d9-f24225b0c5a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:13.685707 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9a5d5-e6d3-4f52-85d9-f24225b0c5a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:13.687174 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9a5d5-e6d3-4f52-85d9-f24225b0c5a8 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:13.697792 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1417/2824] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:44:13.991551 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aaff65-65f0-4dad-8e93-6f4380805acd None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:13.993064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f1aaff65-65f0-4dad-8e93-6f4380805acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:14.022787 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aaff65-65f0-4dad-8e93-6f4380805acd None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:14.033371 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e87d1-491a-4c1f-baa2-525242ba134c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:14.034268 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e87d1-491a-4c1f-baa2-525242ba134c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:14.034726 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e87d1-491a-4c1f-baa2-525242ba134c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:14.034853 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e87d1-491a-4c1f-baa2-525242ba134c admin admin] PATH_INFO: `/v3/projects/13503b357fd448c48904ed2ffad412b1` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:14.036298 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e87d1-491a-4c1f-baa2-525242ba134c admin admin] RBAC: Authorizing `identity:delete_project(project_id=13503b357fd448c48904ed2ffad412b1)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:14.038280 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e87d1-491a-4c1f-baa2-525242ba134c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:14.096232 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-198e87d1-491a-4c1f-baa2-525242ba134c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13503b357fd448c48904ed2ffad412b1', 'request_id': 'req-198e87d1-491a-4c1f-baa2-525242ba134c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:14.102460 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-198e87d1-491a-4c1f-baa2-525242ba134c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13503b357fd448c48904ed2ffad412b1', 'request_id': 'req-198e87d1-491a-4c1f-baa2-525242ba134c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:14.111050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-198e87d1-491a-4c1f-baa2-525242ba134c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13503b357fd448c48904ed2ffad412b1', 'request_id': 'req-198e87d1-491a-4c1f-baa2-525242ba134c'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:14.123359 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-198e87d1-491a-4c1f-baa2-525242ba134c admin admin] The token cache is being invalidate because project 13503b357fd448c48904ed2ffad412b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:44:14.123641 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-198e87d1-491a-4c1f-baa2-525242ba134c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:14.124312 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-198e87d1-491a-4c1f-baa2-525242ba134c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:14.126110 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1408/2825] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:44:13 2022] DELETE /identity/v3/projects/13503b357fd448c48904ed2ffad412b1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:14.130333 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9a5d5-e6d3-4f52-85d9-f24225b0c5a8 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:14.140081 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9a5d5-e6d3-4f52-85d9-f24225b0c5a8 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:14.201964 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be880767-5cc1-4802-93a2-6d740449e679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:14.202852 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be880767-5cc1-4802-93a2-6d740449e679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:14.203130 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be880767-5cc1-4802-93a2-6d740449e679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:14.203499 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be880767-5cc1-4802-93a2-6d740449e679 admin admin] PATH_INFO: `/v3/users/f1db2e56afb14536b3e71663e27891fb` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:14.204776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be880767-5cc1-4802-93a2-6d740449e679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1db2e56afb14536b3e71663e27891fb)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:14.206782 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be880767-5cc1-4802-93a2-6d740449e679 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:14.264640 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-be880767-5cc1-4802-93a2-6d740449e679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1db2e56afb14536b3e71663e27891fb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:14.265874 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-be880767-5cc1-4802-93a2-6d740449e679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1db2e56afb14536b3e71663e27891fb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:14.267110 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-be880767-5cc1-4802-93a2-6d740449e679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1db2e56afb14536b3e71663e27891fb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:14.276430 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:14.281229 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-be880767-5cc1-4802-93a2-6d740449e679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1db2e56afb14536b3e71663e27891fb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:14.289110 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-be880767-5cc1-4802-93a2-6d740449e679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1db2e56afb14536b3e71663e27891fb'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:14.303638 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1418/2826] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:44:14 2022] DELETE /identity/v3/users/f1db2e56afb14536b3e71663e27891fb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:44:14.610456 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e87d1-491a-4c1f-baa2-525242ba134c admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:14.612040 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-198e87d1-491a-4c1f-baa2-525242ba134c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:14.627462 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e87d1-491a-4c1f-baa2-525242ba134c admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:14.681081 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:14.692311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045c87f-146e-4581-a697-b2878fda4c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:14.693707 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045c87f-146e-4581-a697-b2878fda4c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:14.694029 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045c87f-146e-4581-a697-b2878fda4c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:14.694351 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045c87f-146e-4581-a697-b2878fda4c17 admin admin] PATH_INFO: `/v3/projects/d793f2f0f25249bcab681b6fbc0716a1` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:14.695787 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045c87f-146e-4581-a697-b2878fda4c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d793f2f0f25249bcab681b6fbc0716a1)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:14.698095 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045c87f-146e-4581-a697-b2878fda4c17 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:14.748959 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c045c87f-146e-4581-a697-b2878fda4c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd793f2f0f25249bcab681b6fbc0716a1', 'request_id': 'req-c045c87f-146e-4581-a697-b2878fda4c17'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:14.755347 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c045c87f-146e-4581-a697-b2878fda4c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd793f2f0f25249bcab681b6fbc0716a1', 'request_id': 'req-c045c87f-146e-4581-a697-b2878fda4c17'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:14.764929 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c045c87f-146e-4581-a697-b2878fda4c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd793f2f0f25249bcab681b6fbc0716a1', 'request_id': 'req-c045c87f-146e-4581-a697-b2878fda4c17'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:14.777446 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c045c87f-146e-4581-a697-b2878fda4c17 admin admin] The token cache is being invalidate because project d793f2f0f25249bcab681b6fbc0716a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:44:14.777788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c045c87f-146e-4581-a697-b2878fda4c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:14.778373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-c045c87f-146e-4581-a697-b2878fda4c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:14.779955 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1409/2827] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:44:14 2022] DELETE /identity/v3/projects/d793f2f0f25249bcab681b6fbc0716a1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:14.785429 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39cd95-94ab-4854-8ca4-d6babf8388df None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:14.785943 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39cd95-94ab-4854-8ca4-d6babf8388df None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:14.786053 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39cd95-94ab-4854-8ca4-d6babf8388df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:14.806218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-db39cd95-94ab-4854-8ca4-d6babf8388df None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:14.807767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-db39cd95-94ab-4854-8ca4-d6babf8388df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:14.872513 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1419/2828] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:44:14.880781 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a73ae1-adcd-457f-b3f4-087501897840 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:14.881075 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a73ae1-adcd-457f-b3f4-087501897840 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:14.881357 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a73ae1-adcd-457f-b3f4-087501897840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:14.900195 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a6a73ae1-adcd-457f-b3f4-087501897840 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:14.901424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a6a73ae1-adcd-457f-b3f4-087501897840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:14.910446 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1410/2829] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:44:14.914880 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39cd95-94ab-4854-8ca4-d6babf8388df None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:14.925338 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39cd95-94ab-4854-8ca4-d6babf8388df None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:14.930432 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04484825-76e4-4617-99ce-79f805c202aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:14.931109 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04484825-76e4-4617-99ce-79f805c202aa admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:14.931439 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04484825-76e4-4617-99ce-79f805c202aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:14.931712 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04484825-76e4-4617-99ce-79f805c202aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:14.932493 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04484825-76e4-4617-99ce-79f805c202aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:44:14.932911 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04484825-76e4-4617-99ce-79f805c202aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:14.934569 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04484825-76e4-4617-99ce-79f805c202aa admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:14.948533 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1420/2830] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:44:14.953045 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a73ae1-adcd-457f-b3f4-087501897840 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:14.963286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a73ae1-adcd-457f-b3f4-087501897840 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:14.970982 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396d3f4-49cf-472e-9d91-390ebec06c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:14.971270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396d3f4-49cf-472e-9d91-390ebec06c38 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:14.971270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396d3f4-49cf-472e-9d91-390ebec06c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:14.971572 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396d3f4-49cf-472e-9d91-390ebec06c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:14.972358 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396d3f4-49cf-472e-9d91-390ebec06c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:14.974544 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396d3f4-49cf-472e-9d91-390ebec06c38 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:15.012050 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1411/2831] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:44:14 2022] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:44:15.015243 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04484825-76e4-4617-99ce-79f805c202aa admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:15.025502 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04484825-76e4-4617-99ce-79f805c202aa admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:15.082075 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311ca56-7131-427d-ace5-6537ffc39857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:15.082656 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311ca56-7131-427d-ace5-6537ffc39857 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:15.082913 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311ca56-7131-427d-ace5-6537ffc39857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:15.083199 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311ca56-7131-427d-ace5-6537ffc39857 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:15.083869 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311ca56-7131-427d-ace5-6537ffc39857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:15.085859 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d311ca56-7131-427d-ace5-6537ffc39857 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:15.108058 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1421/2832] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:44:15 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:44:15.112571 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396d3f4-49cf-472e-9d91-390ebec06c38 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:15.122973 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396d3f4-49cf-472e-9d91-390ebec06c38 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:15.128195 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9580c5e-3be9-4373-ba06-278d081614de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:15.128876 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9580c5e-3be9-4373-ba06-278d081614de admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:15.129156 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9580c5e-3be9-4373-ba06-278d081614de admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:15.129547 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9580c5e-3be9-4373-ba06-278d081614de admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:15.130274 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9580c5e-3be9-4373-ba06-278d081614de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:15.131867 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9580c5e-3be9-4373-ba06-278d081614de admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:15.149122 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1412/2833] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:44:15.153212 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311ca56-7131-427d-ace5-6537ffc39857 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:15.164106 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311ca56-7131-427d-ace5-6537ffc39857 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:15.169565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d89c08-f174-4a08-b15c-bc9067068848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:15.170247 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d89c08-f174-4a08-b15c-bc9067068848 admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:15.171041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d89c08-f174-4a08-b15c-bc9067068848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:15.171041 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d89c08-f174-4a08-b15c-bc9067068848 admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:15.171662 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d89c08-f174-4a08-b15c-bc9067068848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:15.173993 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d89c08-f174-4a08-b15c-bc9067068848 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:15.185794 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1422/2834] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:44:15.190323 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9580c5e-3be9-4373-ba06-278d081614de admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:15.201007 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9580c5e-3be9-4373-ba06-278d081614de admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:15.206103 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e1eb8-50ec-4a18-b1ca-300729ca817f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:15.207035 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e1eb8-50ec-4a18-b1ca-300729ca817f admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:15.207313 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e1eb8-50ec-4a18-b1ca-300729ca817f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:15.207586 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e1eb8-50ec-4a18-b1ca-300729ca817f admin admin] PATH_INFO: `/v3/projects/190bdfb6759740aeb8ec3a6acde21bac/users/fe9531a477f747efa9a644d9b327ad43/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:15.224035 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e1eb8-50ec-4a18-b1ca-300729ca817f admin admin] RBAC: Authorizing `identity:create_grant(project_id=190bdfb6759740aeb8ec3a6acde21bac, user_id=fe9531a477f747efa9a644d9b327ad43, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:15.226796 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e1eb8-50ec-4a18-b1ca-300729ca817f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:15.253872 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1413/2835] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:44:15 2022] PUT /identity/v3/projects/190bdfb6759740aeb8ec3a6acde21bac/users/fe9531a477f747efa9a644d9b327ad43/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:15.264922 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3884fd-3910-4a7c-a720-0848f2c9df96 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:15.265405 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3884fd-3910-4a7c-a720-0848f2c9df96 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:15.266027 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3884fd-3910-4a7c-a720-0848f2c9df96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:15.307677 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-dd3884fd-3910-4a7c-a720-0848f2c9df96 None None] MFA Rules not processed for user `fe9531a477f747efa9a644d9b327ad43`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:15.308956 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dd3884fd-3910-4a7c-a720-0848f2c9df96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:15.341963 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:15.378714 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1423/2836] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:44:15.383499 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e1eb8-50ec-4a18-b1ca-300729ca817f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:15.450494 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e1eb8-50ec-4a18-b1ca-300729ca817f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:15.456758 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517d628-a58b-49a6-a7ad-51efc0165b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:15.457446 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517d628-a58b-49a6-a7ad-51efc0165b85 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:15.457728 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517d628-a58b-49a6-a7ad-51efc0165b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:15.458010 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517d628-a58b-49a6-a7ad-51efc0165b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:15.458706 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517d628-a58b-49a6-a7ad-51efc0165b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:15.460688 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517d628-a58b-49a6-a7ad-51efc0165b85 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:15.490708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1414/2837] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:44:15 2022] POST /identity/v3/projects => generated 399 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:44:15.495022 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3884fd-3910-4a7c-a720-0848f2c9df96 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:15.506352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3884fd-3910-4a7c-a720-0848f2c9df96 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:15.572985 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54c3c3-5b8a-4bb3-9931-8496392fe3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:15.573675 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54c3c3-5b8a-4bb3-9931-8496392fe3ac admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:15.573954 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54c3c3-5b8a-4bb3-9931-8496392fe3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:15.574208 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54c3c3-5b8a-4bb3-9931-8496392fe3ac admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:15.574921 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54c3c3-5b8a-4bb3-9931-8496392fe3ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:15.577530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54c3c3-5b8a-4bb3-9931-8496392fe3ac admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:15.600943 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1424/2838] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:44:15 2022] POST /identity/v3/users => generated 306 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:44:15.604944 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517d628-a58b-49a6-a7ad-51efc0165b85 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:15.612447 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:15.616958 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517d628-a58b-49a6-a7ad-51efc0165b85 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:15.624307 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5504d08-7a53-44f1-a332-b117e21946a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:15.625719 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5504d08-7a53-44f1-a332-b117e21946a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:15.626184 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5504d08-7a53-44f1-a332-b117e21946a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:15.626762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5504d08-7a53-44f1-a332-b117e21946a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:15.627742 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5504d08-7a53-44f1-a332-b117e21946a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:15.629762 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5504d08-7a53-44f1-a332-b117e21946a7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:15.641225 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1415/2839] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:44:15.645816 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54c3c3-5b8a-4bb3-9931-8496392fe3ac admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:15.656519 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54c3c3-5b8a-4bb3-9931-8496392fe3ac admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:15.661690 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e183ae-f4ea-4bae-8f34-c83455734c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:15.662600 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e183ae-f4ea-4bae-8f34-c83455734c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:15.662883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e183ae-f4ea-4bae-8f34-c83455734c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:15.663161 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e183ae-f4ea-4bae-8f34-c83455734c23 admin admin] PATH_INFO: `/v3/projects/a2fd1bd70ca04b7ab2652118c1dd4037/users/e3f1013063ed46b0a369aefdfe66244e/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:15.680941 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e183ae-f4ea-4bae-8f34-c83455734c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2fd1bd70ca04b7ab2652118c1dd4037, user_id=e3f1013063ed46b0a369aefdfe66244e, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:15.683809 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e183ae-f4ea-4bae-8f34-c83455734c23 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:15.700030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1425/2840] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:44:15 2022] PUT /identity/v3/projects/a2fd1bd70ca04b7ab2652118c1dd4037/users/e3f1013063ed46b0a369aefdfe66244e/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:15.704361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5504d08-7a53-44f1-a332-b117e21946a7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:15.714404 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5504d08-7a53-44f1-a332-b117e21946a7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:15.783184 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08ff86-deee-4491-8dcc-cfe46dde0e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:15.783864 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08ff86-deee-4491-8dcc-cfe46dde0e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:15.784192 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08ff86-deee-4491-8dcc-cfe46dde0e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:15.784470 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08ff86-deee-4491-8dcc-cfe46dde0e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:15.785209 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08ff86-deee-4491-8dcc-cfe46dde0e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:15.786844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08ff86-deee-4491-8dcc-cfe46dde0e22 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:15.797540 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1416/2841] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:44:15.802218 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e183ae-f4ea-4bae-8f34-c83455734c23 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:15.813274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e183ae-f4ea-4bae-8f34-c83455734c23 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:15.818764 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e351e0d-ec1d-4b14-b239-7a2bc8ba9559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:15.819657 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e351e0d-ec1d-4b14-b239-7a2bc8ba9559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:15.819938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e351e0d-ec1d-4b14-b239-7a2bc8ba9559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:15.820249 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e351e0d-ec1d-4b14-b239-7a2bc8ba9559 admin admin] PATH_INFO: `/v3/projects/a2fd1bd70ca04b7ab2652118c1dd4037/users/e3f1013063ed46b0a369aefdfe66244e/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:15.822734 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e351e0d-ec1d-4b14-b239-7a2bc8ba9559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2fd1bd70ca04b7ab2652118c1dd4037, user_id=e3f1013063ed46b0a369aefdfe66244e, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:15.825452 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e351e0d-ec1d-4b14-b239-7a2bc8ba9559 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:15.837212 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1426/2842] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:44:15 2022] PUT /identity/v3/projects/a2fd1bd70ca04b7ab2652118c1dd4037/users/e3f1013063ed46b0a369aefdfe66244e/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:15.852325 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37527772-2bd0-4004-890d-4c2e00c0ba14 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:15.852550 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37527772-2bd0-4004-890d-4c2e00c0ba14 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:15.852892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37527772-2bd0-4004-890d-4c2e00c0ba14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:15.893824 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-37527772-2bd0-4004-890d-4c2e00c0ba14 None None] MFA Rules not processed for user `e3f1013063ed46b0a369aefdfe66244e`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:15.895299 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-37527772-2bd0-4004-890d-4c2e00c0ba14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:15.973437 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1417/2843] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:15 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:44:15.985540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e351e0d-ec1d-4b14-b239-7a2bc8ba9559 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:15.987461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4e351e0d-ec1d-4b14-b239-7a2bc8ba9559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:16.050326 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e351e0d-ec1d-4b14-b239-7a2bc8ba9559 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:16.054111 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db52fb3-fc2b-42c9-9473-7b2106b563a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:16.054761 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db52fb3-fc2b-42c9-9473-7b2106b563a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:16.055037 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db52fb3-fc2b-42c9-9473-7b2106b563a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:16.055312 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db52fb3-fc2b-42c9-9473-7b2106b563a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:16.064460 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db52fb3-fc2b-42c9-9473-7b2106b563a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:16.065909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db52fb3-fc2b-42c9-9473-7b2106b563a8 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:16.076068 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1427/2844] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:44:15 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:44:16.164862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37527772-2bd0-4004-890d-4c2e00c0ba14 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:16.177755 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37527772-2bd0-4004-890d-4c2e00c0ba14 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:16.183860 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc833a72-cb16-4e8a-b1fa-70f0256c4f2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:16.184877 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc833a72-cb16-4e8a-b1fa-70f0256c4f2c service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:16.185284 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc833a72-cb16-4e8a-b1fa-70f0256c4f2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:16.185689 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc833a72-cb16-4e8a-b1fa-70f0256c4f2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:16.256403 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc833a72-cb16-4e8a-b1fa-70f0256c4f2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:16.258064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc833a72-cb16-4e8a-b1fa-70f0256c4f2c service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:16.267730 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1418/2845] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:44:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:44:20.430964 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db52fb3-fc2b-42c9-9473-7b2106b563a8 service cinder] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:20.470367 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:20.505678 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db52fb3-fc2b-42c9-9473-7b2106b563a8 service cinder] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:20.510178 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f1f40-9ac0-4886-b40e-86f2b1222aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:20.511065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f1f40-9ac0-4886-b40e-86f2b1222aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:20.511356 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f1f40-9ac0-4886-b40e-86f2b1222aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:20.511633 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f1f40-9ac0-4886-b40e-86f2b1222aae admin admin] PATH_INFO: `/v3/users/fe9531a477f747efa9a644d9b327ad43` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:20.512861 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f1f40-9ac0-4886-b40e-86f2b1222aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe9531a477f747efa9a644d9b327ad43)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:20.514828 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f1f40-9ac0-4886-b40e-86f2b1222aae admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:20.567813 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1e6f1f40-9ac0-4886-b40e-86f2b1222aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe9531a477f747efa9a644d9b327ad43'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:20.568510 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1e6f1f40-9ac0-4886-b40e-86f2b1222aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe9531a477f747efa9a644d9b327ad43'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:20.569125 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1e6f1f40-9ac0-4886-b40e-86f2b1222aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe9531a477f747efa9a644d9b327ad43'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:20.582297 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1e6f1f40-9ac0-4886-b40e-86f2b1222aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe9531a477f747efa9a644d9b327ad43'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:20.589102 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-1e6f1f40-9ac0-4886-b40e-86f2b1222aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe9531a477f747efa9a644d9b327ad43'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:20.604651 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1428/2846] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:44:20 2022] DELETE /identity/v3/users/fe9531a477f747efa9a644d9b327ad43 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:20.609555 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06f6e2-39e7-4f21-a026-8d652b5eb4a2 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:20.610026 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06f6e2-39e7-4f21-a026-8d652b5eb4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:20.610125 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06f6e2-39e7-4f21-a026-8d652b5eb4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:20.629331 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-ce06f6e2-39e7-4f21-a026-8d652b5eb4a2 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:20.630527 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ce06f6e2-39e7-4f21-a026-8d652b5eb4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:20.639057 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=100 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:20.699093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1419/2847] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:44:20.710839 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f1f40-9ac0-4886-b40e-86f2b1222aae admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:20.712556 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1e6f1f40-9ac0-4886-b40e-86f2b1222aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:20.775732 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f1f40-9ac0-4886-b40e-86f2b1222aae admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:20.780098 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3740b-db3a-4755-b6ec-7d374ee92a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:20.780762 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3740b-db3a-4755-b6ec-7d374ee92a2b service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:20.781036 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3740b-db3a-4755-b6ec-7d374ee92a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:20.781308 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3740b-db3a-4755-b6ec-7d374ee92a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:20.791557 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3740b-db3a-4755-b6ec-7d374ee92a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:20.793066 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3740b-db3a-4755-b6ec-7d374ee92a2b service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:20.802970 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1429/2848] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:44:21.099349 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06f6e2-39e7-4f21-a026-8d652b5eb4a2 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:21.100870 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-ce06f6e2-39e7-4f21-a026-8d652b5eb4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:21.113718 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06f6e2-39e7-4f21-a026-8d652b5eb4a2 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:21.119064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc3951-bf02-4b96-890b-1800cb0ebd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:21.119960 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc3951-bf02-4b96-890b-1800cb0ebd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:21.120286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc3951-bf02-4b96-890b-1800cb0ebd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:21.120567 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc3951-bf02-4b96-890b-1800cb0ebd25 admin admin] PATH_INFO: `/v3/projects/190bdfb6759740aeb8ec3a6acde21bac` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:21.121885 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc3951-bf02-4b96-890b-1800cb0ebd25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=190bdfb6759740aeb8ec3a6acde21bac)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:21.123844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc3951-bf02-4b96-890b-1800cb0ebd25 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:21.174385 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cdcc3951-bf02-4b96-890b-1800cb0ebd25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '190bdfb6759740aeb8ec3a6acde21bac', 'request_id': 'req-cdcc3951-bf02-4b96-890b-1800cb0ebd25'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:21.179934 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cdcc3951-bf02-4b96-890b-1800cb0ebd25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '190bdfb6759740aeb8ec3a6acde21bac', 'request_id': 'req-cdcc3951-bf02-4b96-890b-1800cb0ebd25'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:21.189910 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cdcc3951-bf02-4b96-890b-1800cb0ebd25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '190bdfb6759740aeb8ec3a6acde21bac', 'request_id': 'req-cdcc3951-bf02-4b96-890b-1800cb0ebd25'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:21.202399 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cdcc3951-bf02-4b96-890b-1800cb0ebd25 admin admin] The token cache is being invalidate because project 190bdfb6759740aeb8ec3a6acde21bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:44:21.202685 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cdcc3951-bf02-4b96-890b-1800cb0ebd25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:21.203365 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-cdcc3951-bf02-4b96-890b-1800cb0ebd25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:21.205006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1420/2849] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:44:21 2022] DELETE /identity/v3/projects/190bdfb6759740aeb8ec3a6acde21bac => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:21.209163 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3740b-db3a-4755-b6ec-7d374ee92a2b service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:21.219152 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3740b-db3a-4755-b6ec-7d374ee92a2b service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:21.268944 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:21.282816 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43cd7c-b40b-44eb-b407-0d7ebabb98f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:21.283645 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43cd7c-b40b-44eb-b407-0d7ebabb98f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:21.283909 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43cd7c-b40b-44eb-b407-0d7ebabb98f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:21.284228 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43cd7c-b40b-44eb-b407-0d7ebabb98f3 admin admin] PATH_INFO: `/v3/users/e3f1013063ed46b0a369aefdfe66244e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:21.285445 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43cd7c-b40b-44eb-b407-0d7ebabb98f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3f1013063ed46b0a369aefdfe66244e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:21.287431 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43cd7c-b40b-44eb-b407-0d7ebabb98f3 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:21.339969 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2a43cd7c-b40b-44eb-b407-0d7ebabb98f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3f1013063ed46b0a369aefdfe66244e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:21.340657 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2a43cd7c-b40b-44eb-b407-0d7ebabb98f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3f1013063ed46b0a369aefdfe66244e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:21.341266 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2a43cd7c-b40b-44eb-b407-0d7ebabb98f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3f1013063ed46b0a369aefdfe66244e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:21.354491 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2a43cd7c-b40b-44eb-b407-0d7ebabb98f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3f1013063ed46b0a369aefdfe66244e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:21.363478 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-2a43cd7c-b40b-44eb-b407-0d7ebabb98f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3f1013063ed46b0a369aefdfe66244e'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:21.380495 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1430/2850] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:44:21 2022] DELETE /identity/v3/users/e3f1013063ed46b0a369aefdfe66244e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:21.681384 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc3951-bf02-4b96-890b-1800cb0ebd25 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:21.682924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-cdcc3951-bf02-4b96-890b-1800cb0ebd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:21.704920 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc3951-bf02-4b96-890b-1800cb0ebd25 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:21.770862 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8499d-9d9e-40d7-89bc-38d70146f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:21.771937 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8499d-9d9e-40d7-89bc-38d70146f9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:21.772349 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8499d-9d9e-40d7-89bc-38d70146f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:21.772898 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8499d-9d9e-40d7-89bc-38d70146f9bb admin admin] PATH_INFO: `/v3/projects/a2fd1bd70ca04b7ab2652118c1dd4037` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:21.774948 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8499d-9d9e-40d7-89bc-38d70146f9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2fd1bd70ca04b7ab2652118c1dd4037)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:21.777092 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8499d-9d9e-40d7-89bc-38d70146f9bb admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:21.823680 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:21.833722 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1ae8499d-9d9e-40d7-89bc-38d70146f9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2fd1bd70ca04b7ab2652118c1dd4037', 'request_id': 'req-1ae8499d-9d9e-40d7-89bc-38d70146f9bb'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:21.841453 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1ae8499d-9d9e-40d7-89bc-38d70146f9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2fd1bd70ca04b7ab2652118c1dd4037', 'request_id': 'req-1ae8499d-9d9e-40d7-89bc-38d70146f9bb'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:21.851369 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1ae8499d-9d9e-40d7-89bc-38d70146f9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2fd1bd70ca04b7ab2652118c1dd4037', 'request_id': 'req-1ae8499d-9d9e-40d7-89bc-38d70146f9bb'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:21.863467 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1ae8499d-9d9e-40d7-89bc-38d70146f9bb admin admin] The token cache is being invalidate because project a2fd1bd70ca04b7ab2652118c1dd4037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80263) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:44:21.863748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1ae8499d-9d9e-40d7-89bc-38d70146f9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:21.864419 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-1ae8499d-9d9e-40d7-89bc-38d70146f9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:21.866067 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1421/2851] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:44:21 2022] DELETE /identity/v3/projects/a2fd1bd70ca04b7ab2652118c1dd4037 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:21.871520 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ce005-9d5d-4d62-9a11-6326d23d771b None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:21.872058 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ce005-9d5d-4d62-9a11-6326d23d771b None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:21.872058 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ce005-9d5d-4d62-9a11-6326d23d771b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:21.892255 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-992ce005-9d5d-4d62-9a11-6326d23d771b None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:21.894523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-992ce005-9d5d-4d62-9a11-6326d23d771b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:21.965108 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1431/2852] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 16:44:21.973539 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8d480-b23c-45d8-bbf7-c1fa07379f25 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:21.973834 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8d480-b23c-45d8-bbf7-c1fa07379f25 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:21.974114 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8d480-b23c-45d8-bbf7-c1fa07379f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:21.994473 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-5ab8d480-b23c-45d8-bbf7-c1fa07379f25 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:21.995704 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-5ab8d480-b23c-45d8-bbf7-c1fa07379f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:22.005143 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1422/2853] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:44:22.009680 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ce005-9d5d-4d62-9a11-6326d23d771b None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:22.020323 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ce005-9d5d-4d62-9a11-6326d23d771b None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:22.025901 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf72e1-4c3f-4a0f-aa49-4a552138530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:22.026596 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf72e1-4c3f-4a0f-aa49-4a552138530c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:22.026884 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf72e1-4c3f-4a0f-aa49-4a552138530c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:22.027155 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf72e1-4c3f-4a0f-aa49-4a552138530c admin admin] PATH_INFO: `/v3/domains` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:22.027899 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf72e1-4c3f-4a0f-aa49-4a552138530c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80264) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:44:22.028223 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf72e1-4c3f-4a0f-aa49-4a552138530c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:22.029912 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf72e1-4c3f-4a0f-aa49-4a552138530c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:22.045962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1432/2854] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:44:22.050634 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8d480-b23c-45d8-bbf7-c1fa07379f25 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:22.060652 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8d480-b23c-45d8-bbf7-c1fa07379f25 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:22.066128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62299e-48b2-496c-ba68-c96087a02557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:22.066792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62299e-48b2-496c-ba68-c96087a02557 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:22.067102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62299e-48b2-496c-ba68-c96087a02557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:22.067372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62299e-48b2-496c-ba68-c96087a02557 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:22.068123 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62299e-48b2-496c-ba68-c96087a02557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:22.070100 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e62299e-48b2-496c-ba68-c96087a02557 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:22.100976 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1423/2855] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:44:22 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:44:22.105809 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf72e1-4c3f-4a0f-aa49-4a552138530c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:22.116632 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf72e1-4c3f-4a0f-aa49-4a552138530c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:22.178379 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:22.188658 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c636fd6-8ce5-46b1-a1ec-43806be7bcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:22.189522 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636fd6-8ce5-46b1-a1ec-43806be7bcde admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:22.189863 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636fd6-8ce5-46b1-a1ec-43806be7bcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:22.190301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636fd6-8ce5-46b1-a1ec-43806be7bcde admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:22.191190 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c636fd6-8ce5-46b1-a1ec-43806be7bcde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:22.193687 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c636fd6-8ce5-46b1-a1ec-43806be7bcde admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:22.216796 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1433/2856] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:44:22 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:44:22.221825 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62299e-48b2-496c-ba68-c96087a02557 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:22.232476 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62299e-48b2-496c-ba68-c96087a02557 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:22.237822 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87506e-513b-49ed-84e2-0e5da40fbc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:22.238497 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87506e-513b-49ed-84e2-0e5da40fbc58 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:22.238751 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87506e-513b-49ed-84e2-0e5da40fbc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:22.239054 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87506e-513b-49ed-84e2-0e5da40fbc58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:22.239815 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87506e-513b-49ed-84e2-0e5da40fbc58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:22.241413 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87506e-513b-49ed-84e2-0e5da40fbc58 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:22.253561 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1424/2857] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:44:22.257896 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c636fd6-8ce5-46b1-a1ec-43806be7bcde admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:22.269574 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c636fd6-8ce5-46b1-a1ec-43806be7bcde admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:22.275652 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df81f9c-6c36-48ce-a7f4-4f3e38be0ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:22.276373 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df81f9c-6c36-48ce-a7f4-4f3e38be0ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:22.276657 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df81f9c-6c36-48ce-a7f4-4f3e38be0ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:22.276918 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df81f9c-6c36-48ce-a7f4-4f3e38be0ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:22.277641 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df81f9c-6c36-48ce-a7f4-4f3e38be0ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:22.279286 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df81f9c-6c36-48ce-a7f4-4f3e38be0ceb admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:22.290028 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1434/2858] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:44:22.294334 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87506e-513b-49ed-84e2-0e5da40fbc58 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:22.307655 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87506e-513b-49ed-84e2-0e5da40fbc58 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:22.313173 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b0f8c-970d-461e-af0f-54c557ab1de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:22.314095 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b0f8c-970d-461e-af0f-54c557ab1de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:22.314375 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b0f8c-970d-461e-af0f-54c557ab1de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:22.315271 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b0f8c-970d-461e-af0f-54c557ab1de7 admin admin] PATH_INFO: `/v3/projects/a1d7d54b0e9240ff991631ae641ffe17/users/674c0bc550984c1f84f497db6e15be4a/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:22.338521 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b0f8c-970d-461e-af0f-54c557ab1de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d7d54b0e9240ff991631ae641ffe17, user_id=674c0bc550984c1f84f497db6e15be4a, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:22.342642 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b0f8c-970d-461e-af0f-54c557ab1de7 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:22.360411 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1425/2859] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:44:22 2022] PUT /identity/v3/projects/a1d7d54b0e9240ff991631ae641ffe17/users/674c0bc550984c1f84f497db6e15be4a/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 16:44:22.368237 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93de6b-3695-4af1-a607-46f5e5deb870 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:22.368649 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93de6b-3695-4af1-a607-46f5e5deb870 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:22.369006 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93de6b-3695-4af1-a607-46f5e5deb870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:22.390949 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-dd93de6b-3695-4af1-a607-46f5e5deb870 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:22.392227 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-dd93de6b-3695-4af1-a607-46f5e5deb870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:22.462686 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1435/2860] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:44:22.473611 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b0f8c-970d-461e-af0f-54c557ab1de7 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:22.475432 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-891b0f8c-970d-461e-af0f-54c557ab1de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:22.535220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b0f8c-970d-461e-af0f-54c557ab1de7 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:22.541015 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7275e8c-87c3-43d3-85e4-d03a5e3d6b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:22.542027 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7275e8c-87c3-43d3-85e4-d03a5e3d6b40 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:22.542402 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7275e8c-87c3-43d3-85e4-d03a5e3d6b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:22.542845 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7275e8c-87c3-43d3-85e4-d03a5e3d6b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:22.557056 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7275e8c-87c3-43d3-85e4-d03a5e3d6b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:22.558519 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7275e8c-87c3-43d3-85e4-d03a5e3d6b40 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:22.570006 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1426/2861] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:44:23.220454 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73c2f0-6ef8-42c2-a3cf-9edeeca5c744 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:23.221134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73c2f0-6ef8-42c2-a3cf-9edeeca5c744 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:23.221134 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73c2f0-6ef8-42c2-a3cf-9edeeca5c744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:23.250667 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-bd73c2f0-6ef8-42c2-a3cf-9edeeca5c744 None None] MFA Rules not processed for user `674c0bc550984c1f84f497db6e15be4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:23.251891 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-bd73c2f0-6ef8-42c2-a3cf-9edeeca5c744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:23.324795 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1436/2862] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:44:23.329554 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7275e8c-87c3-43d3-85e4-d03a5e3d6b40 service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:23.339746 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7275e8c-87c3-43d3-85e4-d03a5e3d6b40 service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:23.344534 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6704db4-0ccb-42f2-8572-563197b56352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:23.345288 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6704db4-0ccb-42f2-8572-563197b56352 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:23.345625 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6704db4-0ccb-42f2-8572-563197b56352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:23.346179 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6704db4-0ccb-42f2-8572-563197b56352 admin admin] PATH_INFO: `/v3/projects` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:23.346919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6704db4-0ccb-42f2-8572-563197b56352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:23.348873 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6704db4-0ccb-42f2-8572-563197b56352 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:23.378051 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1427/2863] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:44:23 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:44:23.382007 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73c2f0-6ef8-42c2-a3cf-9edeeca5c744 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:23.394638 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73c2f0-6ef8-42c2-a3cf-9edeeca5c744 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:23.452210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8ceed-2add-451b-a1d6-f5ff40ec05c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:23.452897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8ceed-2add-451b-a1d6-f5ff40ec05c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:23.453181 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8ceed-2add-451b-a1d6-f5ff40ec05c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:23.453461 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8ceed-2add-451b-a1d6-f5ff40ec05c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:23.454194 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8ceed-2add-451b-a1d6-f5ff40ec05c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:23.456261 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8ceed-2add-451b-a1d6-f5ff40ec05c4 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:23.465664 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:23.482591 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1437/2864] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:44:23 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 16:44:23.484748 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6704db4-0ccb-42f2-8572-563197b56352 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:23.497361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6704db4-0ccb-42f2-8572-563197b56352 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:23.503744 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff6d0e-b2ae-4f73-82a7-b2fb41663b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:23.504504 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff6d0e-b2ae-4f73-82a7-b2fb41663b91 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:23.504786 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff6d0e-b2ae-4f73-82a7-b2fb41663b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:23.505058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff6d0e-b2ae-4f73-82a7-b2fb41663b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:23.505788 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff6d0e-b2ae-4f73-82a7-b2fb41663b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:23.507459 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff6d0e-b2ae-4f73-82a7-b2fb41663b91 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:23.521152 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1428/2865] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:44:23.525712 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8ceed-2add-451b-a1d6-f5ff40ec05c4 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:23.536270 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8ceed-2add-451b-a1d6-f5ff40ec05c4 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:23.541374 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1c7d1-f7a1-42b7-a9b7-e987a6d586dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:23.542257 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1c7d1-f7a1-42b7-a9b7-e987a6d586dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:23.542534 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1c7d1-f7a1-42b7-a9b7-e987a6d586dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:23.542800 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1c7d1-f7a1-42b7-a9b7-e987a6d586dd admin admin] PATH_INFO: `/v3/projects/c88f770a4c9d48a2888cf732ed8ffb50/users/4588dba7909747088b34e260c024c692/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:23.558352 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1c7d1-f7a1-42b7-a9b7-e987a6d586dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c88f770a4c9d48a2888cf732ed8ffb50, user_id=4588dba7909747088b34e260c024c692, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:23.561072 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1c7d1-f7a1-42b7-a9b7-e987a6d586dd admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:23.577656 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1438/2866] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:44:23 2022] PUT /identity/v3/projects/c88f770a4c9d48a2888cf732ed8ffb50/users/4588dba7909747088b34e260c024c692/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:23.581975 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff6d0e-b2ae-4f73-82a7-b2fb41663b91 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:23.592194 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff6d0e-b2ae-4f73-82a7-b2fb41663b91 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:23.623492 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:23.653540 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc98a80-e596-4837-a3b2-23c010cf13a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:23.654118 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc98a80-e596-4837-a3b2-23c010cf13a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:23.654394 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc98a80-e596-4837-a3b2-23c010cf13a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:23.654665 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc98a80-e596-4837-a3b2-23c010cf13a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:23.655436 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc98a80-e596-4837-a3b2-23c010cf13a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:23.657132 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc98a80-e596-4837-a3b2-23c010cf13a3 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:23.667148 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1429/2867] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:44:23.671962 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1c7d1-f7a1-42b7-a9b7-e987a6d586dd admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:23.683953 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1c7d1-f7a1-42b7-a9b7-e987a6d586dd admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:23.689084 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f8551-98a2-4425-a7f2-75e45ecfeecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:23.690077 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f8551-98a2-4425-a7f2-75e45ecfeecc admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:23.690360 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f8551-98a2-4425-a7f2-75e45ecfeecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:23.690648 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f8551-98a2-4425-a7f2-75e45ecfeecc admin admin] PATH_INFO: `/v3/projects/c88f770a4c9d48a2888cf732ed8ffb50/users/4588dba7909747088b34e260c024c692/roles/e1e39192d3af465aa504728e32ab7cd2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:23.692702 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f8551-98a2-4425-a7f2-75e45ecfeecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c88f770a4c9d48a2888cf732ed8ffb50, user_id=4588dba7909747088b34e260c024c692, role_id=e1e39192d3af465aa504728e32ab7cd2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:23.695386 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f8551-98a2-4425-a7f2-75e45ecfeecc admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:23.706824 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1439/2868] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:44:23 2022] PUT /identity/v3/projects/c88f770a4c9d48a2888cf732ed8ffb50/users/4588dba7909747088b34e260c024c692/roles/e1e39192d3af465aa504728e32ab7cd2 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:24.454708 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8fca3-f050-4487-8abd-54811acaeb73 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:24.455356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8fca3-f050-4487-8abd-54811acaeb73 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:24.455356 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8fca3-f050-4487-8abd-54811acaeb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:24.483856 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-a0c8fca3-f050-4487-8abd-54811acaeb73 None None] MFA Rules not processed for user `4588dba7909747088b34e260c024c692`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:24.485128 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a0c8fca3-f050-4487-8abd-54811acaeb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:24.561099 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1430/2869] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:44:24.572030 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d0a21-b475-45d5-a1d5-43cc7d3afcb2 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:24.572896 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d0a21-b475-45d5-a1d5-43cc7d3afcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:24.572896 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d0a21-b475-45d5-a1d5-43cc7d3afcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:24.596344 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-861d0a21-b475-45d5-a1d5-43cc7d3afcb2 None None] MFA Rules not processed for user `674c0bc550984c1f84f497db6e15be4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:24.597964 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-861d0a21-b475-45d5-a1d5-43cc7d3afcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:24.659201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1440/2870] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:44:24.670885 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8fca3-f050-4487-8abd-54811acaeb73 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:24.672729 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a0c8fca3-f050-4487-8abd-54811acaeb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:24.751131 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8fca3-f050-4487-8abd-54811acaeb73 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:24.757603 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96537a03-3b1a-4445-a12b-e86dbece261f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:24.758262 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96537a03-3b1a-4445-a12b-e86dbece261f service nova] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:24.758546 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96537a03-3b1a-4445-a12b-e86dbece261f service nova] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:24.758823 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96537a03-3b1a-4445-a12b-e86dbece261f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:24.767245 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96537a03-3b1a-4445-a12b-e86dbece261f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:24.769238 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96537a03-3b1a-4445-a12b-e86dbece261f service nova] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:24.778278 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1431/2871] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:44:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:44:34.651535 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:INSERT=3,keystone:SELECT=42 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:34.774167 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=82 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:35.958976 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d0a21-b475-45d5-a1d5-43cc7d3afcb2 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:35.960643 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-861d0a21-b475-45d5-a1d5-43cc7d3afcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:36.031980 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d0a21-b475-45d5-a1d5-43cc7d3afcb2 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:36.035735 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbb48a-0bba-4b87-9cc5-54a8b8774be9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:36.036395 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbb48a-0bba-4b87-9cc5-54a8b8774be9 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:36.036657 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbb48a-0bba-4b87-9cc5-54a8b8774be9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:36.036927 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbb48a-0bba-4b87-9cc5-54a8b8774be9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:36.038756 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-20fbb48a-0bba-4b87-9cc5-54a8b8774be9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:36.052883 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbb48a-0bba-4b87-9cc5-54a8b8774be9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:36.054347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbb48a-0bba-4b87-9cc5-54a8b8774be9 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:36.069064 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1441/2872] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:44:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:44:37.870678 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96537a03-3b1a-4445-a12b-e86dbece261f service nova] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:37.872164 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-96537a03-3b1a-4445-a12b-e86dbece261f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:37.938587 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96537a03-3b1a-4445-a12b-e86dbece261f service nova] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:37.943241 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a8294-fe4e-4946-a0a6-7b5f779e5044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:37.943894 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a8294-fe4e-4946-a0a6-7b5f779e5044 service cinder] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:37.944207 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a8294-fe4e-4946-a0a6-7b5f779e5044 service cinder] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:37.944482 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a8294-fe4e-4946-a0a6-7b5f779e5044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:37.954906 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a8294-fe4e-4946-a0a6-7b5f779e5044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:37.956398 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a8294-fe4e-4946-a0a6-7b5f779e5044 service cinder] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:37.967522 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1432/2873] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:44:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:44:39.916274 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbb48a-0bba-4b87-9cc5-54a8b8774be9 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:39.925145 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbb48a-0bba-4b87-9cc5-54a8b8774be9 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:39.930479 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f856da-3003-4e9f-b088-f711f0dfe648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:39.931349 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f856da-3003-4e9f-b088-f711f0dfe648 service neutron] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:39.931586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f856da-3003-4e9f-b088-f711f0dfe648 service neutron] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:39.931864 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f856da-3003-4e9f-b088-f711f0dfe648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:39.933968 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c1f856da-3003-4e9f-b088-f711f0dfe648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:39.952215 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f856da-3003-4e9f-b088-f711f0dfe648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:39.953704 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f856da-3003-4e9f-b088-f711f0dfe648 service neutron] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:39.967316 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1442/2874] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:44:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:44:47.961919 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=26 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:49.961329 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=32 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:58.138301 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a8294-fe4e-4946-a0a6-7b5f779e5044 service cinder] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:58.226361 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a8294-fe4e-4946-a0a6-7b5f779e5044 service cinder] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:58.231604 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705c9a8-2a4f-44e1-b582-a0b761e7230e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:58.232529 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705c9a8-2a4f-44e1-b582-a0b761e7230e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:58.232813 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705c9a8-2a4f-44e1-b582-a0b761e7230e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:58.233091 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705c9a8-2a4f-44e1-b582-a0b761e7230e admin admin] PATH_INFO: `/v3/users/674c0bc550984c1f84f497db6e15be4a` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:58.234312 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705c9a8-2a4f-44e1-b582-a0b761e7230e admin admin] RBAC: Authorizing `identity:delete_user(user_id=674c0bc550984c1f84f497db6e15be4a)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:58.236286 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705c9a8-2a4f-44e1-b582-a0b761e7230e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:58.298501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2705c9a8-2a4f-44e1-b582-a0b761e7230e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '674c0bc550984c1f84f497db6e15be4a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:58.307844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2705c9a8-2a4f-44e1-b582-a0b761e7230e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '674c0bc550984c1f84f497db6e15be4a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:58.320442 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2705c9a8-2a4f-44e1-b582-a0b761e7230e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '674c0bc550984c1f84f497db6e15be4a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:58.327769 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2705c9a8-2a4f-44e1-b582-a0b761e7230e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '674c0bc550984c1f84f497db6e15be4a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:58.328497 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2705c9a8-2a4f-44e1-b582-a0b761e7230e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '674c0bc550984c1f84f497db6e15be4a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:58.334693 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1433/2875] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:44:58 2022] DELETE /identity/v3/users/674c0bc550984c1f84f497db6e15be4a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:58.541086 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f856da-3003-4e9f-b088-f711f0dfe648 service neutron] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:58.552417 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f856da-3003-4e9f-b088-f711f0dfe648 service neutron] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:58.615207 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d208a3-60b7-4f00-ba98-5b095e9ee427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:58.616071 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d208a3-60b7-4f00-ba98-5b095e9ee427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:58.616372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d208a3-60b7-4f00-ba98-5b095e9ee427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:58.616636 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d208a3-60b7-4f00-ba98-5b095e9ee427 admin admin] PATH_INFO: `/v3/projects/a1d7d54b0e9240ff991631ae641ffe17` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:58.617856 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d208a3-60b7-4f00-ba98-5b095e9ee427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d7d54b0e9240ff991631ae641ffe17)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:58.619779 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d208a3-60b7-4f00-ba98-5b095e9ee427 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:58.668833 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-93d208a3-60b7-4f00-ba98-5b095e9ee427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d7d54b0e9240ff991631ae641ffe17', 'request_id': 'req-93d208a3-60b7-4f00-ba98-5b095e9ee427'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:58.678268 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-93d208a3-60b7-4f00-ba98-5b095e9ee427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d7d54b0e9240ff991631ae641ffe17', 'request_id': 'req-93d208a3-60b7-4f00-ba98-5b095e9ee427'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:58.684996 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-93d208a3-60b7-4f00-ba98-5b095e9ee427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d7d54b0e9240ff991631ae641ffe17', 'request_id': 'req-93d208a3-60b7-4f00-ba98-5b095e9ee427'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:58.696862 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-93d208a3-60b7-4f00-ba98-5b095e9ee427 admin admin] The token cache is being invalidate because project a1d7d54b0e9240ff991631ae641ffe17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:44:58.697150 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-93d208a3-60b7-4f00-ba98-5b095e9ee427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:58.697896 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-93d208a3-60b7-4f00-ba98-5b095e9ee427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:58.699629 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1443/2876] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:44:58 2022] DELETE /identity/v3/projects/a1d7d54b0e9240ff991631ae641ffe17 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:58.704791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705c9a8-2a4f-44e1-b582-a0b761e7230e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:58.706552 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2705c9a8-2a4f-44e1-b582-a0b761e7230e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:58.720175 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705c9a8-2a4f-44e1-b582-a0b761e7230e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:58.782724 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5c395-d5e8-441b-839e-37b602307b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:58.783865 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5c395-d5e8-441b-839e-37b602307b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:58.784214 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5c395-d5e8-441b-839e-37b602307b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:58.784481 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5c395-d5e8-441b-839e-37b602307b1c admin admin] PATH_INFO: `/v3/users/4588dba7909747088b34e260c024c692` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:58.786160 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5c395-d5e8-441b-839e-37b602307b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4588dba7909747088b34e260c024c692)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:58.788565 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5c395-d5e8-441b-839e-37b602307b1c admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:58.811499 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:58.845616 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e9e5c395-d5e8-441b-839e-37b602307b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4588dba7909747088b34e260c024c692'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:58.857719 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e9e5c395-d5e8-441b-839e-37b602307b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4588dba7909747088b34e260c024c692'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:58.877156 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e9e5c395-d5e8-441b-839e-37b602307b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4588dba7909747088b34e260c024c692'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:58.885823 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e9e5c395-d5e8-441b-839e-37b602307b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4588dba7909747088b34e260c024c692'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:58.886588 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-e9e5c395-d5e8-441b-839e-37b602307b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4588dba7909747088b34e260c024c692'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:58.893102 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1434/2877] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:44:58 2022] DELETE /identity/v3/users/4588dba7909747088b34e260c024c692 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:59.079086 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d208a3-60b7-4f00-ba98-5b095e9ee427 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:59.080602 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-93d208a3-60b7-4f00-ba98-5b095e9ee427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:59.095190 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d208a3-60b7-4f00-ba98-5b095e9ee427 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:59.155209 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b993f-7603-4ebe-9f4a-0129d869e1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:59.156124 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b993f-7603-4ebe-9f4a-0129d869e1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:59.156410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b993f-7603-4ebe-9f4a-0129d869e1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:59.156683 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b993f-7603-4ebe-9f4a-0129d869e1af admin admin] PATH_INFO: `/v3/projects/c88f770a4c9d48a2888cf732ed8ffb50` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:59.157874 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b993f-7603-4ebe-9f4a-0129d869e1af admin admin] RBAC: Authorizing `identity:delete_project(project_id=c88f770a4c9d48a2888cf732ed8ffb50)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:59.159817 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b993f-7603-4ebe-9f4a-0129d869e1af admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:59.196238 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:59.209873 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0f8b993f-7603-4ebe-9f4a-0129d869e1af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c88f770a4c9d48a2888cf732ed8ffb50', 'request_id': 'req-0f8b993f-7603-4ebe-9f4a-0129d869e1af'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:59.220392 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0f8b993f-7603-4ebe-9f4a-0129d869e1af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c88f770a4c9d48a2888cf732ed8ffb50', 'request_id': 'req-0f8b993f-7603-4ebe-9f4a-0129d869e1af'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:59.226818 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0f8b993f-7603-4ebe-9f4a-0129d869e1af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c88f770a4c9d48a2888cf732ed8ffb50', 'request_id': 'req-0f8b993f-7603-4ebe-9f4a-0129d869e1af'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:59.238526 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0f8b993f-7603-4ebe-9f4a-0129d869e1af admin admin] The token cache is being invalidate because project c88f770a4c9d48a2888cf732ed8ffb50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:44:59.238893 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0f8b993f-7603-4ebe-9f4a-0129d869e1af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:59.239814 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-0f8b993f-7603-4ebe-9f4a-0129d869e1af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:44:59.241871 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1444/2878] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:44:59 2022] DELETE /identity/v3/projects/c88f770a4c9d48a2888cf732ed8ffb50 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:59.247093 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc50da-bcb2-47b4-86c0-661d3012534a None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:59.247589 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc50da-bcb2-47b4-86c0-661d3012534a None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:59.247692 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc50da-bcb2-47b4-86c0-661d3012534a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:59.267641 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-b0cc50da-bcb2-47b4-86c0-661d3012534a None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:59.268907 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-b0cc50da-bcb2-47b4-86c0-661d3012534a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:59.342136 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1435/2879] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:44:59.351943 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542da94-f3a0-4c72-b2e4-9794bfc3d6f6 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:59.352342 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542da94-f3a0-4c72-b2e4-9794bfc3d6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:59.352504 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542da94-f3a0-4c72-b2e4-9794bfc3d6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:59.373655 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-c542da94-f3a0-4c72-b2e4-9794bfc3d6f6 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:59.374881 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-c542da94-f3a0-4c72-b2e4-9794bfc3d6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:59.384177 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1445/2880] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:44:59.389712 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc50da-bcb2-47b4-86c0-661d3012534a None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:59.401975 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc50da-bcb2-47b4-86c0-661d3012534a None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:59.407798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fca28a-b623-425f-9602-bde5aa911de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:59.408501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fca28a-b623-425f-9602-bde5aa911de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:59.408789 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fca28a-b623-425f-9602-bde5aa911de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:59.409063 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fca28a-b623-425f-9602-bde5aa911de1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:59.409795 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fca28a-b623-425f-9602-bde5aa911de1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:44:59.410105 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fca28a-b623-425f-9602-bde5aa911de1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:59.411755 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fca28a-b623-425f-9602-bde5aa911de1 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:59.424441 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1436/2881] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:44:59.429201 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542da94-f3a0-4c72-b2e4-9794bfc3d6f6 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:59.440523 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542da94-f3a0-4c72-b2e4-9794bfc3d6f6 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:59.447626 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df9fb6-f8e9-42ed-ab60-77c7c75311b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:59.448335 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df9fb6-f8e9-42ed-ab60-77c7c75311b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:59.448623 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df9fb6-f8e9-42ed-ab60-77c7c75311b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:59.448895 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df9fb6-f8e9-42ed-ab60-77c7c75311b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:59.449586 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df9fb6-f8e9-42ed-ab60-77c7c75311b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:59.451653 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df9fb6-f8e9-42ed-ab60-77c7c75311b6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:59.481927 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1446/2882] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:44:59 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:44:59.486198 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fca28a-b623-425f-9602-bde5aa911de1 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:59.497626 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fca28a-b623-425f-9602-bde5aa911de1 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:59.566174 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3eac5-caad-48b3-8594-c5c16068ab10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:59.567204 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3eac5-caad-48b3-8594-c5c16068ab10 admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:59.567522 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3eac5-caad-48b3-8594-c5c16068ab10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:59.567784 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3eac5-caad-48b3-8594-c5c16068ab10 admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:59.568518 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3eac5-caad-48b3-8594-c5c16068ab10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:59.570480 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3eac5-caad-48b3-8594-c5c16068ab10 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:59.593021 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1437/2883] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:44:59 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:44:59.597296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df9fb6-f8e9-42ed-ab60-77c7c75311b6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:59.609705 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df9fb6-f8e9-42ed-ab60-77c7c75311b6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:59.616504 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba457bf-bff1-4fd4-b7ed-9e040d9fe98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:59.618052 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba457bf-bff1-4fd4-b7ed-9e040d9fe98f admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:59.618052 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba457bf-bff1-4fd4-b7ed-9e040d9fe98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:59.618301 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba457bf-bff1-4fd4-b7ed-9e040d9fe98f admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:59.619032 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba457bf-bff1-4fd4-b7ed-9e040d9fe98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:59.621529 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba457bf-bff1-4fd4-b7ed-9e040d9fe98f admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:59.635490 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1447/2884] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:44:59.640822 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3eac5-caad-48b3-8594-c5c16068ab10 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:59.652039 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3eac5-caad-48b3-8594-c5c16068ab10 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:59.657569 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2d926-0930-47c5-a914-d679ffaa2d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:59.658231 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2d926-0930-47c5-a914-d679ffaa2d79 admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:59.658517 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2d926-0930-47c5-a914-d679ffaa2d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:59.658778 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2d926-0930-47c5-a914-d679ffaa2d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:59.659501 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2d926-0930-47c5-a914-d679ffaa2d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:59.661384 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2d926-0930-47c5-a914-d679ffaa2d79 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:59.671878 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1438/2885] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:44:59.676331 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba457bf-bff1-4fd4-b7ed-9e040d9fe98f admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:59.686571 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba457bf-bff1-4fd4-b7ed-9e040d9fe98f admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:59.691658 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4badbd3-95f8-4c61-90c1-194e62005744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:59.692699 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4badbd3-95f8-4c61-90c1-194e62005744 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:59.692983 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4badbd3-95f8-4c61-90c1-194e62005744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:59.693259 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4badbd3-95f8-4c61-90c1-194e62005744 admin admin] PATH_INFO: `/v3/projects/de8a4febb30f48fda895912c873280d2/users/abf31e7c457b4fe0ae68a2ef81a3ac5a/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:59.709659 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4badbd3-95f8-4c61-90c1-194e62005744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8a4febb30f48fda895912c873280d2, user_id=abf31e7c457b4fe0ae68a2ef81a3ac5a, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:59.712464 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4badbd3-95f8-4c61-90c1-194e62005744 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:59.729217 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1448/2886] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:44:59 2022] PUT /identity/v3/projects/de8a4febb30f48fda895912c873280d2/users/abf31e7c457b4fe0ae68a2ef81a3ac5a/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:44:59.739759 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d917c3b-30ba-48d5-9938-f5de6899e313 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:59.740087 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d917c3b-30ba-48d5-9938-f5de6899e313 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:59.740373 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d917c3b-30ba-48d5-9938-f5de6899e313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:59.747508 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:44:59.769840 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-8d917c3b-30ba-48d5-9938-f5de6899e313 None None] MFA Rules not processed for user `abf31e7c457b4fe0ae68a2ef81a3ac5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:44:59.771062 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-8d917c3b-30ba-48d5-9938-f5de6899e313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:59.838507 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1439/2887] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:44:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:44:59.854088 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4badbd3-95f8-4c61-90c1-194e62005744 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:44:59.856799 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-b4badbd3-95f8-4c61-90c1-194e62005744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:44:59.922372 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4badbd3-95f8-4c61-90c1-194e62005744 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:44:59.927299 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82949f6-f831-4fcc-921c-8cec0466dc91 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b72987d279bf4767bad23918fc33302b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:44:59.927959 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82949f6-f831-4fcc-921c-8cec0466dc91 service glance] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:44:59.928266 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82949f6-f831-4fcc-921c-8cec0466dc91 service glance] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:44:59.928540 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82949f6-f831-4fcc-921c-8cec0466dc91 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:44:59.937847 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82949f6-f831-4fcc-921c-8cec0466dc91 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:44:59.940168 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82949f6-f831-4fcc-921c-8cec0466dc91 service glance] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:44:59.949560 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1449/2888] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:44:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:45:09.835296 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=30 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:45:09.944453 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:45:13.441736 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d917c3b-30ba-48d5-9938-f5de6899e313 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:45:13.511969 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d917c3b-30ba-48d5-9938-f5de6899e313 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:45:13.517016 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f3f05-87f0-4042-8a34-8e3ca03a98d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:45:13.517905 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f3f05-87f0-4042-8a34-8e3ca03a98d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:13.518192 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f3f05-87f0-4042-8a34-8e3ca03a98d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:13.518485 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f3f05-87f0-4042-8a34-8e3ca03a98d8 admin admin] PATH_INFO: `/v3/users/abf31e7c457b4fe0ae68a2ef81a3ac5a` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:13.520096 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f3f05-87f0-4042-8a34-8e3ca03a98d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf31e7c457b4fe0ae68a2ef81a3ac5a)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:45:13.522064 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f3f05-87f0-4042-8a34-8e3ca03a98d8 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:45:13.581393 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f56f3f05-87f0-4042-8a34-8e3ca03a98d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf31e7c457b4fe0ae68a2ef81a3ac5a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:13.590125 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f56f3f05-87f0-4042-8a34-8e3ca03a98d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf31e7c457b4fe0ae68a2ef81a3ac5a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:13.602848 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f56f3f05-87f0-4042-8a34-8e3ca03a98d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf31e7c457b4fe0ae68a2ef81a3ac5a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:13.609767 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f56f3f05-87f0-4042-8a34-8e3ca03a98d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf31e7c457b4fe0ae68a2ef81a3ac5a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:13.610564 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-f56f3f05-87f0-4042-8a34-8e3ca03a98d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf31e7c457b4fe0ae68a2ef81a3ac5a'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:13.617903 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1440/2889] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:45:13 2022] DELETE /identity/v3/users/abf31e7c457b4fe0ae68a2ef81a3ac5a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:45:13.622806 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b1491-ca9c-43fb-b61f-af2914adc61f None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:13.623302 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b1491-ca9c-43fb-b61f-af2914adc61f None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:13.623409 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b1491-ca9c-43fb-b61f-af2914adc61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:13.642018 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-a84b1491-ca9c-43fb-b61f-af2914adc61f None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:45:13.643242 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a84b1491-ca9c-43fb-b61f-af2914adc61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:45:13.705654 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1450/2890] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:45:13.718434 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f3f05-87f0-4042-8a34-8e3ca03a98d8 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:45:13.720081 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-f56f3f05-87f0-4042-8a34-8e3ca03a98d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:45:13.791599 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f3f05-87f0-4042-8a34-8e3ca03a98d8 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:45:13.796082 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb55e977-9b3f-47e4-962c-763948b837f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:45:13.796746 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55e977-9b3f-47e4-962c-763948b837f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:13.797034 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55e977-9b3f-47e4-962c-763948b837f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:13.797311 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb55e977-9b3f-47e4-962c-763948b837f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:13.807162 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55e977-9b3f-47e4-962c-763948b837f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:45:13.808662 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb55e977-9b3f-47e4-962c-763948b837f6 service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:45:13.818745 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1441/2891] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:45:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:45:14.119364 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b1491-ca9c-43fb-b61f-af2914adc61f None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:45:14.121065 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-a84b1491-ca9c-43fb-b61f-af2914adc61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:45:14.134177 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b1491-ca9c-43fb-b61f-af2914adc61f None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:45:14.139296 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7eb157-d125-4b6a-8647-1824224e4819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:45:14.140208 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7eb157-d125-4b6a-8647-1824224e4819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:14.140520 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7eb157-d125-4b6a-8647-1824224e4819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:14.140798 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7eb157-d125-4b6a-8647-1824224e4819 admin admin] PATH_INFO: `/v3/projects/de8a4febb30f48fda895912c873280d2` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:14.142042 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7eb157-d125-4b6a-8647-1824224e4819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de8a4febb30f48fda895912c873280d2)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:45:14.144192 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7eb157-d125-4b6a-8647-1824224e4819 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:45:14.198144 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bb7eb157-d125-4b6a-8647-1824224e4819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8a4febb30f48fda895912c873280d2', 'request_id': 'req-bb7eb157-d125-4b6a-8647-1824224e4819'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:14.207838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bb7eb157-d125-4b6a-8647-1824224e4819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8a4febb30f48fda895912c873280d2', 'request_id': 'req-bb7eb157-d125-4b6a-8647-1824224e4819'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:14.214162 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bb7eb157-d125-4b6a-8647-1824224e4819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8a4febb30f48fda895912c873280d2', 'request_id': 'req-bb7eb157-d125-4b6a-8647-1824224e4819'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:14.225394 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bb7eb157-d125-4b6a-8647-1824224e4819 admin admin] The token cache is being invalidate because project de8a4febb30f48fda895912c873280d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:45:14.225765 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bb7eb157-d125-4b6a-8647-1824224e4819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:14.226370 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-bb7eb157-d125-4b6a-8647-1824224e4819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:14.227983 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1451/2892] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:45:14 2022] DELETE /identity/v3/projects/de8a4febb30f48fda895912c873280d2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:45:14.233900 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40affc90-18c8-40c7-99d3-a7933f70a539 None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:14.234262 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40affc90-18c8-40c7-99d3-a7933f70a539 None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:14.234561 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40affc90-18c8-40c7-99d3-a7933f70a539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:14.253443 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-40affc90-18c8-40c7-99d3-a7933f70a539 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:45:14.254747 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-40affc90-18c8-40c7-99d3-a7933f70a539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:45:14.272039 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:45:14.321844 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1442/2893] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:45:14.335256 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417c16f-18bd-4432-8c71-583b512d9169 None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:14.335564 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417c16f-18bd-4432-8c71-583b512d9169 None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:14.335904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417c16f-18bd-4432-8c71-583b512d9169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:14.363046 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-1417c16f-18bd-4432-8c71-583b512d9169 None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:45:14.364565 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-1417c16f-18bd-4432-8c71-583b512d9169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:45:14.374084 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1452/2894] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:45:14.379083 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40affc90-18c8-40c7-99d3-a7933f70a539 None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:45:14.389892 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40affc90-18c8-40c7-99d3-a7933f70a539 None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:45:14.396255 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354bb13-cd9c-4fad-94cc-0378d76c5d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:45:14.396945 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354bb13-cd9c-4fad-94cc-0378d76c5d7b admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:14.397232 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354bb13-cd9c-4fad-94cc-0378d76c5d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:14.397502 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354bb13-cd9c-4fad-94cc-0378d76c5d7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:14.398234 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354bb13-cd9c-4fad-94cc-0378d76c5d7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80263) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 16:45:14.398540 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354bb13-cd9c-4fad-94cc-0378d76c5d7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:45:14.400219 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354bb13-cd9c-4fad-94cc-0378d76c5d7b admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:45:14.413086 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1443/2895] 10.222.0.41 () {58 vars in 1152 bytes} [Fri May 27 16:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 16:45:14.419627 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417c16f-18bd-4432-8c71-583b512d9169 None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:45:14.431432 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417c16f-18bd-4432-8c71-583b512d9169 None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:45:14.437449 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0011d05-651b-4d4a-9072-af686c5b841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:45:14.438133 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0011d05-651b-4d4a-9072-af686c5b841d admin admin] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:14.438410 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0011d05-651b-4d4a-9072-af686c5b841d admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:14.438677 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0011d05-651b-4d4a-9072-af686c5b841d admin admin] PATH_INFO: `/v3/projects` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:14.439375 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0011d05-651b-4d4a-9072-af686c5b841d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:45:14.441416 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0011d05-651b-4d4a-9072-af686c5b841d admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:45:14.471596 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1453/2896] 10.222.0.41 () {60 vars in 1152 bytes} [Fri May 27 16:45:14 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:45:14.476427 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354bb13-cd9c-4fad-94cc-0378d76c5d7b admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:45:14.487179 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354bb13-cd9c-4fad-94cc-0378d76c5d7b admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:45:14.548456 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18625ccb-2e3c-484c-a554-22a4817cd70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:45:14.549151 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18625ccb-2e3c-484c-a554-22a4817cd70e admin admin] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:14.549439 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18625ccb-2e3c-484c-a554-22a4817cd70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:14.549721 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18625ccb-2e3c-484c-a554-22a4817cd70e admin admin] PATH_INFO: `/v3/users` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:14.550484 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18625ccb-2e3c-484c-a554-22a4817cd70e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:45:14.552532 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18625ccb-2e3c-484c-a554-22a4817cd70e admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:45:14.575893 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1444/2897] 10.222.0.41 () {60 vars in 1143 bytes} [Fri May 27 16:45:14 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 16:45:14.580115 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0011d05-651b-4d4a-9072-af686c5b841d admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:45:14.591767 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0011d05-651b-4d4a-9072-af686c5b841d admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:45:14.597576 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f7210-e14f-4b1e-b0bf-1840553f2e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:45:14.598339 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f7210-e14f-4b1e-b0bf-1840553f2e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:14.598617 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f7210-e14f-4b1e-b0bf-1840553f2e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:14.598884 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f7210-e14f-4b1e-b0bf-1840553f2e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:14.599605 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f7210-e14f-4b1e-b0bf-1840553f2e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:45:14.601347 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39f7210-e14f-4b1e-b0bf-1840553f2e3c admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:45:14.614904 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1454/2898] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:45:14.620411 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18625ccb-2e3c-484c-a554-22a4817cd70e admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:45:14.631923 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18625ccb-2e3c-484c-a554-22a4817cd70e admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:45:14.637092 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed541f3-e9f3-4dbc-928a-2af31ee1e61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:45:14.637749 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed541f3-e9f3-4dbc-928a-2af31ee1e61d admin admin] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:14.638033 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed541f3-e9f3-4dbc-928a-2af31ee1e61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:14.638308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed541f3-e9f3-4dbc-928a-2af31ee1e61d admin admin] PATH_INFO: `/v3/roles` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:14.639028 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed541f3-e9f3-4dbc-928a-2af31ee1e61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:45:14.640691 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed541f3-e9f3-4dbc-928a-2af31ee1e61d admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:45:14.651792 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1445/2899] 10.222.0.41 () {58 vars in 1121 bytes} [Fri May 27 16:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 16:45:14.658532 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f7210-e14f-4b1e-b0bf-1840553f2e3c admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:45:14.670082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f7210-e14f-4b1e-b0bf-1840553f2e3c admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:45:14.675385 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac05a1-09a3-458a-96a1-1d045b38c8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:45:14.676411 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac05a1-09a3-458a-96a1-1d045b38c8d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:14.676874 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac05a1-09a3-458a-96a1-1d045b38c8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:14.676874 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac05a1-09a3-458a-96a1-1d045b38c8d6 admin admin] PATH_INFO: `/v3/projects/1b15ea0dec534ba088ce8a2fbac1942d/users/bef0fd1cd893403bb1af70fc6367b769/roles/91889a59745c4d8185400f69d84eb50e` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:14.692512 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac05a1-09a3-458a-96a1-1d045b38c8d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b15ea0dec534ba088ce8a2fbac1942d, user_id=bef0fd1cd893403bb1af70fc6367b769, role_id=91889a59745c4d8185400f69d84eb50e)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:45:14.695210 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac05a1-09a3-458a-96a1-1d045b38c8d6 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:45:14.710912 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1455/2900] 10.222.0.41 () {60 vars in 1482 bytes} [Fri May 27 16:45:14 2022] PUT /identity/v3/projects/1b15ea0dec534ba088ce8a2fbac1942d/users/bef0fd1cd893403bb1af70fc6367b769/roles/91889a59745c4d8185400f69d84eb50e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:45:14.722308 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e9ac5-4aee-423e-98fa-a4c696b4493b None None] REQUEST_METHOD: `POST` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:14.722659 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e9ac5-4aee-423e-98fa-a4c696b4493b None None] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:14.723116 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e9ac5-4aee-423e-98fa-a4c696b4493b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:14.751581 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.auth.core [None req-df6e9ac5-4aee-423e-98fa-a4c696b4493b None None] MFA Rules not processed for user `bef0fd1cd893403bb1af70fc6367b769`. Rule list: `[]` (Enabled: `True`). {{(pid=80263) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:45:14.752829 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-df6e9ac5-4aee-423e-98fa-a4c696b4493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:45:14.820214 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1446/2901] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:45:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:45:14.832969 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac05a1-09a3-458a-96a1-1d045b38c8d6 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:45:14.835304 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-fdac05a1-09a3-458a-96a1-1d045b38c8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:45:14.864287 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:45:14.913032 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac05a1-09a3-458a-96a1-1d045b38c8d6 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:45:14.918163 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f11ac-6bf5-416e-a1b2-81280a1e64d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4561bdacf98d47a6beffbcc400120bcd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:45:14.918827 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f11ac-6bf5-416e-a1b2-81280a1e64d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:14.919124 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f11ac-6bf5-416e-a1b2-81280a1e64d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:14.919381 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f11ac-6bf5-416e-a1b2-81280a1e64d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:14.929576 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f11ac-6bf5-416e-a1b2-81280a1e64d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:45:14.931052 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f11ac-6bf5-416e-a1b2-81280a1e64d3 service cinder] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:45:14.940475 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1456/2902] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:45:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:45:17.531094 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e9ac5-4aee-423e-98fa-a4c696b4493b None None] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:45:17.552451 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:45:17.604392 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e9ac5-4aee-423e-98fa-a4c696b4493b None None] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:45:17.610895 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28984b7a-045f-4d2a-9063-5c8f66c85a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:45:17.612284 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28984b7a-045f-4d2a-9063-5c8f66c85a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:17.612664 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28984b7a-045f-4d2a-9063-5c8f66c85a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:17.612974 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28984b7a-045f-4d2a-9063-5c8f66c85a06 admin admin] PATH_INFO: `/v3/users/bef0fd1cd893403bb1af70fc6367b769` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:17.614646 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28984b7a-045f-4d2a-9063-5c8f66c85a06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bef0fd1cd893403bb1af70fc6367b769)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:45:17.617344 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28984b7a-045f-4d2a-9063-5c8f66c85a06 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:45:17.682721 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-28984b7a-045f-4d2a-9063-5c8f66c85a06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef0fd1cd893403bb1af70fc6367b769'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:17.695325 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-28984b7a-045f-4d2a-9063-5c8f66c85a06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef0fd1cd893403bb1af70fc6367b769'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:17.710137 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-28984b7a-045f-4d2a-9063-5c8f66c85a06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef0fd1cd893403bb1af70fc6367b769'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:17.717652 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-28984b7a-045f-4d2a-9063-5c8f66c85a06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef0fd1cd893403bb1af70fc6367b769'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:17.718451 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-28984b7a-045f-4d2a-9063-5c8f66c85a06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef0fd1cd893403bb1af70fc6367b769'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:17.725199 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1447/2903] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:45:17 2022] DELETE /identity/v3/users/bef0fd1cd893403bb1af70fc6367b769 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:45:17.730070 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb2cbe-385a-4da6-b4c4-26e565b41f9e None None] REQUEST_METHOD: `POST` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:17.730588 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb2cbe-385a-4da6-b4c4-26e565b41f9e None None] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:17.730705 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb2cbe-385a-4da6-b4c4-26e565b41f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:17.755999 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.auth.core [None req-08fb2cbe-385a-4da6-b4c4-26e565b41f9e None None] MFA Rules not processed for user `4ab56873c9924436afdc333a98301e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80264) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 16:45:17.757250 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-08fb2cbe-385a-4da6-b4c4-26e565b41f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:45:17.824838 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1457/2904] 10.222.0.41 () {58 vars in 957 bytes} [Fri May 27 16:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 16:45:17.835329 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28984b7a-045f-4d2a-9063-5c8f66c85a06 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:45:17.837058 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-28984b7a-045f-4d2a-9063-5c8f66c85a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:45:17.899243 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28984b7a-045f-4d2a-9063-5c8f66c85a06 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:45:17.903798 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e525c-91bb-4371-96c0-48ebe2af011e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:45:17.904487 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e525c-91bb-4371-96c0-48ebe2af011e service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:17.904764 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e525c-91bb-4371-96c0-48ebe2af011e service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:17.905042 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e525c-91bb-4371-96c0-48ebe2af011e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:17.915650 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e525c-91bb-4371-96c0-48ebe2af011e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:45:17.917177 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e525c-91bb-4371-96c0-48ebe2af011e service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:45:17.928052 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1448/2905] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 16:45:18.246492 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb2cbe-385a-4da6-b4c4-26e565b41f9e None None] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:45:18.248163 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-08fb2cbe-385a-4da6-b4c4-26e565b41f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:45:18.263643 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb2cbe-385a-4da6-b4c4-26e565b41f9e None None] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:45:18.270093 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73d66a-76b8-47f1-930a-3d18f6ec22e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:45:18.270992 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73d66a-76b8-47f1-930a-3d18f6ec22e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:18.271272 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73d66a-76b8-47f1-930a-3d18f6ec22e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:18.271542 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73d66a-76b8-47f1-930a-3d18f6ec22e9 admin admin] PATH_INFO: `/v3/projects/1b15ea0dec534ba088ce8a2fbac1942d` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:18.273463 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73d66a-76b8-47f1-930a-3d18f6ec22e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b15ea0dec534ba088ce8a2fbac1942d)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:45:18.275547 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73d66a-76b8-47f1-930a-3d18f6ec22e9 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:45:18.332081 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4b73d66a-76b8-47f1-930a-3d18f6ec22e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b15ea0dec534ba088ce8a2fbac1942d', 'request_id': 'req-4b73d66a-76b8-47f1-930a-3d18f6ec22e9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:18.342234 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4b73d66a-76b8-47f1-930a-3d18f6ec22e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b15ea0dec534ba088ce8a2fbac1942d', 'request_id': 'req-4b73d66a-76b8-47f1-930a-3d18f6ec22e9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:18.348691 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4b73d66a-76b8-47f1-930a-3d18f6ec22e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b15ea0dec534ba088ce8a2fbac1942d', 'request_id': 'req-4b73d66a-76b8-47f1-930a-3d18f6ec22e9'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:18.359438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4b73d66a-76b8-47f1-930a-3d18f6ec22e9 admin admin] The token cache is being invalidate because project 1b15ea0dec534ba088ce8a2fbac1942d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:45:18.359729 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4b73d66a-76b8-47f1-930a-3d18f6ec22e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:18.360450 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4b73d66a-76b8-47f1-930a-3d18f6ec22e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:18.362068 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1458/2906] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:45:18 2022] DELETE /identity/v3/projects/1b15ea0dec534ba088ce8a2fbac1942d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:45:27.922805 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:45:28.356250 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:45:30.791791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e525c-91bb-4371-96c0-48ebe2af011e service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:45:30.794094 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-0c4e525c-91bb-4371-96c0-48ebe2af011e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:45:30.808270 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e525c-91bb-4371-96c0-48ebe2af011e service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:45:30.884673 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6ee0b-d8da-4ac1-950c-cea15514b1fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3fe9e871b34a8faed94550e27fefd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:45:30.885838 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6ee0b-d8da-4ac1-950c-cea15514b1fc service neutron] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:30.886332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6ee0b-d8da-4ac1-950c-cea15514b1fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:30.886987 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6ee0b-d8da-4ac1-950c-cea15514b1fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:30.890507 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a2d6ee0b-d8da-4ac1-950c-cea15514b1fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:45:30.905118 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6ee0b-d8da-4ac1-950c-cea15514b1fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:45:30.906149 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6ee0b-d8da-4ac1-950c-cea15514b1fc service neutron] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:45:30.922852 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1449/2907] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:45:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:45:32.808668 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73d66a-76b8-47f1-930a-3d18f6ec22e9 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:45:32.810468 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4b73d66a-76b8-47f1-930a-3d18f6ec22e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:45:32.898995 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73d66a-76b8-47f1-930a-3d18f6ec22e9 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:45:32.905223 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29e908-56e1-4393-aa0d-365c2545d964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3caa3dbc7bd24ebba28296a1eba9cefe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:45:32.905908 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29e908-56e1-4393-aa0d-365c2545d964 service nova] REQUEST_METHOD: `GET` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:32.906191 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29e908-56e1-4393-aa0d-365c2545d964 service nova] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:32.906474 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29e908-56e1-4393-aa0d-365c2545d964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:32.908496 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-5d29e908-56e1-4393-aa0d-365c2545d964 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:45:32.922185 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29e908-56e1-4393-aa0d-365c2545d964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:45:32.923850 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29e908-56e1-4393-aa0d-365c2545d964 service nova] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:45:32.936254 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1459/2908] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:45:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:45:40.918624 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=26 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:45:42.007108 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6ee0b-d8da-4ac1-950c-cea15514b1fc service neutron] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:45:42.008826 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-a2d6ee0b-d8da-4ac1-950c-cea15514b1fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:45:42.096982 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6ee0b-d8da-4ac1-950c-cea15514b1fc service neutron] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:45:42.101882 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd84c4-52da-41b4-9d66-b60e7a0d155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:45:42.102791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd84c4-52da-41b4-9d66-b60e7a0d155f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:42.103101 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd84c4-52da-41b4-9d66-b60e7a0d155f admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:42.103378 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd84c4-52da-41b4-9d66-b60e7a0d155f admin admin] PATH_INFO: `/v3/users/9203cb6fac9443328bb3cc98fa05a894` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:42.104712 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd84c4-52da-41b4-9d66-b60e7a0d155f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9203cb6fac9443328bb3cc98fa05a894)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:45:42.106760 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd84c4-52da-41b4-9d66-b60e7a0d155f admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:45:42.180677 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4cfd84c4-52da-41b4-9d66-b60e7a0d155f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9203cb6fac9443328bb3cc98fa05a894'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:42.193229 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4cfd84c4-52da-41b4-9d66-b60e7a0d155f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9203cb6fac9443328bb3cc98fa05a894'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:42.209940 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4cfd84c4-52da-41b4-9d66-b60e7a0d155f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9203cb6fac9443328bb3cc98fa05a894'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:42.217602 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4cfd84c4-52da-41b4-9d66-b60e7a0d155f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9203cb6fac9443328bb3cc98fa05a894'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:42.218363 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-4cfd84c4-52da-41b4-9d66-b60e7a0d155f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9203cb6fac9443328bb3cc98fa05a894'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:42.224751 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1450/2909] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:45:42 2022] DELETE /identity/v3/users/9203cb6fac9443328bb3cc98fa05a894 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:45:42.421849 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29e908-56e1-4393-aa0d-365c2545d964 service nova] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:45:42.435383 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29e908-56e1-4393-aa0d-365c2545d964 service nova] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:45:42.511082 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c719ad2-5968-4852-9df0-94012ddcac89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:45:42.512068 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c719ad2-5968-4852-9df0-94012ddcac89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:42.512412 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c719ad2-5968-4852-9df0-94012ddcac89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:42.512622 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c719ad2-5968-4852-9df0-94012ddcac89 admin admin] PATH_INFO: `/v3/projects/1098aff20f1b4f94b4075a710b4d44b8` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:42.513985 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c719ad2-5968-4852-9df0-94012ddcac89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1098aff20f1b4f94b4075a710b4d44b8)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:45:42.516001 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c719ad2-5968-4852-9df0-94012ddcac89 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:45:42.579897 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4c719ad2-5968-4852-9df0-94012ddcac89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1098aff20f1b4f94b4075a710b4d44b8', 'request_id': 'req-4c719ad2-5968-4852-9df0-94012ddcac89'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:42.589463 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4c719ad2-5968-4852-9df0-94012ddcac89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1098aff20f1b4f94b4075a710b4d44b8', 'request_id': 'req-4c719ad2-5968-4852-9df0-94012ddcac89'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:42.599759 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4c719ad2-5968-4852-9df0-94012ddcac89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1098aff20f1b4f94b4075a710b4d44b8', 'request_id': 'req-4c719ad2-5968-4852-9df0-94012ddcac89'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:42.616777 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4c719ad2-5968-4852-9df0-94012ddcac89 admin admin] The token cache is being invalidate because project 1098aff20f1b4f94b4075a710b4d44b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:45:42.617108 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4c719ad2-5968-4852-9df0-94012ddcac89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:42.617776 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-4c719ad2-5968-4852-9df0-94012ddcac89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:42.619412 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1460/2910] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:45:42 2022] DELETE /identity/v3/projects/1098aff20f1b4f94b4075a710b4d44b8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:45:42.624111 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd84c4-52da-41b4-9d66-b60e7a0d155f admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:45:42.625631 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-4cfd84c4-52da-41b4-9d66-b60e7a0d155f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:45:42.640316 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd84c4-52da-41b4-9d66-b60e7a0d155f admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:45:42.699519 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220cb8b-09d1-439e-8b6e-d125fe96f698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:45:42.700372 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220cb8b-09d1-439e-8b6e-d125fe96f698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:42.700651 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220cb8b-09d1-439e-8b6e-d125fe96f698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:42.700924 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220cb8b-09d1-439e-8b6e-d125fe96f698 admin admin] PATH_INFO: `/v3/users/5ace1b529ba84867be9c1e70495876e3` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:42.702296 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220cb8b-09d1-439e-8b6e-d125fe96f698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ace1b529ba84867be9c1e70495876e3)` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:45:42.704220 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220cb8b-09d1-439e-8b6e-d125fe96f698 admin admin] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:45:42.729007 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:45:42.758174 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2220cb8b-09d1-439e-8b6e-d125fe96f698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ace1b529ba84867be9c1e70495876e3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:42.767961 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2220cb8b-09d1-439e-8b6e-d125fe96f698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ace1b529ba84867be9c1e70495876e3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:42.781618 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2220cb8b-09d1-439e-8b6e-d125fe96f698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ace1b529ba84867be9c1e70495876e3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:42.789476 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2220cb8b-09d1-439e-8b6e-d125fe96f698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ace1b529ba84867be9c1e70495876e3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:42.790422 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.notifications [None req-2220cb8b-09d1-439e-8b6e-d125fe96f698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ace1b529ba84867be9c1e70495876e3'} {{(pid=80263) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:42.800451 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1451/2911] 10.222.0.41 () {58 vars in 1223 bytes} [Fri May 27 16:45:42 2022] DELETE /identity/v3/users/5ace1b529ba84867be9c1e70495876e3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:45:42.990530 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c719ad2-5968-4852-9df0-94012ddcac89 admin admin] Authenticating user token {{(pid=80264) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:45:42.992142 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.fernet_utils [None req-4c719ad2-5968-4852-9df0-94012ddcac89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80264) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:45:43.014566 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c719ad2-5968-4852-9df0-94012ddcac89 admin admin] Validating token access rules against request {{(pid=80264) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:45:43.037899 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:45:43.095311 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000e2ca-a4d8-4786-b7b4-ca3bd103df05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ab56873c9924436afdc333a98301e78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4a92a8dcb534d23b8816fa07dbb1878', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80264) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:45:43.096438 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000e2ca-a4d8-4786-b7b4-ca3bd103df05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:45:43.096795 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000e2ca-a4d8-4786-b7b4-ca3bd103df05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:45:43.097136 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000e2ca-a4d8-4786-b7b4-ca3bd103df05 admin admin] PATH_INFO: `/v3/projects/ace5b857b63043ef830af9f536df4380` {{(pid=80264) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:45:43.098899 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000e2ca-a4d8-4786-b7b4-ca3bd103df05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace5b857b63043ef830af9f536df4380)` {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:45:43.100981 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000e2ca-a4d8-4786-b7b4-ca3bd103df05 admin admin] RBAC: Authorization granted {{(pid=80264) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:45:43.153234 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8000e2ca-a4d8-4786-b7b4-ca3bd103df05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace5b857b63043ef830af9f536df4380', 'request_id': 'req-8000e2ca-a4d8-4786-b7b4-ca3bd103df05'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:43.162405 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8000e2ca-a4d8-4786-b7b4-ca3bd103df05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace5b857b63043ef830af9f536df4380', 'request_id': 'req-8000e2ca-a4d8-4786-b7b4-ca3bd103df05'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:43.169560 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8000e2ca-a4d8-4786-b7b4-ca3bd103df05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace5b857b63043ef830af9f536df4380', 'request_id': 'req-8000e2ca-a4d8-4786-b7b4-ca3bd103df05'} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:43.180396 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8000e2ca-a4d8-4786-b7b4-ca3bd103df05 admin admin] The token cache is being invalidate because project ace5b857b63043ef830af9f536df4380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80264) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 16:45:43.180685 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8000e2ca-a4d8-4786-b7b4-ca3bd103df05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:43.181350 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG keystone.notifications [None req-8000e2ca-a4d8-4786-b7b4-ca3bd103df05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80264) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 16:45:43.182938 dv-cinder-835553-1-smb devstack@keystone.service[80264]: [pid: 80264|app: 0|req: 1461/2912] 10.222.0.41 () {58 vars in 1232 bytes} [Fri May 27 16:45:42 2022] DELETE /identity/v3/projects/ace5b857b63043ef830af9f536df4380 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 16:45:52.793019 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:45:53.177250 dv-cinder-835553-1-smb devstack@keystone.service[80264]: DEBUG dbcounter [-] [80264] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80264) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 16:47:46.821228 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220cb8b-09d1-439e-8b6e-d125fe96f698 admin admin] Authenticating user token {{(pid=80263) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 16:47:46.823332 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-2220cb8b-09d1-439e-8b6e-d125fe96f698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:47:46.988772 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220cb8b-09d1-439e-8b6e-d125fe96f698 admin admin] Validating token access rules against request {{(pid=80263) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 16:47:47.054417 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae5716-1191-434d-b1f0-e16f85ccd126 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1266a87d93da4f8d9a1ccafa03067169', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8e5c551b621342e5a5a6e742d673d525', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80263) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 16:47:47.055214 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae5716-1191-434d-b1f0-e16f85ccd126 service placement] REQUEST_METHOD: `GET` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 16:47:47.055504 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae5716-1191-434d-b1f0-e16f85ccd126 service placement] SCRIPT_NAME: `/identity` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 16:47:47.055786 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae5716-1191-434d-b1f0-e16f85ccd126 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80263) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 16:47:47.057791 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.fernet_utils [None req-91ae5716-1191-434d-b1f0-e16f85ccd126 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80263) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 16:47:47.069424 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae5716-1191-434d-b1f0-e16f85ccd126 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 16:47:47.071163 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae5716-1191-434d-b1f0-e16f85ccd126 service placement] RBAC: Authorization granted {{(pid=80263) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 16:47:47.081908 dv-cinder-835553-1-smb devstack@keystone.service[80263]: [pid: 80263|app: 0|req: 1452/2913] 10.222.0.41 () {60 vars in 1365 bytes} [Fri May 27 16:47:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 16:47:57.077457 dv-cinder-835553-1-smb devstack@keystone.service[80263]: DEBUG dbcounter [-] [80263] Writing DB stats keystone:SELECT=89 {{(pid=80263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}